-- Logs begin at Wed 2022-08-24 05:05:07 UTC, end at Wed 2022-08-24 06:07:30 UTC. -- Aug 24 05:31:54.469289 dv-cinder-854268-1-smb systemd[1]: Starting Devstack devstack@keystone.service... Aug 24 05:31:54.477873 dv-cinder-854268-1-smb devstack@keystone.service[88101]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 24 05:31:54.479914 dv-cinder-854268-1-smb devstack@keystone.service[88101]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 24 05:31:54 2022] *** Aug 24 05:31:54.479914 dv-cinder-854268-1-smb devstack@keystone.service[88101]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 24 05:31:54.479914 dv-cinder-854268-1-smb devstack@keystone.service[88101]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 24 05:31:54.479914 dv-cinder-854268-1-smb devstack@keystone.service[88101]: nodename: dv-cinder-854268-1-smb Aug 24 05:31:54.479914 dv-cinder-854268-1-smb devstack@keystone.service[88101]: machine: x86_64 Aug 24 05:31:54.479914 dv-cinder-854268-1-smb devstack@keystone.service[88101]: clock source: unix Aug 24 05:31:54.479914 dv-cinder-854268-1-smb devstack@keystone.service[88101]: pcre jit disabled Aug 24 05:31:54.479914 dv-cinder-854268-1-smb devstack@keystone.service[88101]: detected number of CPU cores: 4 Aug 24 05:31:54.479914 dv-cinder-854268-1-smb devstack@keystone.service[88101]: current working directory: / Aug 24 05:31:54.479914 dv-cinder-854268-1-smb devstack@keystone.service[88101]: detected binary path: /usr/bin/uwsgi-core Aug 24 05:31:54.479914 dv-cinder-854268-1-smb devstack@keystone.service[88101]: your processes number limit is 47680 Aug 24 05:31:54.480518 dv-cinder-854268-1-smb devstack@keystone.service[88101]: your memory page size is 4096 bytes Aug 24 05:31:54.480518 dv-cinder-854268-1-smb devstack@keystone.service[88101]: detected max file descriptor number: 2048 Aug 24 05:31:54.480518 dv-cinder-854268-1-smb devstack@keystone.service[88101]: lock engine: pthread robust mutexes Aug 24 05:31:54.480518 dv-cinder-854268-1-smb devstack@keystone.service[88101]: thunder lock: enabled Aug 24 05:31:54.480518 dv-cinder-854268-1-smb devstack@keystone.service[88101]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 24 05:31:54.480518 dv-cinder-854268-1-smb devstack@keystone.service[88101]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 24 05:31:54.519850 dv-cinder-854268-1-smb devstack@keystone.service[88101]: Python main interpreter initialized at 0x556b67cf09c0 Aug 24 05:31:54.519850 dv-cinder-854268-1-smb devstack@keystone.service[88101]: python threads support enabled Aug 24 05:31:54.519850 dv-cinder-854268-1-smb devstack@keystone.service[88101]: your server socket listen backlog is limited to 100 connections Aug 24 05:31:54.519850 dv-cinder-854268-1-smb devstack@keystone.service[88101]: your mercy for graceful operations on workers is 90 seconds Aug 24 05:31:54.520189 dv-cinder-854268-1-smb devstack@keystone.service[88101]: mapped 403077 bytes (393 KB) for 2 cores Aug 24 05:31:54.520281 dv-cinder-854268-1-smb devstack@keystone.service[88101]: *** Operational MODE: preforking *** Aug 24 05:31:54.520543 dv-cinder-854268-1-smb devstack@keystone.service[88101]: *** uWSGI is running in multiple interpreter mode *** Aug 24 05:31:54.520543 dv-cinder-854268-1-smb devstack@keystone.service[88101]: spawned uWSGI master process (pid: 88101) Aug 24 05:31:54.520757 dv-cinder-854268-1-smb systemd[1]: Started Devstack devstack@keystone.service. Aug 24 05:31:54.521518 dv-cinder-854268-1-smb devstack@keystone.service[88101]: spawned uWSGI worker 1 (pid: 88112, cores: 1) Aug 24 05:31:54.521621 dv-cinder-854268-1-smb devstack@keystone.service[88101]: spawned uWSGI worker 2 (pid: 88113, cores: 1) Aug 24 05:31:54.521765 dv-cinder-854268-1-smb devstack@keystone.service[88101]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 24 05:31:58.799329 dv-cinder-854268-1-smb devstack@keystone.service[88112]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 05:31:58.799329 dv-cinder-854268-1-smb devstack@keystone.service[88112]: from cryptography.utils import int_from_bytes Aug 24 05:31:58.800094 dv-cinder-854268-1-smb devstack@keystone.service[88112]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 05:31:58.800094 dv-cinder-854268-1-smb devstack@keystone.service[88112]: from cryptography.utils import int_from_bytes Aug 24 05:31:58.803910 dv-cinder-854268-1-smb devstack@keystone.service[88113]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 05:31:58.803910 dv-cinder-854268-1-smb devstack@keystone.service[88113]: from cryptography.utils import int_from_bytes Aug 24 05:31:58.804403 dv-cinder-854268-1-smb devstack@keystone.service[88113]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 05:31:58.804403 dv-cinder-854268-1-smb devstack@keystone.service[88113]: from cryptography.utils import int_from_bytes Aug 24 05:31:58.850288 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 24 05:31:58.850482 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 24 05:31:58.850677 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] command line args: [] {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 24 05:31:58.850946 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 24 05:31:58.851125 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] ================================================================================ {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 24 05:31:58.851379 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] admin_token = **** {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:31:58.851627 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] config_dir = [] {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:31:58.851817 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:31:58.852001 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] config_source = [] {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:31:58.852183 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] debug = True {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:31:58.852266 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 24 05:31:58.852385 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:31:58.852642 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 24 05:31:58.852642 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] command line args: [] {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 24 05:31:58.852757 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:31:58.852895 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 24 05:31:58.852979 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] insecure_debug = False {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:31:58.853046 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] ================================================================================ {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 24 05:31:58.853168 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:31:58.853254 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] admin_token = **** {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:31:58.853419 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:31:58.853502 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] config_dir = [] {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:31:58.853653 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] list_limit = None {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:31:58.853741 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:31:58.853842 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] config_source = [] {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:31:58.853916 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] log_config_append = None {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:31:58.854057 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:31:58.854132 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] debug = True {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:31:58.854192 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] log_dir = None {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:31:58.854258 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:31:58.854406 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] log_file = None {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:31:58.854486 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:31:58.854605 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:31:58.854683 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] insecure_debug = False {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:31:58.854855 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:31:58.854947 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:31:58.855098 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:31:58.855181 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:31:58.855331 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] list_limit = None {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:31:58.855421 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:31:58.855506 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] log_config_append = None {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:31:58.855579 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:31:58.855677 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:31:58.855808 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:31:58.855891 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] log_dir = None {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:31:58.855981 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:31:58.856059 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] log_file = None {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:31:58.856140 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:31:58.856242 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:31:58.856384 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:31:58.856492 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:31:58.856606 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:31:58.856738 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:31:58.856837 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:31:58.856980 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:31:58.857084 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:31:58.857172 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:31:58.857297 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:31:58.857401 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:31:58.857543 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] notification_format = cadf {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:31:58.857644 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:31:58.857784 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:31:58.857863 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:31:58.858041 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:31:58.858274 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:31:58.858373 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.26/identity {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:31:58.858489 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] publish_errors = False {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:31:58.858579 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:31:58.858721 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:31:58.858805 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:31:58.858953 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:31:58.859029 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:31:58.859150 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:31:58.859284 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] notification_format = cadf {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:31:58.859381 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:31:58.859442 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:31:58.859612 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:31:58.859859 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] standard_threads = False {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:31:58.859961 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.26/identity {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:31:58.860091 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] strict_password_check = False {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:31:58.860172 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] publish_errors = False {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:31:58.860329 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:31:58.860417 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:31:58.860491 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] use_eventlog = False {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:31:58.860561 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:31:58.860673 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] use_journal = False {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:31:58.860764 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:31:58.860881 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] use_json = False {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:31:58.860956 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:31:58.861040 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] use_stderr = False {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:31:58.861177 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] use_syslog = False {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:31:58.861270 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:31:58.861408 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] standard_threads = False {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:31:58.861535 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] watch_log_file = False {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:31:58.861642 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] strict_password_check = False {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:31:58.861726 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.861885 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:31:58.861981 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.862096 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] use_eventlog = False {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:31:58.862204 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.862278 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] use_journal = False {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:31:58.862408 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.862485 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] use_json = False {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:31:58.862595 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] use_stderr = False {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:31:58.862671 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.862771 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] use_syslog = False {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:31:58.862883 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.863004 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] watch_log_file = False {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:31:58.863132 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.863259 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.863371 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.863497 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.863619 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.863753 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.863868 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.863993 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.864119 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.864240 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.864356 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.864477 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.864604 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.864724 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.864842 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.864961 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.865091 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.865206 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.865340 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.865450 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.865578 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.866227 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.866388 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.866477 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.866647 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.866730 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.866896 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.866982 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.867135 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.867222 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.867382 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.867457 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.867617 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.867769 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.867869 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.867946 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.868122 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.868199 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.868355 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.868432 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.868585 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.868661 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.868816 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.868892 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.869055 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.869132 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.869306 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.869382 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.869555 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.869632 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.869784 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.869860 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.870038 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.870119 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.870270 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.870348 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.870505 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.870590 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.870773 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.870857 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.871001 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.871082 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.871231 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.871308 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.871460 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.871537 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.871694 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.871769 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.871927 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.872005 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.872159 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.872235 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.872389 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.872465 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.872623 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.872700 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.872856 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.872931 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.873099 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.873175 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.873342 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.873417 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.873537 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.873610 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.873759 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.873871 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.874008 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.874087 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.874247 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.874323 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.874494 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.874569 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.874723 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.874800 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.874958 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.875071 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.875186 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.875308 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.875421 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.875507 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.875654 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.875740 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.875890 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.875994 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.876119 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.876228 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.876354 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.876493 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.876600 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.876709 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.876805 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.876897 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.877033 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.877121 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.877268 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.877353 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.877480 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.877556 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.877730 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.877816 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.877991 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.878086 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.878206 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.878292 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.878440 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.878520 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.878697 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.878778 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.878933 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.879060 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.879164 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.879242 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.879400 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.879486 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.879635 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.879717 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.879873 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.879949 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.880124 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] cache.enabled = True {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.880204 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.880370 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.880459 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.880608 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.880746 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.880845 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.880928 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.881079 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.881168 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.881359 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.881468 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.882139 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] cache.enabled = True {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.882220 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.882379 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.882511 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.882617 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.882700 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.882857 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.882939 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.883093 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.883222 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.883328 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.883413 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.883562 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.883641 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.883795 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.883885 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.884028 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.884106 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.884264 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.884341 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.884504 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.884592 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.884740 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.884859 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.884973 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.885050 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.885204 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.885356 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.885431 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.885500 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.885658 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.885736 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.885892 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.886025 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.886145 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.886224 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.886374 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.886451 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.886602 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.886679 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.886838 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.886917 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.887069 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.887190 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.887308 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.887385 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.887541 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.887620 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] auth.external = None {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.887782 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] auth.mapped = None {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.887858 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.888016 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.888093 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.888269 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.888348 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.888523 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] auth.password = None {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.888600 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.888758 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] auth.token = None {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.888873 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.888984 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] auth.external = None {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.889069 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.889212 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] auth.mapped = None {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.889292 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] catalog.caching = True {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.889461 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.889537 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.889696 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.889776 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.889939 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] auth.password = None {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.890036 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.890188 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] auth.token = None {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.890266 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.890425 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.890504 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.890663 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] catalog.caching = True {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.890743 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] credential.caching = True {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.890907 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.890986 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] credential.driver = sql {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.891135 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.891215 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.891380 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.891460 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.891619 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.891696 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.891846 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.891924 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.892079 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] credential.caching = True {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.892159 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.892322 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] credential.driver = sql {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.892401 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.892567 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.892646 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.892806 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.892884 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.893038 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.893115 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.893279 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.893363 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.893511 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.893590 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.893770 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.893849 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.894050 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.894132 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.894289 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.894378 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.894539 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.894617 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] federation.caching = True {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.894785 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.894863 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.895035 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] federation.driver = sql {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.895117 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.895286 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.895364 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.895520 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.895598 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.895771 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.895857 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.896003 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] federation.caching = True {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.896081 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.896238 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.896315 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.896481 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] federation.driver = sql {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.896561 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.896726 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.896804 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.896988 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.897072 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.897236 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.897321 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.897472 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] identity.caching = True {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.897560 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.897720 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.897809 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.897980 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.898061 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.898219 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.898296 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.898450 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.898540 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.898696 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.898781 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] identity.driver = sql {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.898927 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.899004 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] identity.caching = True {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.899168 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.899324 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.899400 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.899470 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.899634 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.899712 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.899869 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.899955 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.900101 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.900178 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] identity.driver = sql {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.900333 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.900409 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.900572 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.900697 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.900817 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.900900 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.901064 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.901146 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.901292 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.901382 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.901522 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.901605 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.901750 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.901831 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.902028 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.902125 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.902260 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.902341 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.902505 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.902586 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.902744 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.902833 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.902979 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.903061 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.903218 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.903300 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.903461 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.903551 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.903694 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.903774 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.903924 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.904005 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.904158 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.904247 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.904385 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.904466 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.904620 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.904701 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.904856 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.904989 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.905095 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.905180 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.905343 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.905439 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.905570 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.905658 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.905805 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.905885 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.906061 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] ldap.password = **** {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.906144 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.906302 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.906396 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.906543 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.906623 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.906787 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.906904 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.907019 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.907150 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.907253 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.907391 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.907473 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] ldap.password = **** {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.907646 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.907735 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.907899 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.907981 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.908134 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.908222 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.908369 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.908458 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.908598 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.908700 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.908845 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.908935 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.909083 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.909176 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.909310 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.909391 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.909538 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.909620 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.909771 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] ldap.user = None {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.909860 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.910036 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.910122 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.910273 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.910353 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.910508 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.910601 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.910746 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.910827 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.910974 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] ldap.user = None {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.911054 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.911210 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.911299 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.911466 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.911545 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.911705 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.911806 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.911926 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.912021 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.912165 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.912246 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.912404 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.912491 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.912658 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.912746 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.912887 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.912974 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.913118 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.913199 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.913351 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.913440 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.913615 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.913694 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.913862 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.913964 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.914128 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.914222 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.914378 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.914459 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.914619 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.914700 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.914856 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.914946 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.915094 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.915178 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.915332 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.915412 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.915575 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.915663 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.915812 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.915894 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.916047 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.916128 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.916281 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.916374 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] policy.driver = sql {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.916514 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.916595 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.916757 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.916837 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.916996 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.917085 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.917228 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.917308 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] receipt.caching = True {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.917464 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.917543 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] policy.driver = sql {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.917696 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.917785 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.917940 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.918039 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.918194 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.918277 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.918430 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] receipt.caching = True {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.918526 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.918667 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.918748 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] resource.caching = True {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.918911 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.918991 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.919150 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.919239 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] resource.driver = sql {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.919380 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.919460 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.919614 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.919694 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.919854 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] resource.caching = True {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.919943 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.920092 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] revoke.caching = True {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.920172 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.920336 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] resource.driver = sql {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.920415 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.920573 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.920661 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.920815 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] role.cache_time = None {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.920895 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.921051 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] role.caching = True {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.921131 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.921282 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] revoke.caching = True {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.921370 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] role.driver = sql {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.921519 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] role.list_limit = None {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.921603 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.921753 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.921832 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.922017 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] role.cache_time = None {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.922098 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.922235 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] role.caching = True {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.922317 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.922479 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] role.driver = sql {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.922562 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.922707 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] role.list_limit = None {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.922789 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.922951 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.923039 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.923195 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.923277 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.923439 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.923522 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.923679 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.923760 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.923920 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.924300 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.924394 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.924471 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.924544 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.924617 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.924689 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.924761 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.924842 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.925025 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.925148 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.925265 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.925353 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.925518 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.925608 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.925769 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.925851 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.926042 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.926183 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.926299 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.926419 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.926537 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.926667 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.926792 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.926914 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.927046 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.927161 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.927287 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.927409 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.927521 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.927642 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.927755 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.927893 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.927974 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.928646 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.928734 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.928891 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.929023 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.929126 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.929278 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.929360 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.929518 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.929598 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.929756 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.929839 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.930018 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] token.cache_time = None {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.930101 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.930261 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] token.caching = True {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.930342 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.930500 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.930583 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.930753 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.930832 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] token.provider = fernet {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.930983 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] token.cache_time = None {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.931064 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.931222 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] token.caching = True {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.931304 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.931457 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.931538 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.931700 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.931779 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] token.provider = fernet {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.931933 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.932015 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.932179 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.932259 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.932422 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.932501 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] trust.driver = sql {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.932656 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.932739 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.932893 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.932972 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.933132 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.933213 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.933374 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] trust.driver = sql {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.933454 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.933608 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.933689 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.933840 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.933919 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.934094 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.934179 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.934339 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.934419 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.934585 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.934665 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] database.connection = **** {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.934813 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.934908 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.935054 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.935135 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.935342 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.935422 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.935590 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.935680 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] database.connection = **** {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.935830 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.935923 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.936071 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.936155 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.936306 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.936386 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.936543 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.936631 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.936775 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.936855 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.937010 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.937091 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.937243 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.937333 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.937477 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.937559 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.937719 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.937807 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.937972 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.938072 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.938217 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.938299 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.938448 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.938528 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.938691 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.938780 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.938925 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.939006 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.939080 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=88112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 24 05:31:58.939154 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.939385 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.939624 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.939857 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:31:58.940026 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=88113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 24 05:31:58.968668 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=88112) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 05:31:58.968902 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=88112) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 05:31:58.969133 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=88112) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 05:31:58.969716 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=88113) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 05:31:58.969965 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=88113) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 05:31:58.970196 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=88113) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 05:31:58.977651 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=88112) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 05:31:58.978795 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=88113) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 05:31:59.006001 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=88112) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 05:31:59.006238 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=88112) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 05:31:59.007569 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=88113) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 05:31:59.007800 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=88113) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 05:31:59.060680 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=88112) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 05:31:59.061177 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=88113) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 05:31:59.109952 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=88112) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 05:31:59.110209 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=88112) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 05:31:59.110476 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=88113) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 05:31:59.110711 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=88113) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 05:31:59.267650 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88112) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 05:31:59.267837 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88113) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 05:31:59.267907 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=88112) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 05:31:59.268053 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=88113) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 05:31:59.268137 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=88112) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 05:31:59.268277 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=88113) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 05:31:59.268361 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=88112) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 05:31:59.268497 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=88113) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 05:31:59.268575 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=88112) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 05:31:59.268718 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=88112) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 05:31:59.268850 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=88113) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 05:31:59.268936 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=88113) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 05:31:59.292539 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88112) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 05:31:59.292782 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=88112) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 05:31:59.293014 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=88112) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 05:31:59.293097 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88113) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 05:31:59.293244 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=88112) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 05:31:59.293328 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=88113) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 05:31:59.293469 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=88113) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 05:31:59.293550 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=88112) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 05:31:59.293687 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=88112) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 05:31:59.293777 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=88113) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 05:31:59.293904 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=88112) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 05:31:59.294014 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=88113) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 05:31:59.294145 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=88113) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 05:31:59.294363 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=88113) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 05:31:59.305143 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=88112) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 05:31:59.306864 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=88113) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 05:31:59.317941 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88112) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 05:31:59.318152 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=88112) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 05:31:59.318248 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88113) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 05:31:59.318383 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=88112) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 05:31:59.318472 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=88113) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 05:31:59.318606 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=88112) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 05:31:59.318688 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=88113) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 05:31:59.319363 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=88112) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 05:31:59.319448 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=88113) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 05:31:59.319584 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=88112) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 05:31:59.319667 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=88113) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 05:31:59.319799 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=88112) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 05:31:59.319881 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=88113) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 05:31:59.320038 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=88113) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 05:31:59.337302 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=88112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:31:59.337473 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=88113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:31:59.337557 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=88112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 24 05:31:59.337684 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=88113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 24 05:31:59.337848 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=88112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:31:59.338062 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=88113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:31:59.338160 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=88112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 24 05:31:59.338265 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=88113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 24 05:31:59.338347 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=88112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:31:59.338543 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=88113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:31:59.338630 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=88112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:31:59.338809 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=88113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:31:59.339102 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=88112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:31:59.339320 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=88113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:31:59.339399 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=88112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:31:59.339584 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=88113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:31:59.348745 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=88112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:31:59.348929 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=88113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:31:59.349037 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=88112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:31:59.349212 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=88113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:31:59.349317 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=88112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:31:59.349484 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=88113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:31:59.349602 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=88112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:31:59.349771 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=88113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:31:59.356659 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=88112) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 05:31:59.356799 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=88113) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 05:31:59.359594 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=88112) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 05:31:59.359696 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=88113) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 05:31:59.359884 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=88112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:31:59.359967 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=88113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:31:59.360172 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=88112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:31:59.360253 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=88113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:31:59.360462 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=88112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:31:59.360552 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=88113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:31:59.360753 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=88112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:31:59.360834 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=88113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:31:59.361020 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=88112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:31:59.361101 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=88113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:31:59.361295 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=88112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:31:59.361377 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=88113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:31:59.361569 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=88113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:31:59.361648 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=88112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:31:59.361975 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=88113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:31:59.362070 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=88112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:31:59.362264 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=88113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:31:59.362343 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=88112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:31:59.362538 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=88112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:31:59.362616 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=88113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:31:59.385684 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=88113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:31:59.385826 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=88112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:31:59.387180 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=88113) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 05:31:59.387325 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=88112) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 05:31:59.387471 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=88113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:31:59.387615 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=88112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:31:59.392159 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=88113) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 05:31:59.392313 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=88112) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 05:31:59.392447 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=88113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:31:59.392603 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=88112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:31:59.392737 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=88113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:31:59.392892 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=88112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:31:59.399241 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=88113) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 05:31:59.399358 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=88112) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 05:31:59.399531 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=88113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:31:59.399649 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=88112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:31:59.403635 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=88113) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 05:31:59.403772 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=88112) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 05:31:59.403930 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=88113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:31:59.404070 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=88112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:31:59.404216 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=88113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:31:59.404356 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=88112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:31:59.404503 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=88113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:31:59.404639 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=88112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:31:59.404783 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=88113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:31:59.404917 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=88112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:31:59.405060 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=88113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:31:59.405195 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=88112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:31:59.405331 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=88113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:31:59.405470 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=88112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:31:59.405599 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=88113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:31:59.405742 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=88112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:31:59.423132 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=88113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:31:59.423407 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=88112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:31:59.423491 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=88113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:31:59.423694 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=88112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:31:59.427264 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=88113) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 05:31:59.427596 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=88112) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 05:31:59.430557 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=88113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:31:59.430860 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=88113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:31:59.430941 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=88112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:31:59.431205 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=88112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:31:59.435086 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=88113) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 05:31:59.435475 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=88112) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 05:31:59.438261 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=88113) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 05:31:59.438669 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=88112) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 05:31:59.441470 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=88113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:31:59.441777 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=88113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:31:59.441893 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=88112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:31:59.442091 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=88113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:31:59.442224 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=88112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:31:59.442394 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=88113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:31:59.442516 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=88112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:31:59.442683 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=88113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:31:59.442809 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=88112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:31:59.442971 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=88113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:31:59.443113 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=88112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:31:59.443407 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=88112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:31:59.459315 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=88113) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 05:31:59.460149 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=88113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:31:59.460422 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=88113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:31:59.460503 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=88112) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 05:31:59.460689 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=88113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:31:59.460770 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=88112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:31:59.460990 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=88112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:31:59.461256 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=88112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:31:59.467581 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=88113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:31:59.468185 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=88112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:31:59.469107 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=88113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:31:59.469399 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=88113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:31:59.469719 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=88112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:31:59.470035 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=88112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:31:59.472067 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=88113) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 05:31:59.472356 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=88113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:31:59.472658 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=88113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:31:59.472817 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=88112) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 05:31:59.472989 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=88113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:31:59.473129 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=88112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:31:59.473254 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=88113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:31:59.473379 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=88112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:31:59.473543 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=88112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:31:59.473824 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=88112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:31:59.484846 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=88113) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 05:31:59.485136 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=88113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:31:59.485420 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=88113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:31:59.485554 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=88112) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 05:31:59.485707 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=88113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:31:59.485846 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=88112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:31:59.485998 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=88113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:31:59.486136 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=88112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:31:59.486271 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=88113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:31:59.486404 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=88112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:31:59.486529 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=88113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:31:59.486658 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=88112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:31:59.486904 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=88112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:31:59.487187 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=88112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:31:59.501910 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=88113) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 05:31:59.502709 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=88112) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 05:31:59.504962 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=88113) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 05:31:59.505783 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=88112) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 05:31:59.508404 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=88113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:31:59.509244 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=88112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:31:59.509853 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=88113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:31:59.510721 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=88112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:31:59.511357 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=88113) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 05:31:59.511654 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=88113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:31:59.511958 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=88113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:31:59.512201 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=88112) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 05:31:59.512508 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=88112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:31:59.512789 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=88112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:31:59.518461 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=88113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:31:59.519335 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=88112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:31:59.519919 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=88113) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 05:31:59.520807 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=88112) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 05:31:59.523567 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=88113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:31:59.523862 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=88113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:31:59.524157 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=88113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:31:59.524441 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=88113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:31:59.524568 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=88112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:31:59.524738 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=88112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:31:59.525027 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=88112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:31:59.525317 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=88112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:31:59.532428 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=88113) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 05:31:59.532726 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=88113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:31:59.533008 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=88113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:31:59.533300 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=88112) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 05:31:59.533599 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=88112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:31:59.533884 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=88112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:31:59.539981 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=88113) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 05:31:59.540249 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=88113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:31:59.540532 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=88113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:31:59.540810 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=88113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:31:59.540896 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=88112) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 05:31:59.541103 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=88113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:31:59.541187 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=88112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:31:59.541377 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=88113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:31:59.541461 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=88112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:31:59.541653 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=88113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:31:59.541739 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=88112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:31:59.541923 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=88113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:31:59.542036 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=88112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:31:59.542226 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=88113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:31:59.542323 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=88112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:31:59.542503 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=88113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:31:59.542586 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=88112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:31:59.542771 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=88112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:31:59.542851 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=88113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:31:59.543054 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=88112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:31:59.543137 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=88113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:31:59.543317 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=88113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:31:59.543409 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=88112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:31:59.543579 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=88113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:31:59.543666 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=88112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:31:59.543857 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=88112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:31:59.544134 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=88112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:31:59.544398 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=88112) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 05:31:59.578019 dv-cinder-854268-1-smb devstack@keystone.service[88113]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x556b67cf09c0 pid: 88113 (default app) Aug 24 05:31:59.579082 dv-cinder-854268-1-smb devstack@keystone.service[88112]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x556b67cf09c0 pid: 88112 (default app) Aug 24 05:31:59.581392 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cfb934-23d6-4cd6-aba4-3f0ee245f220 None None] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:31:59.581682 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cfb934-23d6-4cd6-aba4-3f0ee245f220 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:31:59.582211 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cfb934-23d6-4cd6-aba4-3f0ee245f220 None None] PATH_INFO: `/v3` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:31:59.586175 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1/1] 10.222.0.26 () {50 vars in 791 bytes} [Wed Aug 24 05:31:59 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:32:06.150702 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78ddddc-4921-4e21-bb13-6cc3ebb65d67 None None] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:06.151229 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78ddddc-4921-4e21-bb13-6cc3ebb65d67 None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:06.151229 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78ddddc-4921-4e21-bb13-6cc3ebb65d67 None None] PATH_INFO: `/` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:06.155513 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1/2] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 24 05:32:06 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:32:06.161929 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fbc83f-767b-40d1-854b-6464dd9ddb56 None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:06.162364 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fbc83f-767b-40d1-854b-6464dd9ddb56 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:06.162586 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fbc83f-767b-40d1-854b-6464dd9ddb56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:06.232937 dv-cinder-854268-1-smb devstack@keystone.service[88113]: INFO dbcounter [None req-19fbc83f-767b-40d1-854b-6464dd9ddb56 None None] Registered counter for database keystone Aug 24 05:32:06.251825 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG oslo_db.sqlalchemy.engines [None req-19fbc83f-767b-40d1-854b-6464dd9ddb56 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88113) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 05:32:06.258809 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writer thread running {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 05:32:06.439447 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG passlib.handlers.bcrypt [None req-19fbc83f-767b-40d1-854b-6464dd9ddb56 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=88113) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 24 05:32:06.439792 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG passlib.handlers.bcrypt [None req-19fbc83f-767b-40d1-854b-6464dd9ddb56 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=88113) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 24 05:32:06.494908 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-19fbc83f-767b-40d1-854b-6464dd9ddb56 None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:32:06.496555 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-19fbc83f-767b-40d1-854b-6464dd9ddb56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:32:06.624493 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 2/3] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 24 05:32:06 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 463 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 24 05:32:07.094865 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78ddddc-4921-4e21-bb13-6cc3ebb65d67 None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:32:07.164178 dv-cinder-854268-1-smb devstack@keystone.service[88112]: INFO dbcounter [None req-e78ddddc-4921-4e21-bb13-6cc3ebb65d67 None None] Registered counter for database keystone Aug 24 05:32:07.185482 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG oslo_db.sqlalchemy.engines [None req-e78ddddc-4921-4e21-bb13-6cc3ebb65d67 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88112) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 05:32:07.191602 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writer thread running {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 05:32:07.321885 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78ddddc-4921-4e21-bb13-6cc3ebb65d67 None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:32:07.326211 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748b2ce5-c7f7-4ceb-99af-d6ee02ad8654 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:32:07.326844 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748b2ce5-c7f7-4ceb-99af-d6ee02ad8654 admin admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:07.327126 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748b2ce5-c7f7-4ceb-99af-d6ee02ad8654 admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:07.327401 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748b2ce5-c7f7-4ceb-99af-d6ee02ad8654 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:07.336029 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748b2ce5-c7f7-4ceb-99af-d6ee02ad8654 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:32:07.387756 dv-cinder-854268-1-smb devstack@keystone.service[88112]: WARNING keystone.common.rbac_enforcer.enforcer [None req-748b2ce5-c7f7-4ceb-99af-d6ee02ad8654 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 24 05:32:07.388048 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748b2ce5-c7f7-4ceb-99af-d6ee02ad8654 admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:32:07.398236 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 2/4] 10.222.0.26 () {58 vars in 1324 bytes} [Wed Aug 24 05:32:07 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 24 05:32:07.404152 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fbc83f-767b-40d1-854b-6464dd9ddb56 None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:32:07.419179 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fbc83f-767b-40d1-854b-6464dd9ddb56 None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:32:07.423601 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae0153b-ad40-4867-9d31-57dc6a7d83d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:32:07.424704 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae0153b-ad40-4867-9d31-57dc6a7d83d5 admin admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:07.424998 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae0153b-ad40-4867-9d31-57dc6a7d83d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:07.425274 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae0153b-ad40-4867-9d31-57dc6a7d83d5 admin admin] PATH_INFO: `/v3/projects/9e0475c5e4ae4451b23bd74342fbe5f1` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:07.426842 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae0153b-ad40-4867-9d31-57dc6a7d83d5 admin admin] RBAC: Authorizing `identity:get_project(project_id=9e0475c5e4ae4451b23bd74342fbe5f1)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:32:07.479875 dv-cinder-854268-1-smb devstack@keystone.service[88113]: WARNING keystone.common.rbac_enforcer.enforcer [None req-dae0153b-ad40-4867-9d31-57dc6a7d83d5 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 24 05:32:07.480217 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae0153b-ad40-4867-9d31-57dc6a7d83d5 admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:32:07.484686 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 3/5] 10.222.0.26 () {56 vars in 1207 bytes} [Wed Aug 24 05:32:07 2022] GET /identity/v3/projects/9e0475c5e4ae4451b23bd74342fbe5f1 => generated 344 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:32:09.341086 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2519a7-5fb8-4dc6-a349-1093e622d956 None None] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:09.341694 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2519a7-5fb8-4dc6-a349-1093e622d956 None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:09.341694 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2519a7-5fb8-4dc6-a349-1093e622d956 None None] PATH_INFO: `/` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:09.345745 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 3/6] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 24 05:32:09 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 05:32:09.351524 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4915851-481d-4bdb-af1d-c3d04348ae06 None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:09.351945 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4915851-481d-4bdb-af1d-c3d04348ae06 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:09.352049 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4915851-481d-4bdb-af1d-c3d04348ae06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:09.372114 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-d4915851-481d-4bdb-af1d-c3d04348ae06 None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:32:09.373596 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-d4915851-481d-4bdb-af1d-c3d04348ae06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:32:09.381374 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 4/7] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 24 05:32:09 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 24 05:32:09.646181 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2519a7-5fb8-4dc6-a349-1093e622d956 None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:32:09.658507 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2519a7-5fb8-4dc6-a349-1093e622d956 None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:32:09.662729 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b015f766-7ffe-4e6f-8308-1c448eda5e2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:32:09.663320 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b015f766-7ffe-4e6f-8308-1c448eda5e2f admin admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:09.663598 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b015f766-7ffe-4e6f-8308-1c448eda5e2f admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:09.663868 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b015f766-7ffe-4e6f-8308-1c448eda5e2f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:09.671383 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b015f766-7ffe-4e6f-8308-1c448eda5e2f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:32:09.673147 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b015f766-7ffe-4e6f-8308-1c448eda5e2f admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:32:09.682540 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 4/8] 10.222.0.26 () {58 vars in 1324 bytes} [Wed Aug 24 05:32:09 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 05:32:09.687747 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4915851-481d-4bdb-af1d-c3d04348ae06 None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:32:09.697582 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4915851-481d-4bdb-af1d-c3d04348ae06 None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:32:09.701822 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff57053f-2bb8-4f76-80bc-bcc2e26dec88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:32:09.702472 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff57053f-2bb8-4f76-80bc-bcc2e26dec88 admin admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:09.702750 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff57053f-2bb8-4f76-80bc-bcc2e26dec88 admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:09.703018 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff57053f-2bb8-4f76-80bc-bcc2e26dec88 admin admin] PATH_INFO: `/v3/users/f35a18a67d5646f5b515c46f902c78fc` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:09.704301 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff57053f-2bb8-4f76-80bc-bcc2e26dec88 admin admin] RBAC: Authorizing `identity:get_user(user_id=f35a18a67d5646f5b515c46f902c78fc)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:32:09.706136 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff57053f-2bb8-4f76-80bc-bcc2e26dec88 admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:32:09.707625 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 5/9] 10.222.0.26 () {56 vars in 1198 bytes} [Wed Aug 24 05:32:09 2022] GET /identity/v3/users/f35a18a67d5646f5b515c46f902c78fc => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:32:11.643386 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a092f983-d5aa-4f0d-9d38-4a5ba7e99ad4 None None] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:11.643918 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a092f983-d5aa-4f0d-9d38-4a5ba7e99ad4 None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:11.643918 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a092f983-d5aa-4f0d-9d38-4a5ba7e99ad4 None None] PATH_INFO: `/` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:11.645269 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 5/10] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 24 05:32:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:32:11.651160 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b447b2-e928-46f2-821e-80a7e3061772 None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:11.651575 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b447b2-e928-46f2-821e-80a7e3061772 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:11.651720 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b447b2-e928-46f2-821e-80a7e3061772 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:11.669935 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-c5b447b2-e928-46f2-821e-80a7e3061772 None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:32:11.671154 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-c5b447b2-e928-46f2-821e-80a7e3061772 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:32:11.687161 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be33c117-3fdd-4ad0-ad61-e401e29be8b8 None None] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:11.687442 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be33c117-3fdd-4ad0-ad61-e401e29be8b8 None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:11.687708 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be33c117-3fdd-4ad0-ad61-e401e29be8b8 None None] PATH_INFO: `/` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:11.689007 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 6/11] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 24 05:32:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 05:32:11.694393 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e66425-f5e9-4c91-86ea-2ff2b41fb8fe None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:11.694677 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e66425-f5e9-4c91-86ea-2ff2b41fb8fe None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:11.694950 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e66425-f5e9-4c91-86ea-2ff2b41fb8fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:11.737098 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG passlib.handlers.bcrypt [None req-a7e66425-f5e9-4c91-86ea-2ff2b41fb8fe None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=88112) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 24 05:32:11.737513 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG passlib.handlers.bcrypt [None req-a7e66425-f5e9-4c91-86ea-2ff2b41fb8fe None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=88112) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 24 05:32:11.750847 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 6/12] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 24 05:32:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 05:32:11.787807 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-a7e66425-f5e9-4c91-86ea-2ff2b41fb8fe None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:32:11.789456 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-a7e66425-f5e9-4c91-86ea-2ff2b41fb8fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:32:11.884096 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 7/13] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 24 05:32:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 05:32:12.018157 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b447b2-e928-46f2-821e-80a7e3061772 None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:32:12.041914 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:32:12.121937 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b447b2-e928-46f2-821e-80a7e3061772 None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:32:12.148737 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e66425-f5e9-4c91-86ea-2ff2b41fb8fe None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:32:12.155001 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6380622-1e1a-430e-826e-27bec60095d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:32:12.155642 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6380622-1e1a-430e-826e-27bec60095d6 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:12.155926 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6380622-1e1a-430e-826e-27bec60095d6 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:12.156208 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6380622-1e1a-430e-826e-27bec60095d6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:12.167539 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6380622-1e1a-430e-826e-27bec60095d6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:32:12.175910 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application [None req-f6380622-1e1a-430e-826e-27bec60095d6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 05:32:12.175910 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:32:12.175910 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:32:12.175910 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:32:12.175910 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:32:12.175910 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:32:12.175910 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:32:12.175910 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:32:12.175910 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:32:12.175910 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:32:12.175910 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:32:12.175910 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:32:12.175910 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:32:12.175910 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:32:12.175910 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:32:12.175910 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:32:12.176814 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:32:12.176814 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:32:12.176814 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:32:12.176814 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:32:12.176814 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:32:12.176814 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:32:12.176814 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:32:12.176814 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:32:12.176814 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:32:12.176814 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:32:12.176814 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:32:12.176814 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application with Lock( Aug 24 05:32:12.176814 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:32:12.176814 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:32:12.176814 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:32:12.176814 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:32:12.177642 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:32:12.177642 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:32:12.177642 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:32:12.177642 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:32:12.177642 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:32:12.177642 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:32:12.177642 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:32:12.177642 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:32:12.177642 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:32:12.177642 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:32:12.177642 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 05:32:12.177642 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Aug 24 05:32:12.177642 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 7/14] 10.222.0.26 () {56 vars in 1096 bytes} [Wed Aug 24 05:32:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:32:12.182860 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6380622-1e1a-430e-826e-27bec60095d6 None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:32:12.251885 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e66425-f5e9-4c91-86ea-2ff2b41fb8fe None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:32:12.254262 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:32:12.264004 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:32:12.282814 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6380622-1e1a-430e-826e-27bec60095d6 None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:32:12.291420 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9651d927-f286-49e8-8045-f782b77a005f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:32:12.292341 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9651d927-f286-49e8-8045-f782b77a005f None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:12.292572 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9651d927-f286-49e8-8045-f782b77a005f None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:12.292849 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9651d927-f286-49e8-8045-f782b77a005f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:12.316135 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5155bef-2e65-4c62-b290-a2d2a735acf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:32:12.316734 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5155bef-2e65-4c62-b290-a2d2a735acf9 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:12.317018 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5155bef-2e65-4c62-b290-a2d2a735acf9 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:12.317296 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5155bef-2e65-4c62-b290-a2d2a735acf9 None admin] PATH_INFO: `/v3/roles` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:12.317976 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5155bef-2e65-4c62-b290-a2d2a735acf9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:32:12.318315 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5155bef-2e65-4c62-b290-a2d2a735acf9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:32:12.319959 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5155bef-2e65-4c62-b290-a2d2a735acf9 None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:32:12.331441 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 8/15] 10.222.0.26 () {56 vars in 1099 bytes} [Wed Aug 24 05:32:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:32:12.336858 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5155bef-2e65-4c62-b290-a2d2a735acf9 None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:32:12.358618 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9651d927-f286-49e8-8045-f782b77a005f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:32:12.360144 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9651d927-f286-49e8-8045-f782b77a005f None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:32:12.434635 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5155bef-2e65-4c62-b290-a2d2a735acf9 None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:32:12.456535 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 8/16] 10.222.0.26 () {58 vars in 1282 bytes} [Wed Aug 24 05:32:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 24 05:32:12.462586 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9651d927-f286-49e8-8045-f782b77a005f None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:32:12.465200 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:32:12.469453 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31833b71-2c2f-4adf-b50a-a4e0748c96ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:32:12.470124 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31833b71-2c2f-4adf-b50a-a4e0748c96ea None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:12.470405 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31833b71-2c2f-4adf-b50a-a4e0748c96ea None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:12.470676 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31833b71-2c2f-4adf-b50a-a4e0748c96ea None admin] PATH_INFO: `/v3/users/f35a18a67d5646f5b515c46f902c78fc` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:12.471801 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31833b71-2c2f-4adf-b50a-a4e0748c96ea None admin] RBAC: Authorizing `identity:get_user(user_id=f35a18a67d5646f5b515c46f902c78fc)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:32:12.473239 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31833b71-2c2f-4adf-b50a-a4e0748c96ea None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:32:12.475373 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 9/17] 10.222.0.26 () {56 vars in 1177 bytes} [Wed Aug 24 05:32:12 2022] GET /identity/v3/users/f35a18a67d5646f5b515c46f902c78fc => generated 247 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:32:12.480687 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31833b71-2c2f-4adf-b50a-a4e0748c96ea None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:32:12.497815 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:32:12.563801 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9651d927-f286-49e8-8045-f782b77a005f None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:32:12.582000 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31833b71-2c2f-4adf-b50a-a4e0748c96ea None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:32:12.596701 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236c5deb-3752-4349-8b90-6d0b7400a658 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:32:12.597545 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236c5deb-3752-4349-8b90-6d0b7400a658 None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:12.597824 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236c5deb-3752-4349-8b90-6d0b7400a658 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:12.598128 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236c5deb-3752-4349-8b90-6d0b7400a658 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:12.616019 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6672cd6d-634f-4491-837c-bcf295e27703 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:32:12.616643 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6672cd6d-634f-4491-837c-bcf295e27703 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:12.616748 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236c5deb-3752-4349-8b90-6d0b7400a658 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:32:12.616922 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6672cd6d-634f-4491-837c-bcf295e27703 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:12.617194 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6672cd6d-634f-4491-837c-bcf295e27703 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:12.618139 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236c5deb-3752-4349-8b90-6d0b7400a658 None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:32:12.618331 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6672cd6d-634f-4491-837c-bcf295e27703 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:32:12.619769 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6672cd6d-634f-4491-837c-bcf295e27703 None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:32:12.621476 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 10/18] 10.222.0.26 () {56 vars in 1108 bytes} [Wed Aug 24 05:32:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:32:12.626997 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6672cd6d-634f-4491-837c-bcf295e27703 None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:32:12.635999 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application [None req-236c5deb-3752-4349-8b90-6d0b7400a658 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:32:12.635999 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:32:12.635999 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:32:12.635999 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:32:12.635999 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:32:12.635999 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:32:12.635999 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:32:12.635999 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:32:12.635999 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:32:12.635999 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:32:12.635999 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:32:12.635999 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:32:12.635999 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 05:32:12.635999 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 05:32:12.635999 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 05:32:12.635999 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 05:32:12.636897 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:32:12.636897 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:32:12.636897 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:32:12.636897 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:32:12.636897 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:32:12.636897 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:32:12.636897 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:32:12.636897 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application with Lock( Aug 24 05:32:12.636897 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:32:12.636897 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:32:12.636897 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:32:12.636897 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:32:12.636897 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:32:12.636897 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:32:12.636897 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:32:12.636897 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:32:12.636897 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 05:32:12.637694 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 05:32:12.637694 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:32:12.637694 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Aug 24 05:32:12.637694 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 9/19] 10.222.0.26 () {56 vars in 1108 bytes} [Wed Aug 24 05:32:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 05:32:12.642735 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236c5deb-3752-4349-8b90-6d0b7400a658 None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:32:12.698727 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:32:12.710995 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:32:12.730445 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6672cd6d-634f-4491-837c-bcf295e27703 None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:32:12.742679 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236c5deb-3752-4349-8b90-6d0b7400a658 None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:32:12.764524 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0744e7f4-6f30-442e-ba10-ce03e5a4d95c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:32:12.765128 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0744e7f4-6f30-442e-ba10-ce03e5a4d95c None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:12.765408 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0744e7f4-6f30-442e-ba10-ce03e5a4d95c None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:12.765677 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0744e7f4-6f30-442e-ba10-ce03e5a4d95c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:12.766444 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0744e7f4-6f30-442e-ba10-ce03e5a4d95c None admin] RBAC: Adding query filter params (role.id=640bda0879494e60b72680ee505285f0, scope.domain.id=default, user.id=f35a18a67d5646f5b515c46f902c78fc) {{(pid=88113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:32:12.766736 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0744e7f4-6f30-442e-ba10-ce03e5a4d95c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:32:12.768185 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0744e7f4-6f30-442e-ba10-ce03e5a4d95c None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:32:12.775226 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 11/20] 10.222.0.26 () {56 vars in 1322 bytes} [Wed Aug 24 05:32:12 2022] GET /identity/v3/role_assignments?user.id=f35a18a67d5646f5b515c46f902c78fc&scope.domain.id=default&role.id=640bda0879494e60b72680ee505285f0 => generated 233 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:32:12.776847 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f39d199-3803-4e29-b3a5-6213a223673b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:32:12.777458 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f39d199-3803-4e29-b3a5-6213a223673b None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:12.777740 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f39d199-3803-4e29-b3a5-6213a223673b None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:12.778048 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f39d199-3803-4e29-b3a5-6213a223673b None admin] PATH_INFO: `/v3/domains` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:12.778698 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f39d199-3803-4e29-b3a5-6213a223673b None admin] RBAC: Adding query filter params (name=Default) {{(pid=88112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:32:12.779001 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f39d199-3803-4e29-b3a5-6213a223673b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:32:12.780419 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f39d199-3803-4e29-b3a5-6213a223673b None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:32:12.801178 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 10/21] 10.222.0.26 () {56 vars in 1109 bytes} [Wed Aug 24 05:32:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:32:14.993660 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91196ca0-0a88-4184-a763-459eb235c65c None None] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:14.994195 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91196ca0-0a88-4184-a763-459eb235c65c None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:14.994270 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91196ca0-0a88-4184-a763-459eb235c65c None None] PATH_INFO: `/` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:14.995830 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 12/22] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 24 05:32:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:32:15.014875 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0266f6f-fbe0-4bb9-a10c-0ae5db0a422c None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:15.014875 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0266f6f-fbe0-4bb9-a10c-0ae5db0a422c None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:15.014875 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0266f6f-fbe0-4bb9-a10c-0ae5db0a422c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:15.043042 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-e0266f6f-fbe0-4bb9-a10c-0ae5db0a422c None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:32:15.044618 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-e0266f6f-fbe0-4bb9-a10c-0ae5db0a422c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:32:15.162611 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 11/23] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 24 05:32:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 05:32:15.350935 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f07691a-20a7-44e2-b98c-11a9f31bfca2 None None] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:15.351247 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f07691a-20a7-44e2-b98c-11a9f31bfca2 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:15.351407 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f07691a-20a7-44e2-b98c-11a9f31bfca2 None None] PATH_INFO: `/` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:15.353020 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 13/24] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 24 05:32:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:32:15.360200 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c54dba-794e-467e-b64b-2a923698476d None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:15.360200 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c54dba-794e-467e-b64b-2a923698476d None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:15.360200 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c54dba-794e-467e-b64b-2a923698476d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:15.389768 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-39c54dba-794e-467e-b64b-2a923698476d None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:32:15.391355 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-39c54dba-794e-467e-b64b-2a923698476d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:32:15.441170 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26041cdd-679d-47f0-acb4-f06e1a375776 None None] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:15.441531 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26041cdd-679d-47f0-acb4-f06e1a375776 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:15.441709 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26041cdd-679d-47f0-acb4-f06e1a375776 None None] PATH_INFO: `/` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:15.443433 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 14/25] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 24 05:32:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:32:15.451516 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd38159-727f-45d8-927a-6a3b9046c5d9 None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:15.451800 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd38159-727f-45d8-927a-6a3b9046c5d9 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:15.452074 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd38159-727f-45d8-927a-6a3b9046c5d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:15.478625 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:32:15.499489 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-6dd38159-727f-45d8-927a-6a3b9046c5d9 None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:32:15.500700 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-6dd38159-727f-45d8-927a-6a3b9046c5d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:32:15.535409 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 12/26] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 24 05:32:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 05:32:15.643141 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 15/27] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 24 05:32:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 05:32:15.667290 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78448b9-a828-4604-8736-82a0aeeb738a None None] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:15.667588 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78448b9-a828-4604-8736-82a0aeeb738a None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:15.667864 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78448b9-a828-4604-8736-82a0aeeb738a None None] PATH_INFO: `/` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:15.669302 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 13/28] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 24 05:32:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:32:15.670236 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd38159-727f-45d8-927a-6a3b9046c5d9 None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:32:15.687819 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730e0f67-8cf2-44a8-87bb-c38e992e1b84 None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:15.688110 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730e0f67-8cf2-44a8-87bb-c38e992e1b84 None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:15.688385 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730e0f67-8cf2-44a8-87bb-c38e992e1b84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:15.726683 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-730e0f67-8cf2-44a8-87bb-c38e992e1b84 None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:32:15.727876 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-730e0f67-8cf2-44a8-87bb-c38e992e1b84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:32:15.776870 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:32:15.869347 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd38159-727f-45d8-927a-6a3b9046c5d9 None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:32:15.938590 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 14/29] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 24 05:32:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 05:32:15.989843 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730e0f67-8cf2-44a8-87bb-c38e992e1b84 None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:32:16.002654 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d0be8d-d656-4fc8-9251-6a84713fd772 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:32:16.003309 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d0be8d-d656-4fc8-9251-6a84713fd772 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:16.004373 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d0be8d-d656-4fc8-9251-6a84713fd772 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:16.004373 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d0be8d-d656-4fc8-9251-6a84713fd772 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:16.028110 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d0be8d-d656-4fc8-9251-6a84713fd772 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:32:16.036480 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application [None req-42d0be8d-d656-4fc8-9251-6a84713fd772 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 05:32:16.036480 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:32:16.036480 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:32:16.036480 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:32:16.036480 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:32:16.036480 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:32:16.036480 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:32:16.036480 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:32:16.036480 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:32:16.036480 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:32:16.036480 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:32:16.036480 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:32:16.036480 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:32:16.036480 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:32:16.036480 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:32:16.036480 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:32:16.037357 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:32:16.037357 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:32:16.037357 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:32:16.037357 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:32:16.037357 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:32:16.037357 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:32:16.037357 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:32:16.037357 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:32:16.037357 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:32:16.037357 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:32:16.037357 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:32:16.037357 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application with Lock( Aug 24 05:32:16.037357 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:32:16.037357 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:32:16.037357 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:32:16.037357 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:32:16.038116 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:32:16.038116 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:32:16.038116 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:32:16.038116 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:32:16.038116 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:32:16.038116 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:32:16.038116 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:32:16.038116 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:32:16.038116 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:32:16.038116 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:32:16.038116 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 05:32:16.038116 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Aug 24 05:32:16.039150 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 16/30] 10.222.0.26 () {56 vars in 1096 bytes} [Wed Aug 24 05:32:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 369 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:32:16.044792 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d0be8d-d656-4fc8-9251-6a84713fd772 None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:32:16.180436 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d0be8d-d656-4fc8-9251-6a84713fd772 None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:32:16.228812 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a85aa50-6e8f-40b0-bf78-8a80039bbe17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:32:16.229472 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a85aa50-6e8f-40b0-bf78-8a80039bbe17 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:16.229749 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a85aa50-6e8f-40b0-bf78-8a80039bbe17 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:16.230049 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a85aa50-6e8f-40b0-bf78-8a80039bbe17 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:16.236339 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:32:16.246907 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730e0f67-8cf2-44a8-87bb-c38e992e1b84 None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:32:16.256456 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a85aa50-6e8f-40b0-bf78-8a80039bbe17 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:32:16.258001 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a85aa50-6e8f-40b0-bf78-8a80039bbe17 None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:32:16.266365 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:32:16.289650 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application [None req-7a85aa50-6e8f-40b0-bf78-8a80039bbe17 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:32:16.289650 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:32:16.289650 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:32:16.289650 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:32:16.289650 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:32:16.289650 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:32:16.289650 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:32:16.289650 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:32:16.289650 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:32:16.289650 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:32:16.289650 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:32:16.289650 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:32:16.289650 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 05:32:16.289650 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 05:32:16.289650 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 05:32:16.289650 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 05:32:16.290573 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:32:16.290573 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:32:16.290573 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:32:16.290573 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:32:16.290573 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:32:16.290573 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:32:16.290573 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:32:16.290573 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application with Lock( Aug 24 05:32:16.290573 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:32:16.290573 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:32:16.290573 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:32:16.290573 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:32:16.290573 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:32:16.290573 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:32:16.290573 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:32:16.290573 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:32:16.290573 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 05:32:16.291425 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 05:32:16.291425 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:32:16.291425 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Aug 24 05:32:16.291425 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 17/31] 10.222.0.26 () {56 vars in 1108 bytes} [Wed Aug 24 05:32:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:32:16.305371 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a85aa50-6e8f-40b0-bf78-8a80039bbe17 None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:32:16.324678 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee81f2e-2d7c-4526-a83b-746794c4eefa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:32:16.325308 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee81f2e-2d7c-4526-a83b-746794c4eefa None admin] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:16.325591 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee81f2e-2d7c-4526-a83b-746794c4eefa None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:16.327592 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee81f2e-2d7c-4526-a83b-746794c4eefa None admin] PATH_INFO: `/v3/roles` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:16.327592 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee81f2e-2d7c-4526-a83b-746794c4eefa None admin] RBAC: Authorizing `identity:create_role()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:32:16.332569 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee81f2e-2d7c-4526-a83b-746794c4eefa None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:32:16.430906 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a85aa50-6e8f-40b0-bf78-8a80039bbe17 None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:32:16.486047 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a5f23b-a9cc-4068-9fb3-6b45f7c5fcba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:32:16.486047 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a5f23b-a9cc-4068-9fb3-6b45f7c5fcba None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:16.486047 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a5f23b-a9cc-4068-9fb3-6b45f7c5fcba None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:16.486047 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a5f23b-a9cc-4068-9fb3-6b45f7c5fcba None admin] PATH_INFO: `/v3/roles` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:16.489483 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a5f23b-a9cc-4068-9fb3-6b45f7c5fcba None admin] RBAC: Adding query filter params (name=admin) {{(pid=88113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:32:16.489483 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a5f23b-a9cc-4068-9fb3-6b45f7c5fcba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:32:16.489483 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a5f23b-a9cc-4068-9fb3-6b45f7c5fcba None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:32:16.511910 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 18/32] 10.222.0.26 () {56 vars in 1099 bytes} [Wed Aug 24 05:32:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:32:16.514032 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a5f23b-a9cc-4068-9fb3-6b45f7c5fcba None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:32:16.595414 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:32:16.596417 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 15/33] 10.222.0.26 () {60 vars in 1131 bytes} [Wed Aug 24 05:32:15 2022] POST /identity/v3/roles => generated 225 bytes in 601 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 05:32:16.597804 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee81f2e-2d7c-4526-a83b-746794c4eefa None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:32:16.652605 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a5f23b-a9cc-4068-9fb3-6b45f7c5fcba None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:32:16.696774 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72311e56-0d29-444c-a817-d5859cbf5ecb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:32:16.697407 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72311e56-0d29-444c-a817-d5859cbf5ecb None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:16.697687 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72311e56-0d29-444c-a817-d5859cbf5ecb None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:16.697975 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72311e56-0d29-444c-a817-d5859cbf5ecb None admin] PATH_INFO: `/v3/domains` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:16.698806 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72311e56-0d29-444c-a817-d5859cbf5ecb None admin] RBAC: Adding query filter params (name=Default) {{(pid=88113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:32:16.699243 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72311e56-0d29-444c-a817-d5859cbf5ecb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:32:16.700675 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72311e56-0d29-444c-a817-d5859cbf5ecb None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:32:16.721738 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 19/34] 10.222.0.26 () {56 vars in 1109 bytes} [Wed Aug 24 05:32:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:32:16.726802 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72311e56-0d29-444c-a817-d5859cbf5ecb None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:32:16.856448 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72311e56-0d29-444c-a817-d5859cbf5ecb None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:32:16.866131 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:32:16.869195 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee81f2e-2d7c-4526-a83b-746794c4eefa None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:32:16.898366 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0330ab-257a-4fec-b23e-65f94313305b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:32:16.898978 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0330ab-257a-4fec-b23e-65f94313305b None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:16.899258 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0330ab-257a-4fec-b23e-65f94313305b None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:16.899535 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0330ab-257a-4fec-b23e-65f94313305b None admin] PATH_INFO: `/v3/users/f35a18a67d5646f5b515c46f902c78fc` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:16.900880 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0330ab-257a-4fec-b23e-65f94313305b None admin] RBAC: Authorizing `identity:get_user(user_id=f35a18a67d5646f5b515c46f902c78fc)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:32:16.902665 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0330ab-257a-4fec-b23e-65f94313305b None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:32:16.904940 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 20/35] 10.222.0.26 () {56 vars in 1177 bytes} [Wed Aug 24 05:32:16 2022] GET /identity/v3/users/f35a18a67d5646f5b515c46f902c78fc => generated 247 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:32:16.904940 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0330ab-257a-4fec-b23e-65f94313305b None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:32:16.922987 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0596cbb3-0c74-4990-83af-fdd093e48757 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:32:16.925036 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0596cbb3-0c74-4990-83af-fdd093e48757 None admin] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:16.927445 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0596cbb3-0c74-4990-83af-fdd093e48757 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:16.927966 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0596cbb3-0c74-4990-83af-fdd093e48757 None admin] PATH_INFO: `/v3/roles` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:16.928984 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0596cbb3-0c74-4990-83af-fdd093e48757 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:32:16.930954 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0596cbb3-0c74-4990-83af-fdd093e48757 None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:32:16.952574 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 16/36] 10.222.0.26 () {60 vars in 1131 bytes} [Wed Aug 24 05:32:16 2022] POST /identity/v3/roles => generated 219 bytes in 355 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:32:16.956323 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf293e0f-c0e5-4ffc-aa7e-a93d0792a36d None None] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:16.956889 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf293e0f-c0e5-4ffc-aa7e-a93d0792a36d None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:16.957631 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf293e0f-c0e5-4ffc-aa7e-a93d0792a36d None None] PATH_INFO: `/` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:16.960291 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 17/37] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 24 05:32:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:32:16.961398 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf293e0f-c0e5-4ffc-aa7e-a93d0792a36d None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:32:17.005918 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:32:17.067998 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0330ab-257a-4fec-b23e-65f94313305b None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:32:17.111420 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf293e0f-c0e5-4ffc-aa7e-a93d0792a36d None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:32:17.120194 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f3e20d-9e6e-4047-b943-24c24426e972 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:32:17.120722 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f3e20d-9e6e-4047-b943-24c24426e972 None admin] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:17.121011 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f3e20d-9e6e-4047-b943-24c24426e972 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:17.121282 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f3e20d-9e6e-4047-b943-24c24426e972 None admin] PATH_INFO: `/v3/projects` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:17.126698 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f3e20d-9e6e-4047-b943-24c24426e972 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:32:17.128609 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f3e20d-9e6e-4047-b943-24c24426e972 None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:32:17.161128 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8534048-5178-4d70-81e3-e12cf3a3cebb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:32:17.163286 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8534048-5178-4d70-81e3-e12cf3a3cebb None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:17.163571 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8534048-5178-4d70-81e3-e12cf3a3cebb None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:17.163904 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8534048-5178-4d70-81e3-e12cf3a3cebb None admin] PATH_INFO: `/v3/domains/default` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:17.165490 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8534048-5178-4d70-81e3-e12cf3a3cebb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:32:17.168751 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8534048-5178-4d70-81e3-e12cf3a3cebb None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:32:17.168751 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 18/38] 10.222.0.26 () {56 vars in 1108 bytes} [Wed Aug 24 05:32:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:32:17.174088 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0198ada-fa88-4010-8b67-5f15c4aad320 None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:17.174450 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0198ada-fa88-4010-8b67-5f15c4aad320 None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:17.174759 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0198ada-fa88-4010-8b67-5f15c4aad320 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:17.200006 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-f0198ada-fa88-4010-8b67-5f15c4aad320 None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:32:17.201988 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-f0198ada-fa88-4010-8b67-5f15c4aad320 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:32:17.277285 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 19/39] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 24 05:32:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 05:32:17.282894 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b7c067-9ced-442f-a6f1-a9021d316205 None None] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:17.282894 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b7c067-9ced-442f-a6f1-a9021d316205 None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:17.282894 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b7c067-9ced-442f-a6f1-a9021d316205 None None] PATH_INFO: `/` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:17.282894 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 20/40] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 24 05:32:17 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:32:17.282894 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b7c067-9ced-442f-a6f1-a9021d316205 None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:32:17.290012 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 21/41] 10.222.0.26 () {60 vars in 1141 bytes} [Wed Aug 24 05:32:16 2022] POST /identity/v3/projects => generated 301 bytes in 379 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:32:17.290012 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fabf0c2-0a41-4497-81e6-60971e804251 None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:17.290012 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fabf0c2-0a41-4497-81e6-60971e804251 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:17.290012 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fabf0c2-0a41-4497-81e6-60971e804251 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:17.312997 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-6fabf0c2-0a41-4497-81e6-60971e804251 None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:32:17.312997 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-6fabf0c2-0a41-4497-81e6-60971e804251 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:32:17.341986 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:32:17.359407 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:32:17.432171 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 22/42] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 24 05:32:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 05:32:17.455752 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b7c067-9ced-442f-a6f1-a9021d316205 None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:32:17.506034 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9f5b86-b28f-4565-a3db-f66d88e05025 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:32:17.506517 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9f5b86-b28f-4565-a3db-f66d88e05025 None admin] REQUEST_METHOD: `PUT` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:17.508120 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9f5b86-b28f-4565-a3db-f66d88e05025 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:17.508120 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9f5b86-b28f-4565-a3db-f66d88e05025 None admin] PATH_INFO: `/v3/domains/default/users/f35a18a67d5646f5b515c46f902c78fc/roles/640bda0879494e60b72680ee505285f0` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:17.513978 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9f5b86-b28f-4565-a3db-f66d88e05025 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=f35a18a67d5646f5b515c46f902c78fc, role_id=640bda0879494e60b72680ee505285f0)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:32:17.513978 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9f5b86-b28f-4565-a3db-f66d88e05025 None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:32:17.540263 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 21/43] 10.222.0.26 () {58 vars in 1361 bytes} [Wed Aug 24 05:32:17 2022] PUT /identity/v3/domains/default/users/f35a18a67d5646f5b515c46f902c78fc/roles/640bda0879494e60b72680ee505285f0 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:32:17.582736 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fabf0c2-0a41-4497-81e6-60971e804251 None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:32:17.730425 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9f5b86-b28f-4565-a3db-f66d88e05025 None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:32:17.831680 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fabf0c2-0a41-4497-81e6-60971e804251 None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:32:17.867588 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:32:17.873102 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ff1d0c-2b5d-4647-88b2-c784ce649734 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:32:17.874205 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ff1d0c-2b5d-4647-88b2-c784ce649734 None admin] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:17.874655 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ff1d0c-2b5d-4647-88b2-c784ce649734 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:17.875075 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ff1d0c-2b5d-4647-88b2-c784ce649734 None admin] PATH_INFO: `/v3/roles` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:17.876135 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ff1d0c-2b5d-4647-88b2-c784ce649734 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:32:17.878420 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ff1d0c-2b5d-4647-88b2-c784ce649734 None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:32:17.892111 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9f5b86-b28f-4565-a3db-f66d88e05025 None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:32:17.900078 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 23/44] 10.222.0.26 () {60 vars in 1131 bytes} [Wed Aug 24 05:32:17 2022] POST /identity/v3/roles => generated 223 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:32:17.937161 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acaa00ba-620f-44fa-ab2c-9ee2c575c7f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:32:17.937832 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaa00ba-620f-44fa-ab2c-9ee2c575c7f6 None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:17.938175 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaa00ba-620f-44fa-ab2c-9ee2c575c7f6 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:17.938429 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaa00ba-620f-44fa-ab2c-9ee2c575c7f6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:17.939778 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acaa00ba-620f-44fa-ab2c-9ee2c575c7f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:32:17.941597 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acaa00ba-620f-44fa-ab2c-9ee2c575c7f6 None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:32:17.949159 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 22/45] 10.222.0.26 () {56 vars in 1108 bytes} [Wed Aug 24 05:32:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:32:17.951544 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ff1d0c-2b5d-4647-88b2-c784ce649734 None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:32:17.977350 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:32:18.083960 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ff1d0c-2b5d-4647-88b2-c784ce649734 None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:32:18.134866 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6ec096-9ef5-4e53-a47f-c2a775a2e41b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:32:18.135498 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6ec096-9ef5-4e53-a47f-c2a775a2e41b None admin] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:18.135781 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6ec096-9ef5-4e53-a47f-c2a775a2e41b None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:18.136057 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6ec096-9ef5-4e53-a47f-c2a775a2e41b None admin] PATH_INFO: `/v3/projects` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:18.136730 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6ec096-9ef5-4e53-a47f-c2a775a2e41b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:32:18.138256 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6ec096-9ef5-4e53-a47f-c2a775a2e41b None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:32:18.166890 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 24/46] 10.222.0.26 () {60 vars in 1141 bytes} [Wed Aug 24 05:32:17 2022] POST /identity/v3/projects => generated 312 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:32:19.488554 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46158823-ac3a-401e-85dc-831014f28d9f None None] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:19.489057 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46158823-ac3a-401e-85dc-831014f28d9f None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:19.489143 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46158823-ac3a-401e-85dc-831014f28d9f None None] PATH_INFO: `/` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:19.490699 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 23/47] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 24 05:32:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:32:19.497474 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266be53d-abb3-4e9e-a7bd-cf1b45bc009f None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:19.497913 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266be53d-abb3-4e9e-a7bd-cf1b45bc009f None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:19.498132 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266be53d-abb3-4e9e-a7bd-cf1b45bc009f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:19.517892 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-266be53d-abb3-4e9e-a7bd-cf1b45bc009f None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:32:19.519205 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-266be53d-abb3-4e9e-a7bd-cf1b45bc009f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:32:19.589658 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:32:19.595147 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 25/48] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 24 05:32:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 05:32:19.862642 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46158823-ac3a-401e-85dc-831014f28d9f None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:32:19.971375 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46158823-ac3a-401e-85dc-831014f28d9f None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:32:20.007813 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb3c5e3-19de-4cac-99cd-a2482f88c1f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:32:20.008450 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb3c5e3-19de-4cac-99cd-a2482f88c1f4 None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:20.008731 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb3c5e3-19de-4cac-99cd-a2482f88c1f4 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:20.009004 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb3c5e3-19de-4cac-99cd-a2482f88c1f4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:20.023425 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb3c5e3-19de-4cac-99cd-a2482f88c1f4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:32:20.029669 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application [None req-eeb3c5e3-19de-4cac-99cd-a2482f88c1f4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 05:32:20.029669 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:32:20.029669 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:32:20.029669 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:32:20.029669 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:32:20.029669 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:32:20.029669 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:32:20.029669 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:32:20.029669 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:32:20.029669 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:32:20.029669 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:32:20.029669 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:32:20.029669 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:32:20.029669 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:32:20.029669 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:32:20.029669 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:32:20.030572 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:32:20.030572 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:32:20.030572 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:32:20.030572 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:32:20.030572 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:32:20.030572 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:32:20.030572 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:32:20.030572 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:32:20.030572 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:32:20.030572 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:32:20.030572 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:32:20.030572 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application with Lock( Aug 24 05:32:20.030572 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:32:20.030572 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:32:20.030572 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:32:20.030572 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:32:20.031563 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:32:20.031563 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:32:20.031563 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:32:20.031563 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:32:20.031563 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:32:20.031563 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:32:20.031563 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:32:20.031563 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:32:20.031563 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:32:20.031563 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:32:20.031563 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 05:32:20.031563 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Aug 24 05:32:20.033791 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 24/49] 10.222.0.26 () {56 vars in 1096 bytes} [Wed Aug 24 05:32:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:32:20.039298 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266be53d-abb3-4e9e-a7bd-cf1b45bc009f None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:32:20.112547 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a9be4b-5adb-4c9b-bc8d-1a5760bfb5d3 None None] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:20.112878 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a9be4b-5adb-4c9b-bc8d-1a5760bfb5d3 None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:20.113110 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a9be4b-5adb-4c9b-bc8d-1a5760bfb5d3 None None] PATH_INFO: `/` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:20.114510 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 25/50] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 24 05:32:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 05:32:20.120090 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9719fa05-7c2c-4c5c-9f30-c948eb48a503 None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:20.120432 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9719fa05-7c2c-4c5c-9f30-c948eb48a503 None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:20.120712 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9719fa05-7c2c-4c5c-9f30-c948eb48a503 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:20.143025 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-9719fa05-7c2c-4c5c-9f30-c948eb48a503 None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:32:20.144227 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-9719fa05-7c2c-4c5c-9f30-c948eb48a503 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:32:20.152032 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:32:20.154649 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266be53d-abb3-4e9e-a7bd-cf1b45bc009f None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:32:20.194934 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d82151-8ff4-4720-8978-7c4d39db318f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:32:20.196407 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d82151-8ff4-4720-8978-7c4d39db318f None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:20.196407 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d82151-8ff4-4720-8978-7c4d39db318f None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:20.196407 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d82151-8ff4-4720-8978-7c4d39db318f None admin] PATH_INFO: `/v3/roles` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:20.196681 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d82151-8ff4-4720-8978-7c4d39db318f None admin] RBAC: Adding query filter params (name=admin) {{(pid=88113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:32:20.197066 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d82151-8ff4-4720-8978-7c4d39db318f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:32:20.198522 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d82151-8ff4-4720-8978-7c4d39db318f None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:32:20.212276 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 26/51] 10.222.0.26 () {56 vars in 1099 bytes} [Wed Aug 24 05:32:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:32:20.213477 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d82151-8ff4-4720-8978-7c4d39db318f None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:32:20.218919 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 26/52] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 24 05:32:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 05:32:20.279089 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:32:20.320870 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d82151-8ff4-4720-8978-7c4d39db318f None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:32:20.356017 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c216d7-118b-48e5-9d13-853390222e36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:32:20.356656 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c216d7-118b-48e5-9d13-853390222e36 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:20.356991 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c216d7-118b-48e5-9d13-853390222e36 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:20.357206 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c216d7-118b-48e5-9d13-853390222e36 None admin] PATH_INFO: `/v3/users/f35a18a67d5646f5b515c46f902c78fc` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:20.358371 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c216d7-118b-48e5-9d13-853390222e36 None admin] RBAC: Authorizing `identity:get_user(user_id=f35a18a67d5646f5b515c46f902c78fc)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:32:20.359827 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c216d7-118b-48e5-9d13-853390222e36 None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:32:20.361410 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 27/53] 10.222.0.26 () {56 vars in 1177 bytes} [Wed Aug 24 05:32:20 2022] GET /identity/v3/users/f35a18a67d5646f5b515c46f902c78fc => generated 247 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:32:20.367665 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9719fa05-7c2c-4c5c-9f30-c948eb48a503 None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:32:20.468525 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9719fa05-7c2c-4c5c-9f30-c948eb48a503 None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:32:20.486407 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c216d7-118b-48e5-9d13-853390222e36 None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:32:20.508777 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2158394f-4dd3-4203-87b8-1f753ffc4afa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:32:20.509439 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2158394f-4dd3-4203-87b8-1f753ffc4afa None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:20.509696 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2158394f-4dd3-4203-87b8-1f753ffc4afa None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:20.509980 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2158394f-4dd3-4203-87b8-1f753ffc4afa None admin] PATH_INFO: `/v3/domains/default` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:20.511125 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2158394f-4dd3-4203-87b8-1f753ffc4afa None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:32:20.512579 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2158394f-4dd3-4203-87b8-1f753ffc4afa None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:32:20.514344 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 27/54] 10.222.0.26 () {56 vars in 1108 bytes} [Wed Aug 24 05:32:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:32:20.519933 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2158394f-4dd3-4203-87b8-1f753ffc4afa None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:32:20.532037 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:32:20.615546 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c216d7-118b-48e5-9d13-853390222e36 None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:32:20.632224 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2158394f-4dd3-4203-87b8-1f753ffc4afa None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:32:20.650819 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:32:20.659432 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77cac58-d699-4664-a45c-b5e5ed82d264 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:32:20.660163 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77cac58-d699-4664-a45c-b5e5ed82d264 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:20.660452 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77cac58-d699-4664-a45c-b5e5ed82d264 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:20.660728 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77cac58-d699-4664-a45c-b5e5ed82d264 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:20.662846 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77cac58-d699-4664-a45c-b5e5ed82d264 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:32:20.664446 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77cac58-d699-4664-a45c-b5e5ed82d264 None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:32:20.666152 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 28/55] 10.222.0.26 () {56 vars in 1108 bytes} [Wed Aug 24 05:32:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:32:20.672091 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77cac58-d699-4664-a45c-b5e5ed82d264 None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:32:20.676133 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b9d9b6-39e6-43f4-8c76-3cd2b95c5df2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:32:20.676745 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b9d9b6-39e6-43f4-8c76-3cd2b95c5df2 None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:20.677027 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b9d9b6-39e6-43f4-8c76-3cd2b95c5df2 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:20.677361 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b9d9b6-39e6-43f4-8c76-3cd2b95c5df2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:20.678133 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b9d9b6-39e6-43f4-8c76-3cd2b95c5df2 None admin] RBAC: Adding query filter params (role.id=640bda0879494e60b72680ee505285f0, scope.domain.id=default, user.id=f35a18a67d5646f5b515c46f902c78fc) {{(pid=88112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:32:20.678454 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b9d9b6-39e6-43f4-8c76-3cd2b95c5df2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:32:20.679903 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b9d9b6-39e6-43f4-8c76-3cd2b95c5df2 None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:32:20.689582 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 28/56] 10.222.0.26 () {56 vars in 1322 bytes} [Wed Aug 24 05:32:20 2022] GET /identity/v3/role_assignments?user.id=f35a18a67d5646f5b515c46f902c78fc&scope.domain.id=default&role.id=640bda0879494e60b72680ee505285f0 => generated 530 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:32:20.793775 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77cac58-d699-4664-a45c-b5e5ed82d264 None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:32:20.832822 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78937097-838a-4aad-afd6-1f71495c83d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:32:20.833800 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78937097-838a-4aad-afd6-1f71495c83d2 None admin] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:20.834140 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78937097-838a-4aad-afd6-1f71495c83d2 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:20.834423 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78937097-838a-4aad-afd6-1f71495c83d2 None admin] PATH_INFO: `/v3/projects` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:20.835082 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78937097-838a-4aad-afd6-1f71495c83d2 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:32:20.836829 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78937097-838a-4aad-afd6-1f71495c83d2 None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:32:20.870639 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 29/57] 10.222.0.26 () {60 vars in 1140 bytes} [Wed Aug 24 05:32:20 2022] POST /identity/v3/projects => generated 298 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 05:32:22.799301 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b761c616-d0e5-43b2-be1d-6d8abaa071dc None None] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:22.799802 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b761c616-d0e5-43b2-be1d-6d8abaa071dc None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:22.799802 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b761c616-d0e5-43b2-be1d-6d8abaa071dc None None] PATH_INFO: `/` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:22.801111 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 29/58] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 24 05:32:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:32:22.806909 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef92fd5c-32b7-4dd8-a9c3-e15b62327e44 None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:22.807331 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef92fd5c-32b7-4dd8-a9c3-e15b62327e44 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:22.807474 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef92fd5c-32b7-4dd8-a9c3-e15b62327e44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:22.825378 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-ef92fd5c-32b7-4dd8-a9c3-e15b62327e44 None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:32:22.826618 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-ef92fd5c-32b7-4dd8-a9c3-e15b62327e44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:32:22.874226 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:32:22.897065 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 30/59] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 24 05:32:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 05:32:23.170336 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b761c616-d0e5-43b2-be1d-6d8abaa071dc None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:32:23.251424 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:32:23.280378 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b761c616-d0e5-43b2-be1d-6d8abaa071dc None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:32:23.314059 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bd7244-b102-4078-ad92-0d57bbbca85f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:32:23.314696 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bd7244-b102-4078-ad92-0d57bbbca85f None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:23.314983 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bd7244-b102-4078-ad92-0d57bbbca85f None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:23.315256 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bd7244-b102-4078-ad92-0d57bbbca85f None admin] PATH_INFO: `/v3/domains/default` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:23.316378 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bd7244-b102-4078-ad92-0d57bbbca85f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:32:23.318387 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bd7244-b102-4078-ad92-0d57bbbca85f None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:32:23.320209 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 30/60] 10.222.0.26 () {56 vars in 1108 bytes} [Wed Aug 24 05:32:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:32:23.325681 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef92fd5c-32b7-4dd8-a9c3-e15b62327e44 None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:32:23.425763 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef92fd5c-32b7-4dd8-a9c3-e15b62327e44 None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:32:23.460211 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1660b0b8-0a46-49d2-9a5d-21f290b280c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:32:23.460818 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1660b0b8-0a46-49d2-9a5d-21f290b280c0 None admin] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:23.461104 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1660b0b8-0a46-49d2-9a5d-21f290b280c0 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:23.461371 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1660b0b8-0a46-49d2-9a5d-21f290b280c0 None admin] PATH_INFO: `/v3/users` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:23.462051 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1660b0b8-0a46-49d2-9a5d-21f290b280c0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:32:23.463507 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1660b0b8-0a46-49d2-9a5d-21f290b280c0 None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:32:23.488977 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 31/61] 10.222.0.26 () {60 vars in 1132 bytes} [Wed Aug 24 05:32:23 2022] POST /identity/v3/users => generated 275 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:32:26.517577 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbabf10-87d5-4b71-accd-9301c7eb88ff None None] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:26.518150 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbabf10-87d5-4b71-accd-9301c7eb88ff None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:26.518150 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbabf10-87d5-4b71-accd-9301c7eb88ff None None] PATH_INFO: `/` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:26.519484 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 31/62] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 24 05:32:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:32:26.525571 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edaaa8e-6b3a-4320-82de-a5985698b2f8 None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:26.525989 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edaaa8e-6b3a-4320-82de-a5985698b2f8 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:26.526191 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edaaa8e-6b3a-4320-82de-a5985698b2f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:26.554902 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-4edaaa8e-6b3a-4320-82de-a5985698b2f8 None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:32:26.556137 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-4edaaa8e-6b3a-4320-82de-a5985698b2f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:32:26.586659 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:32:26.643621 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 32/63] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 24 05:32:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 05:32:26.825130 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5596780-7fed-42ac-b509-d8bec2143d47 None None] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:26.825768 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5596780-7fed-42ac-b509-d8bec2143d47 None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:26.826277 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5596780-7fed-42ac-b509-d8bec2143d47 None None] PATH_INFO: `/` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:26.827822 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 32/64] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 24 05:32:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:32:26.833869 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8129849a-c840-4e2c-aac5-b3b33b4535ef None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:26.834457 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8129849a-c840-4e2c-aac5-b3b33b4535ef None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:26.834948 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8129849a-c840-4e2c-aac5-b3b33b4535ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:26.855124 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-8129849a-c840-4e2c-aac5-b3b33b4535ef None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:32:26.856685 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-8129849a-c840-4e2c-aac5-b3b33b4535ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:32:26.869666 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0268d44a-fa82-4dd3-9d74-a4f3c20bafdf None None] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:26.870415 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0268d44a-fa82-4dd3-9d74-a4f3c20bafdf None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:26.870724 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0268d44a-fa82-4dd3-9d74-a4f3c20bafdf None None] PATH_INFO: `/` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:26.872086 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 33/65] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 24 05:32:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 05:32:26.883689 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc475ee7-7c3a-4bfa-9d16-ce92082ffb96 None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:26.883976 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc475ee7-7c3a-4bfa-9d16-ce92082ffb96 None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:26.884258 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc475ee7-7c3a-4bfa-9d16-ce92082ffb96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:26.915260 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-cc475ee7-7c3a-4bfa-9d16-ce92082ffb96 None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:32:26.916823 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-cc475ee7-7c3a-4bfa-9d16-ce92082ffb96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:32:26.962460 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 33/66] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 24 05:32:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 05:32:26.976456 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a41e181-7813-4496-b079-b3399912c9a2 None None] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:26.977057 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a41e181-7813-4496-b079-b3399912c9a2 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:26.977547 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a41e181-7813-4496-b079-b3399912c9a2 None None] PATH_INFO: `/` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:26.979099 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 34/67] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 24 05:32:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 05:32:26.985489 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fef1474-c583-4733-a912-8b1999641fe0 None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:26.986043 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fef1474-c583-4733-a912-8b1999641fe0 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:26.986520 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fef1474-c583-4733-a912-8b1999641fe0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:27.011794 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-6fef1474-c583-4733-a912-8b1999641fe0 None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:32:27.013003 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-6fef1474-c583-4733-a912-8b1999641fe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:32:27.035538 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 34/68] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 24 05:32:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 05:32:27.037022 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc475ee7-7c3a-4bfa-9d16-ce92082ffb96 None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:32:27.116546 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 35/69] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 24 05:32:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 05:32:27.126380 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:32:27.155842 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc475ee7-7c3a-4bfa-9d16-ce92082ffb96 None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:32:27.190973 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38796bf0-1687-4f3a-b262-0c7a8b2f528d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:32:27.191611 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38796bf0-1687-4f3a-b262-0c7a8b2f528d None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:27.191888 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38796bf0-1687-4f3a-b262-0c7a8b2f528d None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:27.192163 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38796bf0-1687-4f3a-b262-0c7a8b2f528d None admin] PATH_INFO: `/v3/roles/member` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:27.203734 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38796bf0-1687-4f3a-b262-0c7a8b2f528d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:32:27.208836 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application [None req-38796bf0-1687-4f3a-b262-0c7a8b2f528d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 05:32:27.208836 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:32:27.208836 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:32:27.208836 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:32:27.208836 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:32:27.208836 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:32:27.208836 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:32:27.208836 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:32:27.208836 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:32:27.208836 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:32:27.208836 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:32:27.208836 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:32:27.208836 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:32:27.208836 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:32:27.208836 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:32:27.208836 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:32:27.209666 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:32:27.209666 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:32:27.209666 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:32:27.209666 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:32:27.209666 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:32:27.209666 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:32:27.209666 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:32:27.209666 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:32:27.209666 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:32:27.209666 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:32:27.209666 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:32:27.209666 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application with Lock( Aug 24 05:32:27.209666 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:32:27.209666 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:32:27.209666 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:32:27.209666 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:32:27.210463 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:32:27.210463 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:32:27.210463 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:32:27.210463 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:32:27.210463 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:32:27.210463 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:32:27.210463 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:32:27.210463 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:32:27.210463 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:32:27.210463 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:32:27.210463 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 05:32:27.210463 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Aug 24 05:32:27.210463 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 35/70] 10.222.0.26 () {56 vars in 1099 bytes} [Wed Aug 24 05:32:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:32:27.215984 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fef1474-c583-4733-a912-8b1999641fe0 None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:32:27.252935 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38796bf0-1687-4f3a-b262-0c7a8b2f528d None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:32:27.262301 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:32:27.340642 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fef1474-c583-4733-a912-8b1999641fe0 None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:32:27.381913 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb041ee2-2b37-48b7-8557-82fe6cd95ede None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:32:27.382569 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb041ee2-2b37-48b7-8557-82fe6cd95ede None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:27.382921 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb041ee2-2b37-48b7-8557-82fe6cd95ede None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:27.383267 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb041ee2-2b37-48b7-8557-82fe6cd95ede None admin] PATH_INFO: `/v3/roles` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:27.384068 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb041ee2-2b37-48b7-8557-82fe6cd95ede None admin] RBAC: Adding query filter params (name=member) {{(pid=88113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:32:27.384447 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb041ee2-2b37-48b7-8557-82fe6cd95ede None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:32:27.385913 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb041ee2-2b37-48b7-8557-82fe6cd95ede None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:32:27.394868 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 36/71] 10.222.0.26 () {56 vars in 1101 bytes} [Wed Aug 24 05:32:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:32:27.396326 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb041ee2-2b37-48b7-8557-82fe6cd95ede None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:32:27.405335 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38796bf0-1687-4f3a-b262-0c7a8b2f528d None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:32:27.437185 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:32:27.444449 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbda130-142e-41c1-ad4a-fca4e206b98d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:32:27.445377 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbda130-142e-41c1-ad4a-fca4e206b98d None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:27.445765 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbda130-142e-41c1-ad4a-fca4e206b98d None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:27.446884 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbda130-142e-41c1-ad4a-fca4e206b98d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:27.457827 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbda130-142e-41c1-ad4a-fca4e206b98d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:32:27.463591 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application [None req-bfbda130-142e-41c1-ad4a-fca4e206b98d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 05:32:27.463591 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:32:27.463591 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:32:27.463591 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:32:27.463591 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:32:27.463591 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:32:27.463591 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:32:27.463591 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:32:27.463591 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:32:27.463591 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:32:27.463591 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:32:27.463591 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:32:27.463591 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:32:27.463591 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:32:27.463591 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:32:27.463591 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:32:27.464487 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:32:27.464487 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:32:27.464487 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:32:27.464487 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:32:27.464487 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:32:27.464487 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:32:27.464487 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:32:27.464487 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:32:27.464487 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:32:27.464487 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:32:27.464487 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:32:27.464487 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application with Lock( Aug 24 05:32:27.464487 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:32:27.464487 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:32:27.464487 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:32:27.464487 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:32:27.465225 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:32:27.465225 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:32:27.465225 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:32:27.465225 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:32:27.465225 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:32:27.465225 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:32:27.465225 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:32:27.465225 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:32:27.465225 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:32:27.465225 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:32:27.465225 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 05:32:27.465225 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Aug 24 05:32:27.465225 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 36/72] 10.222.0.26 () {56 vars in 1114 bytes} [Wed Aug 24 05:32:27 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 05:32:27.465842 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbda130-142e-41c1-ad4a-fca4e206b98d None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:32:27.508128 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:32:27.520152 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb041ee2-2b37-48b7-8557-82fe6cd95ede None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:32:27.556514 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81a973e-886a-4349-827a-8b58a33a2e0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:32:27.557150 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81a973e-886a-4349-827a-8b58a33a2e0a None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:27.557437 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81a973e-886a-4349-827a-8b58a33a2e0a None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:27.557715 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81a973e-886a-4349-827a-8b58a33a2e0a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:27.568169 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81a973e-886a-4349-827a-8b58a33a2e0a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:32:27.571136 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbda130-142e-41c1-ad4a-fca4e206b98d None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:32:27.573711 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application [None req-b81a973e-886a-4349-827a-8b58a33a2e0a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 05:32:27.573711 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:32:27.573711 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:32:27.573711 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:32:27.573711 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:32:27.573711 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:32:27.573711 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:32:27.573711 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:32:27.573711 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:32:27.573711 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:32:27.573711 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:32:27.573711 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:32:27.573711 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:32:27.573711 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:32:27.573711 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:32:27.573711 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:32:27.574612 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:32:27.574612 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:32:27.574612 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:32:27.574612 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:32:27.574612 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:32:27.574612 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:32:27.574612 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:32:27.574612 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:32:27.574612 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:32:27.574612 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:32:27.574612 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:32:27.574612 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application with Lock( Aug 24 05:32:27.574612 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:32:27.574612 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:32:27.574612 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:32:27.574612 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:32:27.575401 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:32:27.575401 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:32:27.575401 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:32:27.575401 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:32:27.575401 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:32:27.575401 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:32:27.575401 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:32:27.575401 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:32:27.575401 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:32:27.575401 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:32:27.575401 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 05:32:27.575401 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Aug 24 05:32:27.575401 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 37/73] 10.222.0.26 () {56 vars in 1096 bytes} [Wed Aug 24 05:32:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:32:27.576493 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6939d4a7-b3de-4337-8a34-5b2ecab1fe86 None None] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:27.576493 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6939d4a7-b3de-4337-8a34-5b2ecab1fe86 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:27.576651 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6939d4a7-b3de-4337-8a34-5b2ecab1fe86 None None] PATH_INFO: `/` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:27.582046 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 38/74] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 24 05:32:27 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:32:27.582046 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6939d4a7-b3de-4337-8a34-5b2ecab1fe86 None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:32:27.607540 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce432dbc-37f7-42ec-9890-16f0f22a9f5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:32:27.608165 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce432dbc-37f7-42ec-9890-16f0f22a9f5a None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:27.608450 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce432dbc-37f7-42ec-9890-16f0f22a9f5a None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:27.608727 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce432dbc-37f7-42ec-9890-16f0f22a9f5a None admin] PATH_INFO: `/v3/users/3f18e05ea2ca4efea2d541eedaad23e0` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:27.623161 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce432dbc-37f7-42ec-9890-16f0f22a9f5a None admin] RBAC: Authorizing `identity:get_user(user_id=3f18e05ea2ca4efea2d541eedaad23e0)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:32:27.624614 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce432dbc-37f7-42ec-9890-16f0f22a9f5a None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:32:27.626243 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 37/75] 10.222.0.26 () {56 vars in 1177 bytes} [Wed Aug 24 05:32:27 2022] GET /identity/v3/users/3f18e05ea2ca4efea2d541eedaad23e0 => generated 275 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:32:27.630817 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce432dbc-37f7-42ec-9890-16f0f22a9f5a None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:32:27.678545 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6939d4a7-b3de-4337-8a34-5b2ecab1fe86 None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:32:27.679691 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:32:27.711944 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cfaf7e-a44f-420a-93f2-d96f2868e829 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:32:27.712555 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cfaf7e-a44f-420a-93f2-d96f2868e829 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:27.712833 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cfaf7e-a44f-420a-93f2-d96f2868e829 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:27.713104 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cfaf7e-a44f-420a-93f2-d96f2868e829 None admin] PATH_INFO: `/v3/roles` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:27.713762 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cfaf7e-a44f-420a-93f2-d96f2868e829 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:32:27.714100 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cfaf7e-a44f-420a-93f2-d96f2868e829 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:32:27.715485 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cfaf7e-a44f-420a-93f2-d96f2868e829 None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:32:27.723491 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 39/76] 10.222.0.26 () {56 vars in 1111 bytes} [Wed Aug 24 05:32:27 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:32:27.724882 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cfaf7e-a44f-420a-93f2-d96f2868e829 None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:32:27.732174 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce432dbc-37f7-42ec-9890-16f0f22a9f5a None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:32:27.736116 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:32:27.765929 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831f36c4-2b0c-45fd-ba50-e14c03673e78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:32:27.766585 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831f36c4-2b0c-45fd-ba50-e14c03673e78 None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:27.766870 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831f36c4-2b0c-45fd-ba50-e14c03673e78 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:27.767151 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831f36c4-2b0c-45fd-ba50-e14c03673e78 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:27.777619 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831f36c4-2b0c-45fd-ba50-e14c03673e78 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:32:27.782430 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application [None req-831f36c4-2b0c-45fd-ba50-e14c03673e78 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 05:32:27.782430 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:32:27.782430 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:32:27.782430 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:32:27.782430 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:32:27.782430 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:32:27.782430 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:32:27.782430 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:32:27.782430 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:32:27.782430 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:32:27.782430 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:32:27.782430 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:32:27.782430 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:32:27.782430 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:32:27.782430 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:32:27.782430 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:32:27.783257 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:32:27.783257 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:32:27.783257 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:32:27.783257 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:32:27.783257 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:32:27.783257 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:32:27.783257 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:32:27.783257 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:32:27.783257 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:32:27.783257 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:32:27.783257 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:32:27.783257 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application with Lock( Aug 24 05:32:27.783257 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:32:27.783257 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:32:27.783257 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:32:27.783257 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:32:27.783993 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:32:27.783993 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:32:27.783993 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:32:27.783993 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:32:27.783993 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:32:27.783993 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:32:27.783993 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:32:27.783993 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:32:27.783993 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:32:27.783993 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:32:27.783993 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 05:32:27.783993 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Aug 24 05:32:27.783993 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 38/77] 10.222.0.26 () {56 vars in 1099 bytes} [Wed Aug 24 05:32:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:32:27.785931 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c380360e-9a1e-40cf-81fc-74513e38ceba None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:27.786247 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c380360e-9a1e-40cf-81fc-74513e38ceba None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:27.786523 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c380360e-9a1e-40cf-81fc-74513e38ceba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:27.802862 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-c380360e-9a1e-40cf-81fc-74513e38ceba None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:32:27.804053 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-c380360e-9a1e-40cf-81fc-74513e38ceba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:32:27.829799 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cfaf7e-a44f-420a-93f2-d96f2868e829 None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:32:27.863419 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d134e3f-86fb-473c-8a4f-e4f481c0d170 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:32:27.864207 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d134e3f-86fb-473c-8a4f-e4f481c0d170 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:27.864497 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d134e3f-86fb-473c-8a4f-e4f481c0d170 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:27.864773 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d134e3f-86fb-473c-8a4f-e4f481c0d170 None admin] PATH_INFO: `/v3/roles` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:27.865440 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d134e3f-86fb-473c-8a4f-e4f481c0d170 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:32:27.865744 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d134e3f-86fb-473c-8a4f-e4f481c0d170 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:32:27.867178 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d134e3f-86fb-473c-8a4f-e4f481c0d170 None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:32:27.868874 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 39/78] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 24 05:32:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 05:32:27.869776 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c380360e-9a1e-40cf-81fc-74513e38ceba None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:32:27.875540 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 40/79] 10.222.0.26 () {56 vars in 1099 bytes} [Wed Aug 24 05:32:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:32:27.878777 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d134e3f-86fb-473c-8a4f-e4f481c0d170 None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:32:27.917989 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:32:27.967695 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:32:27.981302 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c380360e-9a1e-40cf-81fc-74513e38ceba None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:32:27.999153 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d134e3f-86fb-473c-8a4f-e4f481c0d170 None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:32:28.016842 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4b9363-b7c1-4ace-83bf-fb538deef63e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:32:28.017342 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4b9363-b7c1-4ace-83bf-fb538deef63e None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:28.017618 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4b9363-b7c1-4ace-83bf-fb538deef63e None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:28.017885 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4b9363-b7c1-4ace-83bf-fb538deef63e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:28.034210 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6166de-bbc2-4027-80dc-ca41a9b31a4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:32:28.034853 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6166de-bbc2-4027-80dc-ca41a9b31a4c None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:28.035138 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6166de-bbc2-4027-80dc-ca41a9b31a4c None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:28.035415 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6166de-bbc2-4027-80dc-ca41a9b31a4c None admin] PATH_INFO: `/v3/users/3f18e05ea2ca4efea2d541eedaad23e0` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:28.036627 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6166de-bbc2-4027-80dc-ca41a9b31a4c None admin] RBAC: Authorizing `identity:get_user(user_id=3f18e05ea2ca4efea2d541eedaad23e0)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:32:28.038120 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6166de-bbc2-4027-80dc-ca41a9b31a4c None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:32:28.039711 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 41/80] 10.222.0.26 () {56 vars in 1177 bytes} [Wed Aug 24 05:32:27 2022] GET /identity/v3/users/3f18e05ea2ca4efea2d541eedaad23e0 => generated 275 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:32:28.044987 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6166de-bbc2-4027-80dc-ca41a9b31a4c None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:32:28.090199 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4b9363-b7c1-4ace-83bf-fb538deef63e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:32:28.091681 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4b9363-b7c1-4ace-83bf-fb538deef63e None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:32:28.135574 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:32:28.151332 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6166de-bbc2-4027-80dc-ca41a9b31a4c None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:32:28.185049 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232fe421-420d-44e2-962b-d8310f84bd0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:32:28.185664 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232fe421-420d-44e2-962b-d8310f84bd0d None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:28.185969 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232fe421-420d-44e2-962b-d8310f84bd0d None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:28.186249 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232fe421-420d-44e2-962b-d8310f84bd0d None admin] PATH_INFO: `/v3/roles` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:28.186912 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232fe421-420d-44e2-962b-d8310f84bd0d None admin] RBAC: Adding query filter params (name=member) {{(pid=88113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:32:28.187221 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232fe421-420d-44e2-962b-d8310f84bd0d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:32:28.188592 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232fe421-420d-44e2-962b-d8310f84bd0d None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:32:28.194287 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 40/81] 10.222.0.26 () {58 vars in 1282 bytes} [Wed Aug 24 05:32:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 05:32:28.195168 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4b9363-b7c1-4ace-83bf-fb538deef63e None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:32:28.203906 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 42/82] 10.222.0.26 () {56 vars in 1101 bytes} [Wed Aug 24 05:32:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:32:28.203906 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232fe421-420d-44e2-962b-d8310f84bd0d None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:32:28.203906 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:32:28.291849 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4b9363-b7c1-4ace-83bf-fb538deef63e None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:32:28.298882 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232fe421-420d-44e2-962b-d8310f84bd0d None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:32:28.326001 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ca9621-a6cb-43a1-adb7-381c25bad863 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:32:28.326627 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ca9621-a6cb-43a1-adb7-381c25bad863 None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:28.326907 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ca9621-a6cb-43a1-adb7-381c25bad863 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:28.327180 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ca9621-a6cb-43a1-adb7-381c25bad863 None admin] PATH_INFO: `/v3/users/f35a18a67d5646f5b515c46f902c78fc` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:28.328307 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ca9621-a6cb-43a1-adb7-381c25bad863 None admin] RBAC: Authorizing `identity:get_user(user_id=f35a18a67d5646f5b515c46f902c78fc)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:32:28.329760 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ca9621-a6cb-43a1-adb7-381c25bad863 None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:32:28.331358 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 41/83] 10.222.0.26 () {56 vars in 1177 bytes} [Wed Aug 24 05:32:28 2022] GET /identity/v3/users/f35a18a67d5646f5b515c46f902c78fc => generated 247 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:32:28.332191 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ca9621-a6cb-43a1-adb7-381c25bad863 None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:32:28.333365 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015d5006-1c17-4c00-825c-cdb1b561758a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:32:28.334160 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015d5006-1c17-4c00-825c-cdb1b561758a None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:28.334581 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015d5006-1c17-4c00-825c-cdb1b561758a None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:28.334863 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015d5006-1c17-4c00-825c-cdb1b561758a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:28.342898 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:32:28.402353 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015d5006-1c17-4c00-825c-cdb1b561758a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:32:28.403948 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015d5006-1c17-4c00-825c-cdb1b561758a None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:32:28.405851 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:32:28.432760 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ca9621-a6cb-43a1-adb7-381c25bad863 None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:32:28.466294 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d701c8-c260-46f7-bd23-18e8ecfc781d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:32:28.466912 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d701c8-c260-46f7-bd23-18e8ecfc781d None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:28.467192 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d701c8-c260-46f7-bd23-18e8ecfc781d None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:28.467465 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d701c8-c260-46f7-bd23-18e8ecfc781d None admin] PATH_INFO: `/v3/domains/default` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:28.468572 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d701c8-c260-46f7-bd23-18e8ecfc781d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:32:28.470033 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d701c8-c260-46f7-bd23-18e8ecfc781d None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:32:28.471568 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 42/84] 10.222.0.26 () {56 vars in 1108 bytes} [Wed Aug 24 05:32:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:32:28.474186 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d701c8-c260-46f7-bd23-18e8ecfc781d None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:32:28.504354 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 43/85] 10.222.0.26 () {58 vars in 1282 bytes} [Wed Aug 24 05:32:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 05:32:28.505318 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015d5006-1c17-4c00-825c-cdb1b561758a None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:32:28.555840 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:32:28.578637 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d701c8-c260-46f7-bd23-18e8ecfc781d None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:32:28.605538 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015d5006-1c17-4c00-825c-cdb1b561758a None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:32:28.607067 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:32:28.612963 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25442d6d-21e3-44dc-a86a-1abbd93c734e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:32:28.613596 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25442d6d-21e3-44dc-a86a-1abbd93c734e None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:28.613877 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25442d6d-21e3-44dc-a86a-1abbd93c734e None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:28.614202 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25442d6d-21e3-44dc-a86a-1abbd93c734e None admin] PATH_INFO: `/v3/projects/d4bde08b78fc4447a53a2928b2d22185` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:28.615343 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25442d6d-21e3-44dc-a86a-1abbd93c734e None admin] RBAC: Authorizing `identity:get_project(project_id=d4bde08b78fc4447a53a2928b2d22185)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:32:28.616791 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25442d6d-21e3-44dc-a86a-1abbd93c734e None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:32:28.618483 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 43/86] 10.222.0.26 () {56 vars in 1186 bytes} [Wed Aug 24 05:32:28 2022] GET /identity/v3/projects/d4bde08b78fc4447a53a2928b2d22185 => generated 298 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:32:28.619249 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25442d6d-21e3-44dc-a86a-1abbd93c734e None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:32:28.643514 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd1cdf7-7eaa-4fb5-b478-a9ef2ddb0e43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:32:28.644143 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd1cdf7-7eaa-4fb5-b478-a9ef2ddb0e43 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:28.644427 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd1cdf7-7eaa-4fb5-b478-a9ef2ddb0e43 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:28.644700 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd1cdf7-7eaa-4fb5-b478-a9ef2ddb0e43 None admin] PATH_INFO: `/v3/users/3f18e05ea2ca4efea2d541eedaad23e0` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:28.646445 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd1cdf7-7eaa-4fb5-b478-a9ef2ddb0e43 None admin] RBAC: Authorizing `identity:get_user(user_id=3f18e05ea2ca4efea2d541eedaad23e0)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:32:28.647929 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd1cdf7-7eaa-4fb5-b478-a9ef2ddb0e43 None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:32:28.649499 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 44/87] 10.222.0.26 () {56 vars in 1177 bytes} [Wed Aug 24 05:32:28 2022] GET /identity/v3/users/3f18e05ea2ca4efea2d541eedaad23e0 => generated 275 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:32:28.649499 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd1cdf7-7eaa-4fb5-b478-a9ef2ddb0e43 None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:32:28.757340 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd1cdf7-7eaa-4fb5-b478-a9ef2ddb0e43 None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:32:28.790965 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ba7dc1-664c-4e8e-b8e6-39b174bc56dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:32:28.791569 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ba7dc1-664c-4e8e-b8e6-39b174bc56dd None admin] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:28.791850 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ba7dc1-664c-4e8e-b8e6-39b174bc56dd None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:28.792124 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ba7dc1-664c-4e8e-b8e6-39b174bc56dd None admin] PATH_INFO: `/v3/users` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:28.792767 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ba7dc1-664c-4e8e-b8e6-39b174bc56dd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:32:28.794244 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ba7dc1-664c-4e8e-b8e6-39b174bc56dd None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:32:28.814739 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 45/88] 10.222.0.26 () {60 vars in 1132 bytes} [Wed Aug 24 05:32:28 2022] POST /identity/v3/users => generated 289 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:32:28.815565 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ba7dc1-664c-4e8e-b8e6-39b174bc56dd None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:32:28.831667 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25442d6d-21e3-44dc-a86a-1abbd93c734e None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:32:28.847895 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:32:28.875873 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50282612-fbd9-4c95-a9d2-560778ef2d82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:32:28.876632 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50282612-fbd9-4c95-a9d2-560778ef2d82 None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:28.876924 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50282612-fbd9-4c95-a9d2-560778ef2d82 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:28.877203 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50282612-fbd9-4c95-a9d2-560778ef2d82 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:28.898472 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:32:28.931007 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ba7dc1-664c-4e8e-b8e6-39b174bc56dd None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:32:28.969253 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50282612-fbd9-4c95-a9d2-560778ef2d82 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:32:28.970876 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50282612-fbd9-4c95-a9d2-560778ef2d82 None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:32:28.971978 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83cc0d6-3acd-4efa-a948-255b8b6d7217 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:32:28.972459 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83cc0d6-3acd-4efa-a948-255b8b6d7217 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:28.973348 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83cc0d6-3acd-4efa-a948-255b8b6d7217 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:28.973348 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83cc0d6-3acd-4efa-a948-255b8b6d7217 None admin] PATH_INFO: `/v3/projects/d4bde08b78fc4447a53a2928b2d22185` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:28.974616 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83cc0d6-3acd-4efa-a948-255b8b6d7217 None admin] RBAC: Authorizing `identity:get_project(project_id=d4bde08b78fc4447a53a2928b2d22185)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:32:28.976137 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83cc0d6-3acd-4efa-a948-255b8b6d7217 None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:32:28.977990 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 46/89] 10.222.0.26 () {56 vars in 1186 bytes} [Wed Aug 24 05:32:28 2022] GET /identity/v3/projects/d4bde08b78fc4447a53a2928b2d22185 => generated 298 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:32:28.978607 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83cc0d6-3acd-4efa-a948-255b8b6d7217 None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:32:29.092429 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:32:29.101738 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 44/90] 10.222.0.26 () {58 vars in 1282 bytes} [Wed Aug 24 05:32:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 483 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 05:32:29.103634 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50282612-fbd9-4c95-a9d2-560778ef2d82 None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:32:29.103747 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83cc0d6-3acd-4efa-a948-255b8b6d7217 None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:32:29.143668 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96838a9f-83c8-4e30-8ced-3f2fa2c34476 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:32:29.144713 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96838a9f-83c8-4e30-8ced-3f2fa2c34476 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:29.145072 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96838a9f-83c8-4e30-8ced-3f2fa2c34476 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:29.145376 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96838a9f-83c8-4e30-8ced-3f2fa2c34476 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:29.146480 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96838a9f-83c8-4e30-8ced-3f2fa2c34476 None admin] RBAC: Adding query filter params (role.id=f7aa4a2c74c94c1b9ca8ecdcccccda5c, scope.project.id=d4bde08b78fc4447a53a2928b2d22185, user.id=3f18e05ea2ca4efea2d541eedaad23e0) {{(pid=88113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:32:29.146610 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96838a9f-83c8-4e30-8ced-3f2fa2c34476 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:32:29.149088 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96838a9f-83c8-4e30-8ced-3f2fa2c34476 None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:32:29.157739 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 47/91] 10.222.0.26 () {56 vars in 1374 bytes} [Wed Aug 24 05:32:28 2022] GET /identity/v3/role_assignments?user.id=3f18e05ea2ca4efea2d541eedaad23e0&scope.project.id=d4bde08b78fc4447a53a2928b2d22185&role.id=f7aa4a2c74c94c1b9ca8ecdcccccda5c => generated 259 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:32:29.158980 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:32:29.162132 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96838a9f-83c8-4e30-8ced-3f2fa2c34476 None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:32:29.226705 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50282612-fbd9-4c95-a9d2-560778ef2d82 None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:32:29.264679 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b150e93d-f53e-4e8d-8fff-c8e8f94d17ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:32:29.265446 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b150e93d-f53e-4e8d-8fff-c8e8f94d17ba None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:29.265736 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b150e93d-f53e-4e8d-8fff-c8e8f94d17ba None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:29.266044 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b150e93d-f53e-4e8d-8fff-c8e8f94d17ba None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:29.300399 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96838a9f-83c8-4e30-8ced-3f2fa2c34476 None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:32:29.340961 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bbc4f8-32f8-4a9f-b0b4-8c99dc43c378 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:32:29.341599 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bbc4f8-32f8-4a9f-b0b4-8c99dc43c378 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:29.341885 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bbc4f8-32f8-4a9f-b0b4-8c99dc43c378 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:29.342528 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bbc4f8-32f8-4a9f-b0b4-8c99dc43c378 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:29.343233 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bbc4f8-32f8-4a9f-b0b4-8c99dc43c378 None admin] RBAC: Adding query filter params (role.id=109c3556f4644bd291e81b0aa7fe2598, scope.project.id=d4bde08b78fc4447a53a2928b2d22185, user.id=3f18e05ea2ca4efea2d541eedaad23e0) {{(pid=88113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:32:29.343549 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bbc4f8-32f8-4a9f-b0b4-8c99dc43c378 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:32:29.345052 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bbc4f8-32f8-4a9f-b0b4-8c99dc43c378 None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:32:29.352936 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 48/92] 10.222.0.26 () {56 vars in 1374 bytes} [Wed Aug 24 05:32:29 2022] GET /identity/v3/role_assignments?user.id=3f18e05ea2ca4efea2d541eedaad23e0&scope.project.id=d4bde08b78fc4447a53a2928b2d22185&role.id=109c3556f4644bd291e81b0aa7fe2598 => generated 259 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:32:29.353577 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bbc4f8-32f8-4a9f-b0b4-8c99dc43c378 None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:32:29.406276 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:32:29.430045 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b150e93d-f53e-4e8d-8fff-c8e8f94d17ba None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:32:29.431994 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b150e93d-f53e-4e8d-8fff-c8e8f94d17ba None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:32:29.488579 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:32:29.531245 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bbc4f8-32f8-4a9f-b0b4-8c99dc43c378 None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:32:29.560474 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 45/93] 10.222.0.26 () {58 vars in 1282 bytes} [Wed Aug 24 05:32:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 458 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 05:32:29.567060 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b150e93d-f53e-4e8d-8fff-c8e8f94d17ba None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:32:29.571756 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fb89a2-b9b3-4ffe-bf92-e885b84246ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:32:29.571756 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fb89a2-b9b3-4ffe-bf92-e885b84246ec None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:29.571756 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fb89a2-b9b3-4ffe-bf92-e885b84246ec None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:29.571756 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fb89a2-b9b3-4ffe-bf92-e885b84246ec None admin] PATH_INFO: `/v3/projects/d4bde08b78fc4447a53a2928b2d22185` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:29.572928 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fb89a2-b9b3-4ffe-bf92-e885b84246ec None admin] RBAC: Authorizing `identity:get_project(project_id=d4bde08b78fc4447a53a2928b2d22185)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:32:29.574728 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fb89a2-b9b3-4ffe-bf92-e885b84246ec None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:32:29.576446 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 49/94] 10.222.0.26 () {56 vars in 1186 bytes} [Wed Aug 24 05:32:29 2022] GET /identity/v3/projects/d4bde08b78fc4447a53a2928b2d22185 => generated 298 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:32:29.586163 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fb89a2-b9b3-4ffe-bf92-e885b84246ec None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:32:29.682581 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:32:29.694171 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fb89a2-b9b3-4ffe-bf92-e885b84246ec None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:32:29.733975 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba05c54-7290-492e-bd60-58b044bca2d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:32:29.733975 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba05c54-7290-492e-bd60-58b044bca2d8 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:29.733975 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba05c54-7290-492e-bd60-58b044bca2d8 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:29.733975 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba05c54-7290-492e-bd60-58b044bca2d8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:29.734393 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba05c54-7290-492e-bd60-58b044bca2d8 None admin] RBAC: Adding query filter params (role.id=640bda0879494e60b72680ee505285f0, scope.project.id=d4bde08b78fc4447a53a2928b2d22185, user.id=f35a18a67d5646f5b515c46f902c78fc) {{(pid=88113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:32:29.734393 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba05c54-7290-492e-bd60-58b044bca2d8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:32:29.735205 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba05c54-7290-492e-bd60-58b044bca2d8 None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:32:29.743107 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 50/95] 10.222.0.26 () {56 vars in 1374 bytes} [Wed Aug 24 05:32:29 2022] GET /identity/v3/role_assignments?user.id=f35a18a67d5646f5b515c46f902c78fc&scope.project.id=d4bde08b78fc4447a53a2928b2d22185&role.id=640bda0879494e60b72680ee505285f0 => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:32:29.751906 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b150e93d-f53e-4e8d-8fff-c8e8f94d17ba None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:32:29.819068 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8745ac-813f-49b5-ac62-0b978bb44400 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:32:29.820040 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8745ac-813f-49b5-ac62-0b978bb44400 None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:29.820498 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8745ac-813f-49b5-ac62-0b978bb44400 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:29.820971 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8745ac-813f-49b5-ac62-0b978bb44400 None admin] PATH_INFO: `/v3/projects/f3919ce03c0d4a24a2c47e7b17d55a4e` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:29.822457 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8745ac-813f-49b5-ac62-0b978bb44400 None admin] RBAC: Authorizing `identity:get_project(project_id=f3919ce03c0d4a24a2c47e7b17d55a4e)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:32:29.824103 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8745ac-813f-49b5-ac62-0b978bb44400 None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:32:29.825993 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 46/96] 10.222.0.26 () {56 vars in 1186 bytes} [Wed Aug 24 05:32:29 2022] GET /identity/v3/projects/f3919ce03c0d4a24a2c47e7b17d55a4e => generated 312 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:32:29.832272 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba05c54-7290-492e-bd60-58b044bca2d8 None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:32:29.972581 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba05c54-7290-492e-bd60-58b044bca2d8 None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:32:30.017446 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103d8a3b-12b3-4f6d-91df-eb8cf1586172 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:32:30.018096 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103d8a3b-12b3-4f6d-91df-eb8cf1586172 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:30.018385 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103d8a3b-12b3-4f6d-91df-eb8cf1586172 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:30.018660 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103d8a3b-12b3-4f6d-91df-eb8cf1586172 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:30.019665 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103d8a3b-12b3-4f6d-91df-eb8cf1586172 None admin] RBAC: Adding query filter params (role.id=f7aa4a2c74c94c1b9ca8ecdcccccda5c, scope.project.id=f3919ce03c0d4a24a2c47e7b17d55a4e, user.id=3f18e05ea2ca4efea2d541eedaad23e0) {{(pid=88113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:32:30.019982 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103d8a3b-12b3-4f6d-91df-eb8cf1586172 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:32:30.021508 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103d8a3b-12b3-4f6d-91df-eb8cf1586172 None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:32:30.030182 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 51/97] 10.222.0.26 () {56 vars in 1374 bytes} [Wed Aug 24 05:32:29 2022] GET /identity/v3/role_assignments?user.id=3f18e05ea2ca4efea2d541eedaad23e0&scope.project.id=f3919ce03c0d4a24a2c47e7b17d55a4e&role.id=f7aa4a2c74c94c1b9ca8ecdcccccda5c => generated 259 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:32:31.591132 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5359a7-a1e7-4cb1-9eb6-cd3e1a6ab560 None None] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:31.592073 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5359a7-a1e7-4cb1-9eb6-cd3e1a6ab560 None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:31.592545 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5359a7-a1e7-4cb1-9eb6-cd3e1a6ab560 None None] PATH_INFO: `/` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:31.594366 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 47/98] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 24 05:32:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:32:31.599874 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7fdc5b-23a6-482b-8405-b667bfdbc71f None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:31.600276 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7fdc5b-23a6-482b-8405-b667bfdbc71f None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:31.600442 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7fdc5b-23a6-482b-8405-b667bfdbc71f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:31.626996 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-4b7fdc5b-23a6-482b-8405-b667bfdbc71f None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:32:31.628291 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-4b7fdc5b-23a6-482b-8405-b667bfdbc71f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:32:31.643350 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:32:31.649835 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86aef192-19cd-4620-b53d-366aee17e012 None None] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:31.650383 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86aef192-19cd-4620-b53d-366aee17e012 None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:31.650662 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86aef192-19cd-4620-b53d-366aee17e012 None None] PATH_INFO: `/` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:31.652178 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 48/99] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 24 05:32:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:32:31.659240 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c28c280-4488-443d-9001-bfb3cf0817da None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:31.659531 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c28c280-4488-443d-9001-bfb3cf0817da None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:31.659813 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c28c280-4488-443d-9001-bfb3cf0817da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:31.691081 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-5c28c280-4488-443d-9001-bfb3cf0817da None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:32:31.692869 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-5c28c280-4488-443d-9001-bfb3cf0817da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:32:31.704376 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:32:31.736382 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 52/100] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 24 05:32:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 05:32:31.832313 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 49/101] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 24 05:32:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 05:32:32.096662 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6294dc6e-d7a5-4ac2-97ae-ebe0907d4fcb None None] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:32.096994 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6294dc6e-d7a5-4ac2-97ae-ebe0907d4fcb None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:32.097168 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6294dc6e-d7a5-4ac2-97ae-ebe0907d4fcb None None] PATH_INFO: `/` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:32.098748 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 53/102] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 24 05:32:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:32:32.104063 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad59207-19c6-4080-8bdc-fe19391ab65f None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:32.104585 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad59207-19c6-4080-8bdc-fe19391ab65f None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:32.105055 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad59207-19c6-4080-8bdc-fe19391ab65f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:32.132093 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-dad59207-19c6-4080-8bdc-fe19391ab65f None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:32:32.133593 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-dad59207-19c6-4080-8bdc-fe19391ab65f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:32:32.135389 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6294dc6e-d7a5-4ac2-97ae-ebe0907d4fcb None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:32:32.252572 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 50/103] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 24 05:32:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 05:32:32.277071 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6294dc6e-d7a5-4ac2-97ae-ebe0907d4fcb None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:32:32.338680 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75613dae-fabd-40a2-a2d4-023ae021936d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:32:32.339365 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75613dae-fabd-40a2-a2d4-023ae021936d None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:32.339651 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75613dae-fabd-40a2-a2d4-023ae021936d None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:32.339924 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75613dae-fabd-40a2-a2d4-023ae021936d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:32.360263 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75613dae-fabd-40a2-a2d4-023ae021936d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:32:32.365618 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application [None req-75613dae-fabd-40a2-a2d4-023ae021936d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 05:32:32.365618 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:32:32.365618 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:32:32.365618 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:32:32.365618 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:32:32.365618 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:32:32.365618 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:32:32.365618 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:32:32.365618 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:32:32.365618 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:32:32.365618 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:32:32.365618 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:32:32.365618 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:32:32.365618 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:32:32.365618 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:32:32.365618 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:32:32.366562 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:32:32.366562 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:32:32.366562 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:32:32.366562 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:32:32.366562 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:32:32.366562 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:32:32.366562 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:32:32.366562 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:32:32.366562 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:32:32.366562 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:32:32.366562 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:32:32.366562 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application with Lock( Aug 24 05:32:32.366562 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:32:32.366562 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:32:32.366562 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:32:32.366562 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:32:32.367298 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:32:32.367298 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:32:32.367298 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:32:32.367298 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:32:32.367298 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:32:32.367298 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:32:32.367298 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:32:32.367298 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:32:32.367298 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:32:32.367298 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:32:32.367298 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 05:32:32.367298 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Aug 24 05:32:32.367298 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 54/104] 10.222.0.26 () {56 vars in 1099 bytes} [Wed Aug 24 05:32:32 2022] GET /identity/v3/roles/reader => generated 84 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 05:32:32.372571 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad59207-19c6-4080-8bdc-fe19391ab65f None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:32:32.384345 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83168d29-ac46-4224-aa13-eca149fadf8c None None] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:32.384633 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83168d29-ac46-4224-aa13-eca149fadf8c None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:32.384905 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83168d29-ac46-4224-aa13-eca149fadf8c None None] PATH_INFO: `/` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:32.386675 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 55/105] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 24 05:32:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:32:32.395587 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37326956-d6c3-4d70-8c02-b50d04e67fe0 None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:32.396163 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37326956-d6c3-4d70-8c02-b50d04e67fe0 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:32.396441 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37326956-d6c3-4d70-8c02-b50d04e67fe0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:32.436166 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-37326956-d6c3-4d70-8c02-b50d04e67fe0 None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:32:32.440482 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-37326956-d6c3-4d70-8c02-b50d04e67fe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:32:32.448356 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:32:32.510450 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:32:32.518552 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad59207-19c6-4080-8bdc-fe19391ab65f None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:32:32.590416 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184bfda6-9d38-46bb-a0fa-838473647365 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:32:32.591821 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184bfda6-9d38-46bb-a0fa-838473647365 None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:32.592346 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184bfda6-9d38-46bb-a0fa-838473647365 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:32.592346 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184bfda6-9d38-46bb-a0fa-838473647365 None admin] PATH_INFO: `/v3/roles` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:32.593016 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184bfda6-9d38-46bb-a0fa-838473647365 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:32:32.593317 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184bfda6-9d38-46bb-a0fa-838473647365 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:32:32.599125 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184bfda6-9d38-46bb-a0fa-838473647365 None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:32:32.613192 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 56/106] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 24 05:32:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 05:32:32.615232 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37326956-d6c3-4d70-8c02-b50d04e67fe0 None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:32:32.628684 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 51/107] 10.222.0.26 () {56 vars in 1101 bytes} [Wed Aug 24 05:32:32 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:32:32.629386 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184bfda6-9d38-46bb-a0fa-838473647365 None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:32:32.722738 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37326956-d6c3-4d70-8c02-b50d04e67fe0 None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:32:32.744834 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184bfda6-9d38-46bb-a0fa-838473647365 None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:32:32.758507 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ac4a17-5ebc-406c-8e37-17aad5df5125 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:32:32.759489 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ac4a17-5ebc-406c-8e37-17aad5df5125 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:32.759964 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ac4a17-5ebc-406c-8e37-17aad5df5125 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:32.760463 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ac4a17-5ebc-406c-8e37-17aad5df5125 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:32.761767 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ac4a17-5ebc-406c-8e37-17aad5df5125 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:32:32.763427 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ac4a17-5ebc-406c-8e37-17aad5df5125 None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:32:32.765194 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 57/108] 10.222.0.26 () {56 vars in 1108 bytes} [Wed Aug 24 05:32:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:32:32.771084 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ac4a17-5ebc-406c-8e37-17aad5df5125 None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:32:32.780192 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c233c5a9-4397-4fa1-8e28-5f96491c5624 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:32:32.780721 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:32:32.780831 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c233c5a9-4397-4fa1-8e28-5f96491c5624 None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:32.781098 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c233c5a9-4397-4fa1-8e28-5f96491c5624 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:32.781882 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c233c5a9-4397-4fa1-8e28-5f96491c5624 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:32.793362 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c233c5a9-4397-4fa1-8e28-5f96491c5624 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:32:32.798121 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:32:32.801495 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application [None req-c233c5a9-4397-4fa1-8e28-5f96491c5624 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 05:32:32.801495 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:32:32.801495 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:32:32.801495 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:32:32.801495 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:32:32.801495 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:32:32.801495 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:32:32.801495 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:32:32.801495 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:32:32.801495 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:32:32.801495 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:32:32.801495 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:32:32.801495 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:32:32.801495 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:32:32.801495 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:32:32.801495 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:32:32.802515 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:32:32.802515 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:32:32.802515 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:32:32.802515 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:32:32.802515 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:32:32.802515 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:32:32.802515 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:32:32.802515 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:32:32.802515 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:32:32.802515 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:32:32.802515 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:32:32.802515 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application with Lock( Aug 24 05:32:32.802515 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:32:32.802515 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:32:32.802515 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:32:32.802515 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:32:32.803477 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:32:32.803477 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:32:32.803477 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:32:32.803477 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:32:32.803477 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:32:32.803477 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:32:32.803477 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:32:32.803477 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:32:32.803477 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:32:32.803477 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:32:32.803477 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 05:32:32.803477 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Aug 24 05:32:32.806140 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 52/109] 10.222.0.26 () {56 vars in 1114 bytes} [Wed Aug 24 05:32:32 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:32:32.808363 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbeb0e5-8663-4bd2-96cd-8e7448784e91 None None] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:32.808814 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbeb0e5-8663-4bd2-96cd-8e7448784e91 None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:32.809524 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbeb0e5-8663-4bd2-96cd-8e7448784e91 None None] PATH_INFO: `/` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:32.811226 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 53/110] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 24 05:32:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:32:32.812056 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbeb0e5-8663-4bd2-96cd-8e7448784e91 None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:32:32.886262 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ac4a17-5ebc-406c-8e37-17aad5df5125 None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:32:32.922950 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6242c000-aac3-4b68-920f-4c108dcbffff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:32:32.923645 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6242c000-aac3-4b68-920f-4c108dcbffff None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:32.923937 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6242c000-aac3-4b68-920f-4c108dcbffff None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:32.924998 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6242c000-aac3-4b68-920f-4c108dcbffff None admin] PATH_INFO: `/v3/users/4741d05f701246fe9bc52f7dabbfde5f` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:32.936934 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbeb0e5-8663-4bd2-96cd-8e7448784e91 None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:32:32.942910 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6242c000-aac3-4b68-920f-4c108dcbffff None admin] RBAC: Authorizing `identity:get_user(user_id=4741d05f701246fe9bc52f7dabbfde5f)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:32:32.945255 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6242c000-aac3-4b68-920f-4c108dcbffff None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:32:32.947495 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 58/111] 10.222.0.26 () {56 vars in 1177 bytes} [Wed Aug 24 05:32:32 2022] GET /identity/v3/users/4741d05f701246fe9bc52f7dabbfde5f => generated 289 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:32:32.948527 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6242c000-aac3-4b68-920f-4c108dcbffff None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:32:32.978085 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee0cb52-225f-4210-9a55-e6ced990c55a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:32:32.978708 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee0cb52-225f-4210-9a55-e6ced990c55a None admin] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:32.978995 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee0cb52-225f-4210-9a55-e6ced990c55a None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:32.979273 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee0cb52-225f-4210-9a55-e6ced990c55a None admin] PATH_INFO: `/v3/projects` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:32.979922 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee0cb52-225f-4210-9a55-e6ced990c55a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:32:32.981424 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee0cb52-225f-4210-9a55-e6ced990c55a None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:32:33.010737 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 54/112] 10.222.0.26 () {60 vars in 1141 bytes} [Wed Aug 24 05:32:32 2022] POST /identity/v3/projects => generated 302 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:32:33.012247 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b952d71-4e63-489c-afca-0f9c5077c20e None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:33.012683 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b952d71-4e63-489c-afca-0f9c5077c20e None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:33.012961 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b952d71-4e63-489c-afca-0f9c5077c20e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:33.014550 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:32:33.033290 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-6b952d71-4e63-489c-afca-0f9c5077c20e None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:32:33.034555 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-6b952d71-4e63-489c-afca-0f9c5077c20e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:32:33.058590 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6242c000-aac3-4b68-920f-4c108dcbffff None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:32:33.080344 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:32:33.103063 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e31de8-3d9f-407f-ae76-65cd99b0d76e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:32:33.103681 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e31de8-3d9f-407f-ae76-65cd99b0d76e None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:33.103961 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e31de8-3d9f-407f-ae76-65cd99b0d76e None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:33.104300 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e31de8-3d9f-407f-ae76-65cd99b0d76e None admin] PATH_INFO: `/v3/roles` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:33.104908 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e31de8-3d9f-407f-ae76-65cd99b0d76e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:32:33.105210 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e31de8-3d9f-407f-ae76-65cd99b0d76e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:32:33.106637 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e31de8-3d9f-407f-ae76-65cd99b0d76e None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:32:33.114250 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 55/113] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 24 05:32:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 05:32:33.114250 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b952d71-4e63-489c-afca-0f9c5077c20e None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:32:33.117964 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 59/114] 10.222.0.26 () {56 vars in 1111 bytes} [Wed Aug 24 05:32:32 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:32:33.117964 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e31de8-3d9f-407f-ae76-65cd99b0d76e None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:32:33.243465 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e31de8-3d9f-407f-ae76-65cd99b0d76e None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:32:33.257544 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b952d71-4e63-489c-afca-0f9c5077c20e None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:32:33.271290 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:32:33.280483 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb103c92-d83a-47e9-a306-bd568abed5e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:32:33.281215 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb103c92-d83a-47e9-a306-bd568abed5e8 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:33.281563 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb103c92-d83a-47e9-a306-bd568abed5e8 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:33.281904 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb103c92-d83a-47e9-a306-bd568abed5e8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:33.301114 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef9ccf9-fc51-4c2c-8e87-32d47ccc47fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:32:33.301857 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef9ccf9-fc51-4c2c-8e87-32d47ccc47fc None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:33.302179 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef9ccf9-fc51-4c2c-8e87-32d47ccc47fc None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:33.302453 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef9ccf9-fc51-4c2c-8e87-32d47ccc47fc None admin] PATH_INFO: `/v3/roles/member` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:33.313520 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef9ccf9-fc51-4c2c-8e87-32d47ccc47fc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:32:33.319570 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application [None req-1ef9ccf9-fc51-4c2c-8e87-32d47ccc47fc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 05:32:33.319570 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:32:33.319570 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:32:33.319570 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:32:33.319570 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:32:33.319570 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:32:33.319570 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:32:33.319570 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:32:33.319570 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:32:33.319570 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:32:33.319570 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:32:33.319570 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:32:33.319570 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:32:33.319570 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:32:33.319570 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:32:33.319570 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:32:33.320372 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:32:33.320372 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:32:33.320372 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:32:33.320372 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:32:33.320372 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:32:33.320372 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:32:33.320372 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:32:33.320372 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:32:33.320372 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:32:33.320372 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:32:33.320372 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:32:33.320372 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application with Lock( Aug 24 05:32:33.320372 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:32:33.320372 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:32:33.320372 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:32:33.320372 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:32:33.321123 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:32:33.321123 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:32:33.321123 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:32:33.321123 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:32:33.321123 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:32:33.321123 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:32:33.321123 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:32:33.321123 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:32:33.321123 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:32:33.321123 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:32:33.321123 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 05:32:33.321123 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Aug 24 05:32:33.321123 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 56/115] 10.222.0.26 () {56 vars in 1099 bytes} [Wed Aug 24 05:32:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:32:33.326016 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ceb744b-519d-4a89-b346-67513d848c7d None None] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:33.326016 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ceb744b-519d-4a89-b346-67513d848c7d None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:33.326016 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ceb744b-519d-4a89-b346-67513d848c7d None None] PATH_INFO: `/` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:33.326016 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 57/116] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 24 05:32:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:32:33.326016 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ceb744b-519d-4a89-b346-67513d848c7d None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:32:33.365585 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb103c92-d83a-47e9-a306-bd568abed5e8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:32:33.368115 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb103c92-d83a-47e9-a306-bd568abed5e8 None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:32:33.391892 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:32:33.438607 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ceb744b-519d-4a89-b346-67513d848c7d None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:32:33.476057 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65116130-96a2-4adb-8f90-4c121437346a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:32:33.476674 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65116130-96a2-4adb-8f90-4c121437346a None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:33.476961 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65116130-96a2-4adb-8f90-4c121437346a None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:33.477232 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65116130-96a2-4adb-8f90-4c121437346a None admin] PATH_INFO: `/v3/users/3f18e05ea2ca4efea2d541eedaad23e0` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:33.478395 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65116130-96a2-4adb-8f90-4c121437346a None admin] RBAC: Authorizing `identity:get_user(user_id=3f18e05ea2ca4efea2d541eedaad23e0)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:32:33.479859 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65116130-96a2-4adb-8f90-4c121437346a None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:32:33.481432 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 58/117] 10.222.0.26 () {56 vars in 1177 bytes} [Wed Aug 24 05:32:33 2022] GET /identity/v3/users/3f18e05ea2ca4efea2d541eedaad23e0 => generated 275 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:32:33.482217 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65116130-96a2-4adb-8f90-4c121437346a None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:32:33.484391 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 60/118] 10.222.0.26 () {58 vars in 1282 bytes} [Wed Aug 24 05:32:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 05:32:33.489967 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcffa5d-0c73-4036-b885-c51e2eac664e None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:33.490176 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcffa5d-0c73-4036-b885-c51e2eac664e None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:33.490457 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcffa5d-0c73-4036-b885-c51e2eac664e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:33.511357 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-2bcffa5d-0c73-4036-b885-c51e2eac664e None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:32:33.512465 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-2bcffa5d-0c73-4036-b885-c51e2eac664e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:32:33.536456 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:32:33.586456 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 61/119] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 24 05:32:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 05:32:33.587321 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcffa5d-0c73-4036-b885-c51e2eac664e None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:32:33.619055 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65116130-96a2-4adb-8f90-4c121437346a None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:32:33.623052 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:32:33.658563 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce67d54-b1bb-4528-83dd-f2bb653707e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:32:33.659177 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce67d54-b1bb-4528-83dd-f2bb653707e6 None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:33.659458 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce67d54-b1bb-4528-83dd-f2bb653707e6 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:33.659730 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce67d54-b1bb-4528-83dd-f2bb653707e6 None admin] PATH_INFO: `/v3/roles` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:33.660402 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce67d54-b1bb-4528-83dd-f2bb653707e6 None admin] RBAC: Adding query filter params (name=member) {{(pid=88112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:32:33.661025 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce67d54-b1bb-4528-83dd-f2bb653707e6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:32:33.662318 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce67d54-b1bb-4528-83dd-f2bb653707e6 None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:32:33.675885 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 59/120] 10.222.0.26 () {56 vars in 1101 bytes} [Wed Aug 24 05:32:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:32:33.677362 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce67d54-b1bb-4528-83dd-f2bb653707e6 None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:32:33.731040 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcffa5d-0c73-4036-b885-c51e2eac664e None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:32:33.775264 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f949acf-b7ff-4e97-92cf-fa65454d6503 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:32:33.776105 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f949acf-b7ff-4e97-92cf-fa65454d6503 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:33.776105 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f949acf-b7ff-4e97-92cf-fa65454d6503 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:33.776396 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f949acf-b7ff-4e97-92cf-fa65454d6503 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:33.787579 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f949acf-b7ff-4e97-92cf-fa65454d6503 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:32:33.792297 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application [None req-6f949acf-b7ff-4e97-92cf-fa65454d6503 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 05:32:33.792297 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:32:33.792297 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:32:33.792297 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:32:33.792297 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:32:33.792297 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:32:33.792297 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:32:33.792297 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:32:33.792297 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:32:33.792297 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:32:33.792297 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:32:33.792297 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:32:33.792297 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:32:33.792297 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:32:33.792297 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:32:33.792297 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:32:33.793119 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:32:33.793119 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:32:33.793119 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:32:33.793119 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:32:33.793119 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:32:33.793119 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:32:33.793119 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:32:33.793119 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:32:33.793119 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:32:33.793119 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:32:33.793119 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:32:33.793119 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application with Lock( Aug 24 05:32:33.793119 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:32:33.793119 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:32:33.793119 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:32:33.793119 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:32:33.794303 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:32:33.794303 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:32:33.794303 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:32:33.794303 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:32:33.794303 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:32:33.794303 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:32:33.794303 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:32:33.794303 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:32:33.794303 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:32:33.794303 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:32:33.794303 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 05:32:33.794303 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Aug 24 05:32:33.794303 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 62/121] 10.222.0.26 () {56 vars in 1096 bytes} [Wed Aug 24 05:32:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:32:33.794303 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f949acf-b7ff-4e97-92cf-fa65454d6503 None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:32:33.812727 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce67d54-b1bb-4528-83dd-f2bb653707e6 None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:32:33.814010 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:32:33.851553 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98a7ef3-4732-4175-b842-a5030af7af54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:32:33.852189 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98a7ef3-4732-4175-b842-a5030af7af54 None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:33.852467 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98a7ef3-4732-4175-b842-a5030af7af54 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:33.852740 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98a7ef3-4732-4175-b842-a5030af7af54 None admin] PATH_INFO: `/v3/projects/d4bde08b78fc4447a53a2928b2d22185` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:33.853916 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98a7ef3-4732-4175-b842-a5030af7af54 None admin] RBAC: Authorizing `identity:get_project(project_id=d4bde08b78fc4447a53a2928b2d22185)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:32:33.855448 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98a7ef3-4732-4175-b842-a5030af7af54 None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:32:33.857632 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 60/122] 10.222.0.26 () {56 vars in 1186 bytes} [Wed Aug 24 05:32:33 2022] GET /identity/v3/projects/d4bde08b78fc4447a53a2928b2d22185 => generated 298 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:32:33.862316 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98a7ef3-4732-4175-b842-a5030af7af54 None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:32:33.897407 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:32:33.919009 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f949acf-b7ff-4e97-92cf-fa65454d6503 None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:32:33.957277 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e13fcc1-ae6c-4555-8fa2-667d6d8fc849 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:32:33.958295 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e13fcc1-ae6c-4555-8fa2-667d6d8fc849 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:33.958768 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e13fcc1-ae6c-4555-8fa2-667d6d8fc849 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:33.959043 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e13fcc1-ae6c-4555-8fa2-667d6d8fc849 None admin] PATH_INFO: `/v3/projects/d4bde08b78fc4447a53a2928b2d22185` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:33.960178 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e13fcc1-ae6c-4555-8fa2-667d6d8fc849 None admin] RBAC: Authorizing `identity:get_project(project_id=d4bde08b78fc4447a53a2928b2d22185)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:32:33.961666 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e13fcc1-ae6c-4555-8fa2-667d6d8fc849 None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:32:33.963465 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 63/123] 10.222.0.26 () {56 vars in 1186 bytes} [Wed Aug 24 05:32:33 2022] GET /identity/v3/projects/d4bde08b78fc4447a53a2928b2d22185 => generated 298 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:32:33.967636 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98a7ef3-4732-4175-b842-a5030af7af54 None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:32:33.968749 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e13fcc1-ae6c-4555-8fa2-667d6d8fc849 None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:32:34.005867 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030f5577-72f0-4c6f-a917-c4fd37bb211d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:32:34.006541 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030f5577-72f0-4c6f-a917-c4fd37bb211d None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:34.006827 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030f5577-72f0-4c6f-a917-c4fd37bb211d None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:34.007105 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030f5577-72f0-4c6f-a917-c4fd37bb211d None admin] PATH_INFO: `/v3/users/3f18e05ea2ca4efea2d541eedaad23e0` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:34.008381 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030f5577-72f0-4c6f-a917-c4fd37bb211d None admin] RBAC: Authorizing `identity:get_user(user_id=3f18e05ea2ca4efea2d541eedaad23e0)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:32:34.009992 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030f5577-72f0-4c6f-a917-c4fd37bb211d None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:32:34.011711 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 61/124] 10.222.0.26 () {56 vars in 1177 bytes} [Wed Aug 24 05:32:33 2022] GET /identity/v3/users/3f18e05ea2ca4efea2d541eedaad23e0 => generated 275 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:32:34.012486 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030f5577-72f0-4c6f-a917-c4fd37bb211d None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:32:34.057084 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:32:34.073799 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e13fcc1-ae6c-4555-8fa2-667d6d8fc849 None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:32:34.107634 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c1f82c-1e0c-4d13-8b2a-6efd23ce5573 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:32:34.108245 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c1f82c-1e0c-4d13-8b2a-6efd23ce5573 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:34.108628 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c1f82c-1e0c-4d13-8b2a-6efd23ce5573 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:34.108818 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c1f82c-1e0c-4d13-8b2a-6efd23ce5573 None admin] PATH_INFO: `/v3/roles` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:34.109458 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c1f82c-1e0c-4d13-8b2a-6efd23ce5573 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:32:34.109762 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c1f82c-1e0c-4d13-8b2a-6efd23ce5573 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:32:34.111173 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c1f82c-1e0c-4d13-8b2a-6efd23ce5573 None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:32:34.120055 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 64/125] 10.222.0.26 () {56 vars in 1099 bytes} [Wed Aug 24 05:32:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:32:34.123325 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030f5577-72f0-4c6f-a917-c4fd37bb211d None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:32:34.125078 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:32:34.125187 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c1f82c-1e0c-4d13-8b2a-6efd23ce5573 None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:32:34.161748 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05840a8-5ca2-4cf3-a3b2-00cb0f4def8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:32:34.162426 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05840a8-5ca2-4cf3-a3b2-00cb0f4def8a None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:34.162761 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05840a8-5ca2-4cf3-a3b2-00cb0f4def8a None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:34.163035 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05840a8-5ca2-4cf3-a3b2-00cb0f4def8a None admin] PATH_INFO: `/v3/roles/member` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:34.173793 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05840a8-5ca2-4cf3-a3b2-00cb0f4def8a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:32:34.178651 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application [None req-e05840a8-5ca2-4cf3-a3b2-00cb0f4def8a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 05:32:34.178651 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:32:34.178651 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:32:34.178651 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:32:34.178651 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:32:34.178651 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:32:34.178651 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:32:34.178651 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:32:34.178651 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:32:34.178651 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:32:34.178651 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:32:34.178651 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:32:34.178651 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:32:34.178651 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:32:34.178651 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:32:34.178651 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:32:34.179492 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:32:34.179492 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:32:34.179492 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:32:34.179492 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:32:34.179492 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:32:34.179492 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:32:34.179492 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:32:34.179492 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:32:34.179492 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:32:34.179492 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:32:34.179492 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:32:34.179492 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application with Lock( Aug 24 05:32:34.179492 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:32:34.179492 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:32:34.179492 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:32:34.179492 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:32:34.182675 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:32:34.182675 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:32:34.182675 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:32:34.182675 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:32:34.182675 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:32:34.182675 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:32:34.182675 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:32:34.182675 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:32:34.182675 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:32:34.182675 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:32:34.182675 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 05:32:34.182675 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Aug 24 05:32:34.182675 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 62/126] 10.222.0.26 () {56 vars in 1099 bytes} [Wed Aug 24 05:32:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:32:34.182675 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05840a8-5ca2-4cf3-a3b2-00cb0f4def8a None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:32:34.236792 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c1f82c-1e0c-4d13-8b2a-6efd23ce5573 None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:32:34.269694 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1658a9e1-2665-400b-a1d1-8ab86463f55c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:32:34.271037 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1658a9e1-2665-400b-a1d1-8ab86463f55c None admin] REQUEST_METHOD: `PUT` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:34.271320 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1658a9e1-2665-400b-a1d1-8ab86463f55c None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:34.271594 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1658a9e1-2665-400b-a1d1-8ab86463f55c None admin] PATH_INFO: `/v3/projects/d4bde08b78fc4447a53a2928b2d22185/users/3f18e05ea2ca4efea2d541eedaad23e0/roles/109c3556f4644bd291e81b0aa7fe2598` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:34.273734 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1658a9e1-2665-400b-a1d1-8ab86463f55c None admin] RBAC: Authorizing `identity:create_grant(project_id=d4bde08b78fc4447a53a2928b2d22185, user_id=3f18e05ea2ca4efea2d541eedaad23e0, role_id=109c3556f4644bd291e81b0aa7fe2598)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:32:34.275216 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1658a9e1-2665-400b-a1d1-8ab86463f55c None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:32:34.285506 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05840a8-5ca2-4cf3-a3b2-00cb0f4def8a None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:32:34.290587 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 65/127] 10.222.0.26 () {58 vars in 1439 bytes} [Wed Aug 24 05:32:34 2022] PUT /identity/v3/projects/d4bde08b78fc4447a53a2928b2d22185/users/3f18e05ea2ca4efea2d541eedaad23e0/roles/109c3556f4644bd291e81b0aa7fe2598 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:32:34.291183 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1658a9e1-2665-400b-a1d1-8ab86463f55c None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:32:34.300189 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:32:34.340647 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa37f6e-de31-435b-a043-f97bf782dcc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:32:34.341722 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa37f6e-de31-435b-a043-f97bf782dcc8 None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:34.342161 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa37f6e-de31-435b-a043-f97bf782dcc8 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:34.342571 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa37f6e-de31-435b-a043-f97bf782dcc8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:34.343639 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa37f6e-de31-435b-a043-f97bf782dcc8 None admin] RBAC: Adding query filter params (role.id=129798c59b2c43978b555869931dada4, scope.project.id=d4bde08b78fc4447a53a2928b2d22185, user.id=4741d05f701246fe9bc52f7dabbfde5f) {{(pid=88112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:32:34.344091 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa37f6e-de31-435b-a043-f97bf782dcc8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:32:34.345791 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa37f6e-de31-435b-a043-f97bf782dcc8 None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:32:34.353441 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 63/128] 10.222.0.26 () {56 vars in 1374 bytes} [Wed Aug 24 05:32:34 2022] GET /identity/v3/role_assignments?user.id=4741d05f701246fe9bc52f7dabbfde5f&scope.project.id=d4bde08b78fc4447a53a2928b2d22185&role.id=129798c59b2c43978b555869931dada4 => generated 259 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:32:34.354792 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa37f6e-de31-435b-a043-f97bf782dcc8 None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:32:34.388627 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:32:34.463273 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1658a9e1-2665-400b-a1d1-8ab86463f55c None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:32:34.482974 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa37f6e-de31-435b-a043-f97bf782dcc8 None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:32:34.533007 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd190293-5cf9-42ca-9689-5f81cf22dd8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:32:34.539188 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd190293-5cf9-42ca-9689-5f81cf22dd8c None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:34.539188 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd190293-5cf9-42ca-9689-5f81cf22dd8c None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:34.539322 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd190293-5cf9-42ca-9689-5f81cf22dd8c None admin] PATH_INFO: `/v3/users/f35a18a67d5646f5b515c46f902c78fc` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:34.540602 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd190293-5cf9-42ca-9689-5f81cf22dd8c None admin] RBAC: Authorizing `identity:get_user(user_id=f35a18a67d5646f5b515c46f902c78fc)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:32:34.542114 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd190293-5cf9-42ca-9689-5f81cf22dd8c None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:32:34.542688 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa07fb9-cc97-49e9-af95-aa131ba42d79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:32:34.543597 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa07fb9-cc97-49e9-af95-aa131ba42d79 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:34.544099 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 64/129] 10.222.0.26 () {56 vars in 1177 bytes} [Wed Aug 24 05:32:34 2022] GET /identity/v3/users/f35a18a67d5646f5b515c46f902c78fc => generated 247 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:32:34.544203 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa07fb9-cc97-49e9-af95-aa131ba42d79 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:34.544740 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa07fb9-cc97-49e9-af95-aa131ba42d79 None admin] PATH_INFO: `/v3/projects/d4bde08b78fc4447a53a2928b2d22185` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:34.544930 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd190293-5cf9-42ca-9689-5f81cf22dd8c None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:32:34.546467 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa07fb9-cc97-49e9-af95-aa131ba42d79 None admin] RBAC: Authorizing `identity:get_project(project_id=d4bde08b78fc4447a53a2928b2d22185)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:32:34.551796 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa07fb9-cc97-49e9-af95-aa131ba42d79 None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:32:34.553547 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 66/130] 10.222.0.26 () {56 vars in 1186 bytes} [Wed Aug 24 05:32:34 2022] GET /identity/v3/projects/d4bde08b78fc4447a53a2928b2d22185 => generated 298 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:32:34.554211 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa07fb9-cc97-49e9-af95-aa131ba42d79 None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:32:34.667725 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:32:34.670491 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:32:34.679808 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd190293-5cf9-42ca-9689-5f81cf22dd8c None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:32:34.722243 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0a6854-8e34-47f8-b08a-5235e63ec4b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:32:34.723562 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0a6854-8e34-47f8-b08a-5235e63ec4b7 None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:34.724050 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0a6854-8e34-47f8-b08a-5235e63ec4b7 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:34.724516 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0a6854-8e34-47f8-b08a-5235e63ec4b7 None admin] PATH_INFO: `/v3/roles` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:34.724734 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa07fb9-cc97-49e9-af95-aa131ba42d79 None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:32:34.725594 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0a6854-8e34-47f8-b08a-5235e63ec4b7 None admin] RBAC: Adding query filter params (name=member) {{(pid=88112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:32:34.726334 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0a6854-8e34-47f8-b08a-5235e63ec4b7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:32:34.727935 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0a6854-8e34-47f8-b08a-5235e63ec4b7 None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:32:34.738240 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 65/131] 10.222.0.26 () {56 vars in 1101 bytes} [Wed Aug 24 05:32:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:32:34.739403 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0a6854-8e34-47f8-b08a-5235e63ec4b7 None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:32:34.807122 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78537186-6856-4170-a021-e2f92450a39e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:32:34.807846 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78537186-6856-4170-a021-e2f92450a39e None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:34.808046 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78537186-6856-4170-a021-e2f92450a39e None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:34.808318 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78537186-6856-4170-a021-e2f92450a39e None admin] PATH_INFO: `/v3/projects/d4bde08b78fc4447a53a2928b2d22185` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:34.814668 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78537186-6856-4170-a021-e2f92450a39e None admin] RBAC: Authorizing `identity:get_project(project_id=d4bde08b78fc4447a53a2928b2d22185)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:32:34.816251 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78537186-6856-4170-a021-e2f92450a39e None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:32:34.819227 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 67/132] 10.222.0.26 () {56 vars in 1186 bytes} [Wed Aug 24 05:32:34 2022] GET /identity/v3/projects/d4bde08b78fc4447a53a2928b2d22185 => generated 298 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:32:34.819836 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78537186-6856-4170-a021-e2f92450a39e None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:32:34.864846 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0a6854-8e34-47f8-b08a-5235e63ec4b7 None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:32:34.906761 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c16340d-982a-459d-a224-53030391663d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:32:34.907810 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c16340d-982a-459d-a224-53030391663d None admin] REQUEST_METHOD: `PUT` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:34.908289 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c16340d-982a-459d-a224-53030391663d None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:34.908935 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c16340d-982a-459d-a224-53030391663d None admin] PATH_INFO: `/v3/projects/d4bde08b78fc4447a53a2928b2d22185/users/3f18e05ea2ca4efea2d541eedaad23e0/roles/f7aa4a2c74c94c1b9ca8ecdcccccda5c` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:34.911364 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c16340d-982a-459d-a224-53030391663d None admin] RBAC: Authorizing `identity:create_grant(project_id=d4bde08b78fc4447a53a2928b2d22185, user_id=3f18e05ea2ca4efea2d541eedaad23e0, role_id=f7aa4a2c74c94c1b9ca8ecdcccccda5c)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:32:34.914043 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c16340d-982a-459d-a224-53030391663d None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:32:34.937991 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 66/133] 10.222.0.26 () {58 vars in 1439 bytes} [Wed Aug 24 05:32:34 2022] PUT /identity/v3/projects/d4bde08b78fc4447a53a2928b2d22185/users/3f18e05ea2ca4efea2d541eedaad23e0/roles/f7aa4a2c74c94c1b9ca8ecdcccccda5c => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:32:34.939146 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c16340d-982a-459d-a224-53030391663d None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:32:34.973281 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:32:35.000888 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78537186-6856-4170-a021-e2f92450a39e None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:32:35.085398 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878195da-161b-4103-b5c6-2d25e4795531 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:32:35.086106 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878195da-161b-4103-b5c6-2d25e4795531 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:35.086401 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878195da-161b-4103-b5c6-2d25e4795531 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:35.086680 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878195da-161b-4103-b5c6-2d25e4795531 None admin] PATH_INFO: `/v3/users/3f18e05ea2ca4efea2d541eedaad23e0` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:35.089649 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878195da-161b-4103-b5c6-2d25e4795531 None admin] RBAC: Authorizing `identity:get_user(user_id=3f18e05ea2ca4efea2d541eedaad23e0)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:32:35.091193 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878195da-161b-4103-b5c6-2d25e4795531 None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:32:35.092861 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 68/134] 10.222.0.26 () {56 vars in 1177 bytes} [Wed Aug 24 05:32:34 2022] GET /identity/v3/users/3f18e05ea2ca4efea2d541eedaad23e0 => generated 275 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:32:35.094096 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e833126-f5aa-4b2d-99a8-09b582182a97 None None] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:35.094395 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e833126-f5aa-4b2d-99a8-09b582182a97 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:35.100481 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e833126-f5aa-4b2d-99a8-09b582182a97 None None] PATH_INFO: `/` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:35.101990 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 69/135] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 24 05:32:35 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:32:35.102738 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e833126-f5aa-4b2d-99a8-09b582182a97 None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:32:35.138360 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:32:35.142926 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c16340d-982a-459d-a224-53030391663d None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:32:35.178032 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01197654-6fbf-4d0a-a5b3-fae9c325ac4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:32:35.178710 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01197654-6fbf-4d0a-a5b3-fae9c325ac4f None admin] REQUEST_METHOD: `PUT` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:35.178990 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01197654-6fbf-4d0a-a5b3-fae9c325ac4f None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:35.179272 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01197654-6fbf-4d0a-a5b3-fae9c325ac4f None admin] PATH_INFO: `/v3/projects/d4bde08b78fc4447a53a2928b2d22185/users/f35a18a67d5646f5b515c46f902c78fc/roles/640bda0879494e60b72680ee505285f0` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:35.181187 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01197654-6fbf-4d0a-a5b3-fae9c325ac4f None admin] RBAC: Authorizing `identity:create_grant(project_id=d4bde08b78fc4447a53a2928b2d22185, user_id=f35a18a67d5646f5b515c46f902c78fc, role_id=640bda0879494e60b72680ee505285f0)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:32:35.182662 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01197654-6fbf-4d0a-a5b3-fae9c325ac4f None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:32:35.199173 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 67/136] 10.222.0.26 () {58 vars in 1439 bytes} [Wed Aug 24 05:32:34 2022] PUT /identity/v3/projects/d4bde08b78fc4447a53a2928b2d22185/users/f35a18a67d5646f5b515c46f902c78fc/roles/640bda0879494e60b72680ee505285f0 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:32:35.200586 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e81d8e-e6de-4d60-a633-a7b1359b317f None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:35.200878 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e81d8e-e6de-4d60-a633-a7b1359b317f None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:35.201154 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e81d8e-e6de-4d60-a633-a7b1359b317f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:35.221448 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-20e81d8e-e6de-4d60-a633-a7b1359b317f None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:32:35.222791 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-20e81d8e-e6de-4d60-a633-a7b1359b317f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:32:35.297807 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 68/137] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 24 05:32:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 05:32:35.338701 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e833126-f5aa-4b2d-99a8-09b582182a97 None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:32:35.388015 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa4a41e-9c75-4f21-bbec-6c0e02c1174b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:32:35.388669 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa4a41e-9c75-4f21-bbec-6c0e02c1174b None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:35.389258 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa4a41e-9c75-4f21-bbec-6c0e02c1174b None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:35.389542 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa4a41e-9c75-4f21-bbec-6c0e02c1174b None admin] PATH_INFO: `/v3/projects/f3919ce03c0d4a24a2c47e7b17d55a4e` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:35.390985 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa4a41e-9c75-4f21-bbec-6c0e02c1174b None admin] RBAC: Authorizing `identity:get_project(project_id=f3919ce03c0d4a24a2c47e7b17d55a4e)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:32:35.392446 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa4a41e-9c75-4f21-bbec-6c0e02c1174b None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:32:35.394137 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 70/138] 10.222.0.26 () {56 vars in 1186 bytes} [Wed Aug 24 05:32:35 2022] GET /identity/v3/projects/f3919ce03c0d4a24a2c47e7b17d55a4e => generated 312 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:32:35.400781 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e81d8e-e6de-4d60-a633-a7b1359b317f None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:32:35.414005 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:32:35.549136 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e81d8e-e6de-4d60-a633-a7b1359b317f None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:32:35.584688 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42d4254-2e77-41ab-abea-89d5368b0974 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:32:35.585357 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42d4254-2e77-41ab-abea-89d5368b0974 None admin] REQUEST_METHOD: `PUT` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:35.585639 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42d4254-2e77-41ab-abea-89d5368b0974 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:35.585914 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42d4254-2e77-41ab-abea-89d5368b0974 None admin] PATH_INFO: `/v3/projects/f3919ce03c0d4a24a2c47e7b17d55a4e/users/3f18e05ea2ca4efea2d541eedaad23e0/roles/f7aa4a2c74c94c1b9ca8ecdcccccda5c` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:35.587886 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42d4254-2e77-41ab-abea-89d5368b0974 None admin] RBAC: Authorizing `identity:create_grant(project_id=f3919ce03c0d4a24a2c47e7b17d55a4e, user_id=3f18e05ea2ca4efea2d541eedaad23e0, role_id=f7aa4a2c74c94c1b9ca8ecdcccccda5c)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:32:35.589340 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42d4254-2e77-41ab-abea-89d5368b0974 None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:32:35.614339 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 69/139] 10.222.0.26 () {58 vars in 1439 bytes} [Wed Aug 24 05:32:35 2022] PUT /identity/v3/projects/f3919ce03c0d4a24a2c47e7b17d55a4e/users/3f18e05ea2ca4efea2d541eedaad23e0/roles/f7aa4a2c74c94c1b9ca8ecdcccccda5c => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:32:35.831208 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa4a41e-9c75-4f21-bbec-6c0e02c1174b None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:32:35.919875 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:32:35.944564 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa4a41e-9c75-4f21-bbec-6c0e02c1174b None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:32:35.993137 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc49715-9325-4ad0-846b-458d67817754 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:32:35.993788 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc49715-9325-4ad0-846b-458d67817754 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:35.994094 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc49715-9325-4ad0-846b-458d67817754 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:35.994361 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc49715-9325-4ad0-846b-458d67817754 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:35.998811 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc49715-9325-4ad0-846b-458d67817754 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:32:36.000307 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc49715-9325-4ad0-846b-458d67817754 None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:32:36.002012 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 71/140] 10.222.0.26 () {56 vars in 1108 bytes} [Wed Aug 24 05:32:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:32:36.008491 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42d4254-2e77-41ab-abea-89d5368b0974 None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:32:36.108603 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:32:36.151151 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42d4254-2e77-41ab-abea-89d5368b0974 None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:32:36.192902 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc4a5ec-b988-47be-a10d-aa42af476cd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:32:36.194165 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc4a5ec-b988-47be-a10d-aa42af476cd2 None admin] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:36.194639 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc4a5ec-b988-47be-a10d-aa42af476cd2 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:36.195128 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc4a5ec-b988-47be-a10d-aa42af476cd2 None admin] PATH_INFO: `/v3/users` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:36.195966 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc4a5ec-b988-47be-a10d-aa42af476cd2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:32:36.197615 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc4a5ec-b988-47be-a10d-aa42af476cd2 None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:32:36.243621 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 70/141] 10.222.0.26 () {60 vars in 1132 bytes} [Wed Aug 24 05:32:36 2022] POST /identity/v3/users => generated 283 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:32:36.839046 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d82451-edd4-4c90-bda2-4dca56c37d13 None None] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:36.839520 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d82451-edd4-4c90-bda2-4dca56c37d13 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:36.839520 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d82451-edd4-4c90-bda2-4dca56c37d13 None None] PATH_INFO: `/` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:36.841103 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 72/142] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 24 05:32:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:32:36.846370 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324869e6-1865-4e31-a536-80bb9f99aa39 None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:36.846895 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324869e6-1865-4e31-a536-80bb9f99aa39 None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:36.847381 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324869e6-1865-4e31-a536-80bb9f99aa39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:36.875109 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-324869e6-1865-4e31-a536-80bb9f99aa39 None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:32:36.876605 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-324869e6-1865-4e31-a536-80bb9f99aa39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:32:36.968083 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 71/143] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 24 05:32:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 05:32:37.024896 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2345fa9-94cc-40f1-b8b5-ab5e613c234c None None] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:37.025206 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2345fa9-94cc-40f1-b8b5-ab5e613c234c None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:37.025458 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2345fa9-94cc-40f1-b8b5-ab5e613c234c None None] PATH_INFO: `/` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:37.027144 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 73/144] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 24 05:32:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:32:37.032453 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367b3c4c-9ace-4b4a-b0ff-3523a56ade7d None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:37.032892 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367b3c4c-9ace-4b4a-b0ff-3523a56ade7d None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:37.033072 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367b3c4c-9ace-4b4a-b0ff-3523a56ade7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:37.052578 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-367b3c4c-9ace-4b4a-b0ff-3523a56ade7d None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:32:37.053787 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-367b3c4c-9ace-4b4a-b0ff-3523a56ade7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:32:37.106209 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:32:37.134063 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 72/145] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 24 05:32:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 05:32:37.405543 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2345fa9-94cc-40f1-b8b5-ab5e613c234c None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:32:37.526923 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2345fa9-94cc-40f1-b8b5-ab5e613c234c None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:32:37.546760 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367b3c4c-9ace-4b4a-b0ff-3523a56ade7d None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:32:37.576152 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c6aa5a-559e-421a-971c-20c22f18fcf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:32:37.576805 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c6aa5a-559e-421a-971c-20c22f18fcf7 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:37.577087 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c6aa5a-559e-421a-971c-20c22f18fcf7 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:37.577362 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c6aa5a-559e-421a-971c-20c22f18fcf7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:37.595520 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c6aa5a-559e-421a-971c-20c22f18fcf7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:32:37.601007 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application [None req-c9c6aa5a-559e-421a-971c-20c22f18fcf7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 05:32:37.601007 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:32:37.601007 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:32:37.601007 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:32:37.601007 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:32:37.601007 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:32:37.601007 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:32:37.601007 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:32:37.601007 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:32:37.601007 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:32:37.601007 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:32:37.601007 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:32:37.601007 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:32:37.601007 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:32:37.601007 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:32:37.601007 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:32:37.601863 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:32:37.601863 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:32:37.601863 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:32:37.601863 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:32:37.601863 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:32:37.601863 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:32:37.601863 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:32:37.601863 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:32:37.601863 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:32:37.601863 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:32:37.601863 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:32:37.601863 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application with Lock( Aug 24 05:32:37.601863 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:32:37.601863 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:32:37.601863 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:32:37.601863 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:32:37.602739 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:32:37.602739 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:32:37.602739 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:32:37.602739 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:32:37.602739 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:32:37.602739 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:32:37.602739 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:32:37.602739 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:32:37.602739 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:32:37.602739 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:32:37.602739 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 05:32:37.602739 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Aug 24 05:32:37.604618 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 74/146] 10.222.0.26 () {56 vars in 1114 bytes} [Wed Aug 24 05:32:37 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:32:37.611317 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c6aa5a-559e-421a-971c-20c22f18fcf7 None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:32:37.624903 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:32:37.720741 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367b3c4c-9ace-4b4a-b0ff-3523a56ade7d None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:32:37.760221 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b121006-175a-491c-b508-e5b20bab49d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:32:37.760874 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b121006-175a-491c-b508-e5b20bab49d2 None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:37.761162 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b121006-175a-491c-b508-e5b20bab49d2 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:37.761441 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b121006-175a-491c-b508-e5b20bab49d2 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:37.773403 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b121006-175a-491c-b508-e5b20bab49d2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:32:37.780173 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application [None req-8b121006-175a-491c-b508-e5b20bab49d2 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 05:32:37.780173 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:32:37.780173 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:32:37.780173 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:32:37.780173 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:32:37.780173 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:32:37.780173 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:32:37.780173 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:32:37.780173 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:32:37.780173 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:32:37.780173 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:32:37.780173 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:32:37.780173 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:32:37.780173 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:32:37.780173 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:32:37.780173 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:32:37.781053 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:32:37.781053 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:32:37.781053 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:32:37.781053 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:32:37.781053 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:32:37.781053 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:32:37.781053 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:32:37.781053 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:32:37.781053 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:32:37.781053 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:32:37.781053 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:32:37.781053 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application with Lock( Aug 24 05:32:37.781053 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:32:37.781053 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:32:37.781053 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:32:37.781053 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:32:37.781825 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:32:37.781825 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:32:37.781825 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:32:37.781825 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:32:37.781825 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:32:37.781825 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:32:37.781825 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:32:37.781825 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:32:37.781825 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:32:37.781825 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:32:37.781825 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 05:32:37.781825 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Aug 24 05:32:37.786077 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 73/147] 10.222.0.26 () {56 vars in 1099 bytes} [Wed Aug 24 05:32:37 2022] GET /identity/v3/roles/reader => generated 84 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:32:37.787979 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fafe0d-9b33-42a5-8b78-912248484261 None None] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:37.788656 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fafe0d-9b33-42a5-8b78-912248484261 None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:37.788946 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fafe0d-9b33-42a5-8b78-912248484261 None None] PATH_INFO: `/` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:37.790563 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 74/148] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 24 05:32:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:32:37.791961 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fafe0d-9b33-42a5-8b78-912248484261 None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:32:37.815686 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c6aa5a-559e-421a-971c-20c22f18fcf7 None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:32:37.855185 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:32:37.883290 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27c2577-84eb-4d4e-84ad-42d4ac3d54e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:32:37.883964 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27c2577-84eb-4d4e-84ad-42d4ac3d54e4 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:37.884186 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27c2577-84eb-4d4e-84ad-42d4ac3d54e4 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:37.884461 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27c2577-84eb-4d4e-84ad-42d4ac3d54e4 None admin] PATH_INFO: `/v3/roles` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:37.885144 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27c2577-84eb-4d4e-84ad-42d4ac3d54e4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:32:37.885449 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27c2577-84eb-4d4e-84ad-42d4ac3d54e4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:32:37.886880 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27c2577-84eb-4d4e-84ad-42d4ac3d54e4 None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:32:37.901264 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 75/149] 10.222.0.26 () {56 vars in 1111 bytes} [Wed Aug 24 05:32:37 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:32:37.906684 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fb8c9b-ea4f-4109-bc19-77d7860b9bd2 None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:37.906973 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fb8c9b-ea4f-4109-bc19-77d7860b9bd2 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:37.907248 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fb8c9b-ea4f-4109-bc19-77d7860b9bd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:37.909486 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fafe0d-9b33-42a5-8b78-912248484261 None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:32:37.935688 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-17fb8c9b-ea4f-4109-bc19-77d7860b9bd2 None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:32:37.936904 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-17fb8c9b-ea4f-4109-bc19-77d7860b9bd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:32:37.947199 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930b952f-07f7-4b2e-863e-07480b241fc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:32:37.947823 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930b952f-07f7-4b2e-863e-07480b241fc8 None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:37.948210 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930b952f-07f7-4b2e-863e-07480b241fc8 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:37.948496 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930b952f-07f7-4b2e-863e-07480b241fc8 None admin] PATH_INFO: `/v3/roles` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:37.949184 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930b952f-07f7-4b2e-863e-07480b241fc8 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:32:37.949488 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930b952f-07f7-4b2e-863e-07480b241fc8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:32:37.951044 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930b952f-07f7-4b2e-863e-07480b241fc8 None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:32:37.961030 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 75/150] 10.222.0.26 () {56 vars in 1101 bytes} [Wed Aug 24 05:32:37 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:32:37.961711 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930b952f-07f7-4b2e-863e-07480b241fc8 None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:32:38.057534 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:32:38.066681 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 76/151] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 24 05:32:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 05:32:38.069241 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fb8c9b-ea4f-4109-bc19-77d7860b9bd2 None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:32:38.139224 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930b952f-07f7-4b2e-863e-07480b241fc8 None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:32:38.143831 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:32:38.197536 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f6f155-42e9-4db1-a4eb-212a1a55fa0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:32:38.198212 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f6f155-42e9-4db1-a4eb-212a1a55fa0b None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:38.198502 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f6f155-42e9-4db1-a4eb-212a1a55fa0b None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:38.198791 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f6f155-42e9-4db1-a4eb-212a1a55fa0b None admin] PATH_INFO: `/v3/users/3f18e05ea2ca4efea2d541eedaad23e0` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:38.201050 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f6f155-42e9-4db1-a4eb-212a1a55fa0b None admin] RBAC: Authorizing `identity:get_user(user_id=3f18e05ea2ca4efea2d541eedaad23e0)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:32:38.202734 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f6f155-42e9-4db1-a4eb-212a1a55fa0b None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:32:38.204482 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 76/152] 10.222.0.26 () {56 vars in 1177 bytes} [Wed Aug 24 05:32:37 2022] GET /identity/v3/users/3f18e05ea2ca4efea2d541eedaad23e0 => generated 275 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:32:38.210568 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f6f155-42e9-4db1-a4eb-212a1a55fa0b None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:32:38.293684 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fb8c9b-ea4f-4109-bc19-77d7860b9bd2 None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:32:38.352923 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f6f155-42e9-4db1-a4eb-212a1a55fa0b None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:32:38.384995 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e3f492-3b0b-4c75-aca6-d6f30d30f900 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:32:38.385656 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e3f492-3b0b-4c75-aca6-d6f30d30f900 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:38.385965 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e3f492-3b0b-4c75-aca6-d6f30d30f900 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:38.386241 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e3f492-3b0b-4c75-aca6-d6f30d30f900 None admin] PATH_INFO: `/v3/users/4741d05f701246fe9bc52f7dabbfde5f` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:38.387421 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e3f492-3b0b-4c75-aca6-d6f30d30f900 None admin] RBAC: Authorizing `identity:get_user(user_id=4741d05f701246fe9bc52f7dabbfde5f)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:32:38.388902 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e3f492-3b0b-4c75-aca6-d6f30d30f900 None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:32:38.394749 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 77/153] 10.222.0.26 () {56 vars in 1177 bytes} [Wed Aug 24 05:32:38 2022] GET /identity/v3/users/4741d05f701246fe9bc52f7dabbfde5f => generated 289 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:32:38.401135 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e3f492-3b0b-4c75-aca6-d6f30d30f900 None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:32:38.403308 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba140634-da46-4c63-9d7e-b34e62835f3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:32:38.404103 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba140634-da46-4c63-9d7e-b34e62835f3e None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:38.404400 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba140634-da46-4c63-9d7e-b34e62835f3e None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:38.404728 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba140634-da46-4c63-9d7e-b34e62835f3e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:38.460167 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:32:38.502399 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba140634-da46-4c63-9d7e-b34e62835f3e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:32:38.503918 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba140634-da46-4c63-9d7e-b34e62835f3e None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:32:38.590454 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:32:38.682385 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e3f492-3b0b-4c75-aca6-d6f30d30f900 None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:32:38.706021 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 77/154] 10.222.0.26 () {58 vars in 1282 bytes} [Wed Aug 24 05:32:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 496 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 24 05:32:38.707970 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523076f3-91c4-4528-aae6-63c6c3442f45 None None] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:38.708455 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523076f3-91c4-4528-aae6-63c6c3442f45 None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:38.708946 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523076f3-91c4-4528-aae6-63c6c3442f45 None None] PATH_INFO: `/` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:38.710427 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 78/155] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 24 05:32:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:32:38.711604 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523076f3-91c4-4528-aae6-63c6c3442f45 None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:32:38.768763 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde961e4-befe-4d97-b8f0-8fa8036ce72b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:32:38.769411 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde961e4-befe-4d97-b8f0-8fa8036ce72b None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:38.769694 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde961e4-befe-4d97-b8f0-8fa8036ce72b None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:38.770034 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde961e4-befe-4d97-b8f0-8fa8036ce72b None admin] PATH_INFO: `/v3/projects/d4bde08b78fc4447a53a2928b2d22185` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:38.771185 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde961e4-befe-4d97-b8f0-8fa8036ce72b None admin] RBAC: Authorizing `identity:get_project(project_id=d4bde08b78fc4447a53a2928b2d22185)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:32:38.772643 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde961e4-befe-4d97-b8f0-8fa8036ce72b None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:32:38.774344 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 78/156] 10.222.0.26 () {56 vars in 1186 bytes} [Wed Aug 24 05:32:38 2022] GET /identity/v3/projects/d4bde08b78fc4447a53a2928b2d22185 => generated 298 bytes in 374 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:32:38.775111 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde961e4-befe-4d97-b8f0-8fa8036ce72b None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:32:38.802070 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:32:38.840954 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523076f3-91c4-4528-aae6-63c6c3442f45 None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:32:38.877144 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32a95bd-e96e-416b-92bb-5c9406e985c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:32:38.878182 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32a95bd-e96e-416b-92bb-5c9406e985c1 None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:38.878656 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32a95bd-e96e-416b-92bb-5c9406e985c1 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:38.879132 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32a95bd-e96e-416b-92bb-5c9406e985c1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:38.897129 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32a95bd-e96e-416b-92bb-5c9406e985c1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:32:38.902269 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application [None req-f32a95bd-e96e-416b-92bb-5c9406e985c1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 05:32:38.902269 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:32:38.902269 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:32:38.902269 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:32:38.902269 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:32:38.902269 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:32:38.902269 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:32:38.902269 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:32:38.902269 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:32:38.902269 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:32:38.902269 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:32:38.902269 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:32:38.902269 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:32:38.902269 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:32:38.902269 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:32:38.902269 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:32:38.903241 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:32:38.903241 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:32:38.903241 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:32:38.903241 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:32:38.903241 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:32:38.903241 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:32:38.903241 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:32:38.903241 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:32:38.903241 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:32:38.903241 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:32:38.903241 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:32:38.903241 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application with Lock( Aug 24 05:32:38.903241 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:32:38.903241 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:32:38.903241 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:32:38.903241 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:32:38.904145 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:32:38.904145 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:32:38.904145 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:32:38.904145 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:32:38.904145 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:32:38.904145 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:32:38.904145 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:32:38.904145 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:32:38.904145 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:32:38.904145 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:32:38.904145 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 05:32:38.904145 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Aug 24 05:32:38.914253 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 79/157] 10.222.0.26 () {56 vars in 1099 bytes} [Wed Aug 24 05:32:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:32:38.916564 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb99e4c-2528-47f6-baf3-de6cc5f55a02 None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:38.917797 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb99e4c-2528-47f6-baf3-de6cc5f55a02 None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:38.918488 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb99e4c-2528-47f6-baf3-de6cc5f55a02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:38.934492 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde961e4-befe-4d97-b8f0-8fa8036ce72b None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:32:38.961058 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-7fb99e4c-2528-47f6-baf3-de6cc5f55a02 None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:32:38.962633 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-7fb99e4c-2528-47f6-baf3-de6cc5f55a02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:32:38.981360 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dce8b1e-eaf6-46ff-8fad-7055553dfebb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:32:38.982384 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dce8b1e-eaf6-46ff-8fad-7055553dfebb None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:38.985027 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dce8b1e-eaf6-46ff-8fad-7055553dfebb None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:38.986669 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dce8b1e-eaf6-46ff-8fad-7055553dfebb None admin] PATH_INFO: `/v3/projects/d4bde08b78fc4447a53a2928b2d22185` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:38.989402 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dce8b1e-eaf6-46ff-8fad-7055553dfebb None admin] RBAC: Authorizing `identity:get_project(project_id=d4bde08b78fc4447a53a2928b2d22185)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:32:38.991714 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dce8b1e-eaf6-46ff-8fad-7055553dfebb None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:32:38.994085 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 79/158] 10.222.0.26 () {56 vars in 1186 bytes} [Wed Aug 24 05:32:38 2022] GET /identity/v3/projects/d4bde08b78fc4447a53a2928b2d22185 => generated 298 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:32:38.995825 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6118541-dd7e-41c9-b1cf-67ff37ae7ec1 None None] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:38.996111 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6118541-dd7e-41c9-b1cf-67ff37ae7ec1 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:38.996432 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6118541-dd7e-41c9-b1cf-67ff37ae7ec1 None None] PATH_INFO: `/` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:38.997640 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 80/159] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 24 05:32:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:32:39.002614 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6118541-dd7e-41c9-b1cf-67ff37ae7ec1 None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:32:39.007281 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:32:39.050583 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 80/160] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 24 05:32:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 05:32:39.052616 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb99e4c-2528-47f6-baf3-de6cc5f55a02 None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:32:39.142388 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:32:39.163396 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb99e4c-2528-47f6-baf3-de6cc5f55a02 None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:32:39.200586 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f1b6cc-d66c-41af-b549-95112c586317 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:32:39.201587 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f1b6cc-d66c-41af-b549-95112c586317 None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:39.202256 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f1b6cc-d66c-41af-b549-95112c586317 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:39.202727 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f1b6cc-d66c-41af-b549-95112c586317 None admin] PATH_INFO: `/v3/roles` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:39.203583 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f1b6cc-d66c-41af-b549-95112c586317 None admin] RBAC: Adding query filter params (name=member) {{(pid=88112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:32:39.204075 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f1b6cc-d66c-41af-b549-95112c586317 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:32:39.205653 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f1b6cc-d66c-41af-b549-95112c586317 None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:32:39.214914 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 81/161] 10.222.0.26 () {56 vars in 1101 bytes} [Wed Aug 24 05:32:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:32:39.215922 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f1b6cc-d66c-41af-b549-95112c586317 None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:32:39.330421 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f1b6cc-d66c-41af-b549-95112c586317 None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:32:39.358338 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:32:39.362615 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6118541-dd7e-41c9-b1cf-67ff37ae7ec1 None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:32:39.368923 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb970e9-d811-4b8c-8ecd-61f7783fbc39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:32:39.369795 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb970e9-d811-4b8c-8ecd-61f7783fbc39 None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:39.370292 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb970e9-d811-4b8c-8ecd-61f7783fbc39 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:39.370756 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb970e9-d811-4b8c-8ecd-61f7783fbc39 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:39.371739 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb970e9-d811-4b8c-8ecd-61f7783fbc39 None admin] RBAC: Adding query filter params (role.id=109c3556f4644bd291e81b0aa7fe2598, scope.project.id=d4bde08b78fc4447a53a2928b2d22185, user.id=3f18e05ea2ca4efea2d541eedaad23e0) {{(pid=88112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:32:39.372703 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb970e9-d811-4b8c-8ecd-61f7783fbc39 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:32:39.374472 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb970e9-d811-4b8c-8ecd-61f7783fbc39 None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:32:39.381418 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 82/162] 10.222.0.26 () {56 vars in 1374 bytes} [Wed Aug 24 05:32:39 2022] GET /identity/v3/role_assignments?user.id=3f18e05ea2ca4efea2d541eedaad23e0&scope.project.id=d4bde08b78fc4447a53a2928b2d22185&role.id=109c3556f4644bd291e81b0aa7fe2598 => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:32:39.383256 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69792a64-2291-4936-9763-269adfd8b934 None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:39.383806 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69792a64-2291-4936-9763-269adfd8b934 None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:39.384271 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69792a64-2291-4936-9763-269adfd8b934 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:39.415151 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-69792a64-2291-4936-9763-269adfd8b934 None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:32:39.416754 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-69792a64-2291-4936-9763-269adfd8b934 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:32:39.505995 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 83/163] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 24 05:32:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 05:32:39.507275 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69792a64-2291-4936-9763-269adfd8b934 None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:32:39.507732 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d8de9c-bc05-41e7-829a-13192d9db60f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:32:39.508840 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d8de9c-bc05-41e7-829a-13192d9db60f None admin] REQUEST_METHOD: `PUT` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:39.509123 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d8de9c-bc05-41e7-829a-13192d9db60f None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:39.509398 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d8de9c-bc05-41e7-829a-13192d9db60f None admin] PATH_INFO: `/v3/projects/d4bde08b78fc4447a53a2928b2d22185/users/4741d05f701246fe9bc52f7dabbfde5f/roles/129798c59b2c43978b555869931dada4` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:39.518721 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d8de9c-bc05-41e7-829a-13192d9db60f None admin] RBAC: Authorizing `identity:create_grant(project_id=d4bde08b78fc4447a53a2928b2d22185, user_id=4741d05f701246fe9bc52f7dabbfde5f, role_id=129798c59b2c43978b555869931dada4)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:32:39.520707 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d8de9c-bc05-41e7-829a-13192d9db60f None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:32:39.558009 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 81/164] 10.222.0.26 () {58 vars in 1439 bytes} [Wed Aug 24 05:32:38 2022] PUT /identity/v3/projects/d4bde08b78fc4447a53a2928b2d22185/users/4741d05f701246fe9bc52f7dabbfde5f/roles/129798c59b2c43978b555869931dada4 => generated 0 bytes in 556 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:32:39.641501 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d8de9c-bc05-41e7-829a-13192d9db60f None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:32:39.663093 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69792a64-2291-4936-9763-269adfd8b934 None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:32:39.698067 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:32:39.709832 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6950e669-51bf-4cad-b31c-5e9465d13ba8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:32:39.710516 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6950e669-51bf-4cad-b31c-5e9465d13ba8 None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:39.711938 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6950e669-51bf-4cad-b31c-5e9465d13ba8 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:39.712987 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6950e669-51bf-4cad-b31c-5e9465d13ba8 None admin] PATH_INFO: `/v3/users/3f18e05ea2ca4efea2d541eedaad23e0` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:39.715020 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6950e669-51bf-4cad-b31c-5e9465d13ba8 None admin] RBAC: Authorizing `identity:get_user(user_id=3f18e05ea2ca4efea2d541eedaad23e0)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:32:39.716511 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6950e669-51bf-4cad-b31c-5e9465d13ba8 None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:32:39.718521 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 84/165] 10.222.0.26 () {56 vars in 1177 bytes} [Wed Aug 24 05:32:39 2022] GET /identity/v3/users/3f18e05ea2ca4efea2d541eedaad23e0 => generated 275 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:32:39.737741 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6950e669-51bf-4cad-b31c-5e9465d13ba8 None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:32:39.786108 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:32:39.893911 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6950e669-51bf-4cad-b31c-5e9465d13ba8 None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:32:39.900110 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d8de9c-bc05-41e7-829a-13192d9db60f None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:32:39.935359 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bff9836-595e-477c-a4bf-b64aba8e7afd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:32:39.936054 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bff9836-595e-477c-a4bf-b64aba8e7afd None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:39.936339 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bff9836-595e-477c-a4bf-b64aba8e7afd None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:39.936611 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bff9836-595e-477c-a4bf-b64aba8e7afd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:39.983271 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e97d3b-6f3d-44f5-8cc5-ee25eb4fdf08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:32:39.983934 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e97d3b-6f3d-44f5-8cc5-ee25eb4fdf08 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:39.984218 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e97d3b-6f3d-44f5-8cc5-ee25eb4fdf08 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:39.984495 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e97d3b-6f3d-44f5-8cc5-ee25eb4fdf08 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:40.007467 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:32:40.015722 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e97d3b-6f3d-44f5-8cc5-ee25eb4fdf08 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:32:40.022374 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bff9836-595e-477c-a4bf-b64aba8e7afd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:32:40.023856 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bff9836-595e-477c-a4bf-b64aba8e7afd None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:32:40.025641 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application [None req-f7e97d3b-6f3d-44f5-8cc5-ee25eb4fdf08 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 05:32:40.025641 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:32:40.025641 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:32:40.025641 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:32:40.025641 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:32:40.025641 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:32:40.025641 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:32:40.025641 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:32:40.025641 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:32:40.025641 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:32:40.025641 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:32:40.025641 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:32:40.025641 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:32:40.025641 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:32:40.025641 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:32:40.025641 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:32:40.026574 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:32:40.026574 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:32:40.026574 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:32:40.026574 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:32:40.026574 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:32:40.026574 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:32:40.026574 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:32:40.026574 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:32:40.026574 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:32:40.026574 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:32:40.026574 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:32:40.026574 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application with Lock( Aug 24 05:32:40.026574 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:32:40.026574 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:32:40.026574 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:32:40.026574 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:32:40.027645 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:32:40.027645 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:32:40.027645 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:32:40.027645 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:32:40.027645 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:32:40.027645 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:32:40.027645 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:32:40.027645 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:32:40.027645 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:32:40.027645 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:32:40.027645 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 05:32:40.027645 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Aug 24 05:32:40.029856 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 82/166] 10.222.0.26 () {56 vars in 1096 bytes} [Wed Aug 24 05:32:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 389 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:32:40.034581 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e97d3b-6f3d-44f5-8cc5-ee25eb4fdf08 None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:32:40.224890 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e97d3b-6f3d-44f5-8cc5-ee25eb4fdf08 None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:32:40.252732 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 85/167] 10.222.0.26 () {58 vars in 1282 bytes} [Wed Aug 24 05:32:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 516 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 24 05:32:40.254318 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bff9836-595e-477c-a4bf-b64aba8e7afd None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:32:40.278455 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:32:40.303743 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4076ab8c-3392-49a6-a98e-5de21dcc8421 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:32:40.304374 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4076ab8c-3392-49a6-a98e-5de21dcc8421 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:40.304652 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4076ab8c-3392-49a6-a98e-5de21dcc8421 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:40.304924 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4076ab8c-3392-49a6-a98e-5de21dcc8421 None admin] PATH_INFO: `/v3/roles` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:40.305609 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4076ab8c-3392-49a6-a98e-5de21dcc8421 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:32:40.305914 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4076ab8c-3392-49a6-a98e-5de21dcc8421 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:32:40.307345 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4076ab8c-3392-49a6-a98e-5de21dcc8421 None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:32:40.339132 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 83/168] 10.222.0.26 () {56 vars in 1099 bytes} [Wed Aug 24 05:32:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:32:40.340041 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4076ab8c-3392-49a6-a98e-5de21dcc8421 None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:32:40.409742 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:32:40.437880 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bff9836-595e-477c-a4bf-b64aba8e7afd None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:32:40.493675 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38616f5-f4ab-4e8b-8596-e896da4a8222 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:32:40.494686 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38616f5-f4ab-4e8b-8596-e896da4a8222 None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:40.496000 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38616f5-f4ab-4e8b-8596-e896da4a8222 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:40.496648 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38616f5-f4ab-4e8b-8596-e896da4a8222 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:40.517889 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38616f5-f4ab-4e8b-8596-e896da4a8222 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:32:40.524623 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application [None req-d38616f5-f4ab-4e8b-8596-e896da4a8222 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 05:32:40.524623 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:32:40.524623 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:32:40.524623 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:32:40.524623 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:32:40.524623 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:32:40.524623 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:32:40.524623 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:32:40.524623 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:32:40.524623 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:32:40.524623 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:32:40.524623 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:32:40.524623 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:32:40.524623 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:32:40.524623 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:32:40.524623 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:32:40.525630 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:32:40.525630 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:32:40.525630 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:32:40.525630 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:32:40.525630 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:32:40.525630 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:32:40.525630 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:32:40.525630 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:32:40.525630 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:32:40.525630 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:32:40.525630 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:32:40.525630 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application with Lock( Aug 24 05:32:40.525630 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:32:40.525630 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:32:40.525630 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:32:40.525630 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:32:40.526480 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:32:40.526480 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:32:40.526480 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:32:40.526480 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:32:40.526480 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:32:40.526480 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:32:40.526480 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:32:40.526480 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:32:40.526480 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:32:40.526480 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:32:40.526480 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 05:32:40.526480 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Aug 24 05:32:40.528822 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 86/169] 10.222.0.26 () {56 vars in 1099 bytes} [Wed Aug 24 05:32:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:32:40.534352 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d57453-905e-406d-a8fa-0535034e3ca5 None None] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:40.534889 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d57453-905e-406d-a8fa-0535034e3ca5 None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:40.535406 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d57453-905e-406d-a8fa-0535034e3ca5 None None] PATH_INFO: `/` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:40.538203 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 87/170] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 24 05:32:40 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:32:40.539802 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d57453-905e-406d-a8fa-0535034e3ca5 None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:32:40.544780 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4076ab8c-3392-49a6-a98e-5de21dcc8421 None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:32:40.615612 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9e4162-1e02-4ddf-b8eb-8622935c4dbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:32:40.616254 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9e4162-1e02-4ddf-b8eb-8622935c4dbc None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:40.616531 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9e4162-1e02-4ddf-b8eb-8622935c4dbc None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:40.616798 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9e4162-1e02-4ddf-b8eb-8622935c4dbc None admin] PATH_INFO: `/v3/projects/d4bde08b78fc4447a53a2928b2d22185` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:40.622691 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9e4162-1e02-4ddf-b8eb-8622935c4dbc None admin] RBAC: Authorizing `identity:get_project(project_id=d4bde08b78fc4447a53a2928b2d22185)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:32:40.624168 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9e4162-1e02-4ddf-b8eb-8622935c4dbc None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:32:40.626173 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 84/171] 10.222.0.26 () {56 vars in 1186 bytes} [Wed Aug 24 05:32:40 2022] GET /identity/v3/projects/d4bde08b78fc4447a53a2928b2d22185 => generated 298 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:32:40.627336 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d6d75b-a1a7-4b50-8b20-d6970ee7904c None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:40.627615 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d6d75b-a1a7-4b50-8b20-d6970ee7904c None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:40.627874 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d6d75b-a1a7-4b50-8b20-d6970ee7904c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:40.657574 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-25d6d75b-a1a7-4b50-8b20-d6970ee7904c None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:32:40.658829 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-25d6d75b-a1a7-4b50-8b20-d6970ee7904c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:32:40.698545 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d57453-905e-406d-a8fa-0535034e3ca5 None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:32:40.725973 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:32:40.756990 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 85/172] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 24 05:32:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 05:32:40.757776 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d6d75b-a1a7-4b50-8b20-d6970ee7904c None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:32:40.765751 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0475bfeb-bda2-4a4e-a560-b3f1320649d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:32:40.766418 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0475bfeb-bda2-4a4e-a560-b3f1320649d8 None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:40.766692 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0475bfeb-bda2-4a4e-a560-b3f1320649d8 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:40.766965 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0475bfeb-bda2-4a4e-a560-b3f1320649d8 None admin] PATH_INFO: `/v3/users/f35a18a67d5646f5b515c46f902c78fc` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:40.773364 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0475bfeb-bda2-4a4e-a560-b3f1320649d8 None admin] RBAC: Authorizing `identity:get_user(user_id=f35a18a67d5646f5b515c46f902c78fc)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:32:40.774851 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0475bfeb-bda2-4a4e-a560-b3f1320649d8 None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:32:40.776616 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 88/173] 10.222.0.26 () {56 vars in 1177 bytes} [Wed Aug 24 05:32:40 2022] GET /identity/v3/users/f35a18a67d5646f5b515c46f902c78fc => generated 247 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:32:40.777206 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0475bfeb-bda2-4a4e-a560-b3f1320649d8 None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:32:40.810650 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:32:40.922637 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d6d75b-a1a7-4b50-8b20-d6970ee7904c None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:32:40.931630 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0475bfeb-bda2-4a4e-a560-b3f1320649d8 None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:32:40.990315 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3564355-58bf-4c72-848d-c974eb66f261 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:32:40.991202 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3564355-58bf-4c72-848d-c974eb66f261 None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:40.991631 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3564355-58bf-4c72-848d-c974eb66f261 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:40.992683 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3564355-58bf-4c72-848d-c974eb66f261 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:40.993565 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3564355-58bf-4c72-848d-c974eb66f261 None admin] RBAC: Adding query filter params (role.id=f7aa4a2c74c94c1b9ca8ecdcccccda5c, scope.project.id=d4bde08b78fc4447a53a2928b2d22185, user.id=3f18e05ea2ca4efea2d541eedaad23e0) {{(pid=88112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:32:40.994306 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3564355-58bf-4c72-848d-c974eb66f261 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:32:40.996757 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3564355-58bf-4c72-848d-c974eb66f261 None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:32:41.003927 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ec1df1-6e94-4442-90d4-672e23fd9410 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:32:41.005090 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ec1df1-6e94-4442-90d4-672e23fd9410 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:41.005510 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ec1df1-6e94-4442-90d4-672e23fd9410 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:41.005936 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ec1df1-6e94-4442-90d4-672e23fd9410 None admin] PATH_INFO: `/v3/roles` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:41.006762 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ec1df1-6e94-4442-90d4-672e23fd9410 None admin] RBAC: Adding query filter params (name=member) {{(pid=88113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:32:41.007272 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ec1df1-6e94-4442-90d4-672e23fd9410 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:32:41.010465 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ec1df1-6e94-4442-90d4-672e23fd9410 None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:32:41.011616 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 89/174] 10.222.0.26 () {56 vars in 1374 bytes} [Wed Aug 24 05:32:40 2022] GET /identity/v3/role_assignments?user.id=3f18e05ea2ca4efea2d541eedaad23e0&scope.project.id=d4bde08b78fc4447a53a2928b2d22185&role.id=f7aa4a2c74c94c1b9ca8ecdcccccda5c => generated 608 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:32:41.014202 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3564355-58bf-4c72-848d-c974eb66f261 None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:32:41.025715 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 86/175] 10.222.0.26 () {56 vars in 1101 bytes} [Wed Aug 24 05:32:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:32:41.027034 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962afb5e-a0b6-43bc-99ff-d0729718d7f5 None None] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:41.027318 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962afb5e-a0b6-43bc-99ff-d0729718d7f5 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:41.027592 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962afb5e-a0b6-43bc-99ff-d0729718d7f5 None None] PATH_INFO: `/` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:41.029081 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 87/176] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 24 05:32:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:32:41.035032 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962afb5e-a0b6-43bc-99ff-d0729718d7f5 None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:32:41.119086 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:32:41.139098 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3564355-58bf-4c72-848d-c974eb66f261 None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:32:41.161969 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:32:41.196201 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29aa26c-c68b-4dc2-9305-c99658cb3856 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:32:41.197477 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29aa26c-c68b-4dc2-9305-c99658cb3856 None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:41.197937 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29aa26c-c68b-4dc2-9305-c99658cb3856 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:41.198726 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29aa26c-c68b-4dc2-9305-c99658cb3856 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:41.226305 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962afb5e-a0b6-43bc-99ff-d0729718d7f5 None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:32:41.274325 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5a53f4-7b1e-4f03-9b4f-e84c1f91b2fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:32:41.275013 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5a53f4-7b1e-4f03-9b4f-e84c1f91b2fc None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:41.275296 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5a53f4-7b1e-4f03-9b4f-e84c1f91b2fc None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:41.275623 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5a53f4-7b1e-4f03-9b4f-e84c1f91b2fc None admin] PATH_INFO: `/v3/users/3f18e05ea2ca4efea2d541eedaad23e0` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:41.276765 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5a53f4-7b1e-4f03-9b4f-e84c1f91b2fc None admin] RBAC: Authorizing `identity:get_user(user_id=3f18e05ea2ca4efea2d541eedaad23e0)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:32:41.278884 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5a53f4-7b1e-4f03-9b4f-e84c1f91b2fc None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:32:41.280001 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 88/177] 10.222.0.26 () {56 vars in 1177 bytes} [Wed Aug 24 05:32:41 2022] GET /identity/v3/users/3f18e05ea2ca4efea2d541eedaad23e0 => generated 275 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:32:41.280961 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04431db-3c3b-4b38-add0-23f9a383e813 None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:41.281245 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04431db-3c3b-4b38-add0-23f9a383e813 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:41.281523 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04431db-3c3b-4b38-add0-23f9a383e813 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:41.299907 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29aa26c-c68b-4dc2-9305-c99658cb3856 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:32:41.301661 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29aa26c-c68b-4dc2-9305-c99658cb3856 None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:32:41.308090 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-a04431db-3c3b-4b38-add0-23f9a383e813 None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:32:41.309997 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-a04431db-3c3b-4b38-add0-23f9a383e813 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:32:41.388382 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 89/178] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 24 05:32:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 05:32:41.389628 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ef101a-62a9-4087-8b57-64b5fb6b762f None None] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:41.389907 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ef101a-62a9-4087-8b57-64b5fb6b762f None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:41.390227 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ef101a-62a9-4087-8b57-64b5fb6b762f None None] PATH_INFO: `/` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:41.391722 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 90/179] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 24 05:32:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:32:41.392254 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ef101a-62a9-4087-8b57-64b5fb6b762f None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:32:41.405692 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:32:41.430226 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 90/180] 10.222.0.26 () {58 vars in 1282 bytes} [Wed Aug 24 05:32:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 05:32:41.431203 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29aa26c-c68b-4dc2-9305-c99658cb3856 None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:32:41.446075 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:32:41.503865 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ef101a-62a9-4087-8b57-64b5fb6b762f None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:32:41.540841 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29aa26c-c68b-4dc2-9305-c99658cb3856 None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:32:41.542063 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a692fa-4b63-4796-8378-2b96449632ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:32:41.542921 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a692fa-4b63-4796-8378-2b96449632ea None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:41.543259 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a692fa-4b63-4796-8378-2b96449632ea None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:41.544409 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a692fa-4b63-4796-8378-2b96449632ea None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:41.556441 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a692fa-4b63-4796-8378-2b96449632ea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:32:41.562294 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application [None req-43a692fa-4b63-4796-8378-2b96449632ea None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 05:32:41.562294 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:32:41.562294 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:32:41.562294 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:32:41.562294 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:32:41.562294 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:32:41.562294 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:32:41.562294 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:32:41.562294 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:32:41.562294 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:32:41.562294 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:32:41.562294 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:32:41.562294 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:32:41.562294 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:32:41.562294 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:32:41.562294 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:32:41.563330 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:32:41.563330 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:32:41.563330 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:32:41.563330 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:32:41.563330 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:32:41.563330 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:32:41.563330 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:32:41.563330 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:32:41.563330 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:32:41.563330 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:32:41.563330 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:32:41.563330 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application with Lock( Aug 24 05:32:41.563330 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:32:41.563330 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:32:41.563330 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:32:41.563330 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:32:41.564307 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:32:41.564307 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:32:41.564307 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:32:41.564307 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:32:41.564307 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:32:41.564307 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:32:41.564307 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:32:41.564307 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:32:41.564307 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:32:41.564307 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:32:41.564307 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 05:32:41.564307 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Aug 24 05:32:41.564307 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 91/181] 10.222.0.26 () {56 vars in 1096 bytes} [Wed Aug 24 05:32:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:32:41.565127 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2227da0d-b66c-44ec-8e32-c4779b12b6b1 None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:41.565220 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2227da0d-b66c-44ec-8e32-c4779b12b6b1 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:41.565560 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2227da0d-b66c-44ec-8e32-c4779b12b6b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:41.581482 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d27d20f-8a99-4600-8f93-d330a4bc2ed6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:32:41.582887 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d27d20f-8a99-4600-8f93-d330a4bc2ed6 None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:41.583309 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d27d20f-8a99-4600-8f93-d330a4bc2ed6 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:41.583680 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d27d20f-8a99-4600-8f93-d330a4bc2ed6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:41.587311 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-2227da0d-b66c-44ec-8e32-c4779b12b6b1 None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:32:41.589240 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-2227da0d-b66c-44ec-8e32-c4779b12b6b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:32:41.638351 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:32:41.665235 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d27d20f-8a99-4600-8f93-d330a4bc2ed6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:32:41.666763 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d27d20f-8a99-4600-8f93-d330a4bc2ed6 None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:32:41.683968 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 92/182] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 24 05:32:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 05:32:41.685158 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2227da0d-b66c-44ec-8e32-c4779b12b6b1 None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:32:41.721981 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:32:41.784602 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 91/183] 10.222.0.26 () {58 vars in 1282 bytes} [Wed Aug 24 05:32:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 05:32:41.786497 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d27d20f-8a99-4600-8f93-d330a4bc2ed6 None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:32:41.807707 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2227da0d-b66c-44ec-8e32-c4779b12b6b1 None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:32:41.851237 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b982666c-10c2-4813-b33c-ec82d8aa7ad7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:32:41.852244 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b982666c-10c2-4813-b33c-ec82d8aa7ad7 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:41.852587 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b982666c-10c2-4813-b33c-ec82d8aa7ad7 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:41.852926 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b982666c-10c2-4813-b33c-ec82d8aa7ad7 None admin] PATH_INFO: `/v3/projects/d4bde08b78fc4447a53a2928b2d22185` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:41.854289 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b982666c-10c2-4813-b33c-ec82d8aa7ad7 None admin] RBAC: Authorizing `identity:get_project(project_id=d4bde08b78fc4447a53a2928b2d22185)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:32:41.856389 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b982666c-10c2-4813-b33c-ec82d8aa7ad7 None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:32:41.858270 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 93/184] 10.222.0.26 () {56 vars in 1186 bytes} [Wed Aug 24 05:32:41 2022] GET /identity/v3/projects/d4bde08b78fc4447a53a2928b2d22185 => generated 298 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:32:41.862502 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b982666c-10c2-4813-b33c-ec82d8aa7ad7 None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:32:41.886390 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:32:41.916870 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d27d20f-8a99-4600-8f93-d330a4bc2ed6 None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:32:41.967841 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa45c31-3a9a-46fd-85b4-04ad5eee8830 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:32:41.968457 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa45c31-3a9a-46fd-85b4-04ad5eee8830 None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:41.968991 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa45c31-3a9a-46fd-85b4-04ad5eee8830 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:41.969267 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa45c31-3a9a-46fd-85b4-04ad5eee8830 None admin] PATH_INFO: `/v3/roles` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:41.970219 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa45c31-3a9a-46fd-85b4-04ad5eee8830 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:32:41.970553 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa45c31-3a9a-46fd-85b4-04ad5eee8830 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:32:41.972566 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa45c31-3a9a-46fd-85b4-04ad5eee8830 None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:32:41.974789 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:32:41.977875 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b982666c-10c2-4813-b33c-ec82d8aa7ad7 None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:32:41.984207 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 92/185] 10.222.0.26 () {56 vars in 1099 bytes} [Wed Aug 24 05:32:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:32:41.984850 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa45c31-3a9a-46fd-85b4-04ad5eee8830 None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:32:42.015362 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a9e8a0-a7c9-4764-9672-7a7b32003726 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:32:42.016079 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a9e8a0-a7c9-4764-9672-7a7b32003726 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:42.016364 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a9e8a0-a7c9-4764-9672-7a7b32003726 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:42.016635 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a9e8a0-a7c9-4764-9672-7a7b32003726 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:42.028548 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a9e8a0-a7c9-4764-9672-7a7b32003726 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:32:42.033323 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application [None req-83a9e8a0-a7c9-4764-9672-7a7b32003726 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 05:32:42.033323 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:32:42.033323 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:32:42.033323 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:32:42.033323 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:32:42.033323 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:32:42.033323 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:32:42.033323 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:32:42.033323 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:32:42.033323 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:32:42.033323 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:32:42.033323 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:32:42.033323 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:32:42.033323 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:32:42.033323 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:32:42.033323 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:32:42.034220 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:32:42.034220 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:32:42.034220 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:32:42.034220 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:32:42.034220 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:32:42.034220 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:32:42.034220 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:32:42.034220 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:32:42.034220 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:32:42.034220 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:32:42.034220 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:32:42.034220 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application with Lock( Aug 24 05:32:42.034220 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:32:42.034220 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:32:42.034220 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:32:42.034220 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:32:42.035019 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:32:42.035019 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:32:42.035019 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:32:42.035019 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:32:42.035019 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:32:42.035019 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:32:42.035019 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:32:42.035019 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:32:42.035019 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:32:42.035019 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:32:42.035019 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 05:32:42.035019 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Aug 24 05:32:42.035019 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 94/186] 10.222.0.26 () {56 vars in 1114 bytes} [Wed Aug 24 05:32:41 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:32:42.036297 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a9e8a0-a7c9-4764-9672-7a7b32003726 None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:32:42.098138 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa45c31-3a9a-46fd-85b4-04ad5eee8830 None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:32:42.130859 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a804bbea-23d9-4573-ac8d-31e580aafb62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:32:42.131492 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a804bbea-23d9-4573-ac8d-31e580aafb62 None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:42.131776 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a804bbea-23d9-4573-ac8d-31e580aafb62 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:42.132050 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a804bbea-23d9-4573-ac8d-31e580aafb62 None admin] PATH_INFO: `/v3/projects/f3919ce03c0d4a24a2c47e7b17d55a4e` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:42.133207 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a804bbea-23d9-4573-ac8d-31e580aafb62 None admin] RBAC: Authorizing `identity:get_project(project_id=f3919ce03c0d4a24a2c47e7b17d55a4e)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:32:42.134207 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a9e8a0-a7c9-4764-9672-7a7b32003726 None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:32:42.134677 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a804bbea-23d9-4573-ac8d-31e580aafb62 None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:32:42.136313 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 93/187] 10.222.0.26 () {56 vars in 1186 bytes} [Wed Aug 24 05:32:41 2022] GET /identity/v3/projects/f3919ce03c0d4a24a2c47e7b17d55a4e => generated 312 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:32:42.137081 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a804bbea-23d9-4573-ac8d-31e580aafb62 None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:32:42.150202 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:32:42.168484 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c94f57-0fc5-458d-b79b-c88888d98164 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:32:42.169081 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c94f57-0fc5-458d-b79b-c88888d98164 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:42.169371 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c94f57-0fc5-458d-b79b-c88888d98164 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:42.169634 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c94f57-0fc5-458d-b79b-c88888d98164 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:42.170391 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c94f57-0fc5-458d-b79b-c88888d98164 None admin] RBAC: Adding query filter params (role.id=640bda0879494e60b72680ee505285f0, scope.project.id=d4bde08b78fc4447a53a2928b2d22185, user.id=f35a18a67d5646f5b515c46f902c78fc) {{(pid=88113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:32:42.170699 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c94f57-0fc5-458d-b79b-c88888d98164 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:32:42.172126 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c94f57-0fc5-458d-b79b-c88888d98164 None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:32:42.177726 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 95/188] 10.222.0.26 () {56 vars in 1374 bytes} [Wed Aug 24 05:32:42 2022] GET /identity/v3/role_assignments?user.id=f35a18a67d5646f5b515c46f902c78fc&scope.project.id=d4bde08b78fc4447a53a2928b2d22185&role.id=640bda0879494e60b72680ee505285f0 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:32:42.178523 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c94f57-0fc5-458d-b79b-c88888d98164 None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:32:42.206343 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:32:42.257067 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a804bbea-23d9-4573-ac8d-31e580aafb62 None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:32:42.290799 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c94f57-0fc5-458d-b79b-c88888d98164 None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:32:42.295508 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c78fde5-0309-461b-82b0-cfe94db29b0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:32:42.296240 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c78fde5-0309-461b-82b0-cfe94db29b0e None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:42.296591 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c78fde5-0309-461b-82b0-cfe94db29b0e None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:42.296930 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c78fde5-0309-461b-82b0-cfe94db29b0e None admin] PATH_INFO: `/v3/domains/default` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:42.298337 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c78fde5-0309-461b-82b0-cfe94db29b0e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:32:42.299910 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c78fde5-0309-461b-82b0-cfe94db29b0e None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:32:42.301973 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 94/189] 10.222.0.26 () {56 vars in 1108 bytes} [Wed Aug 24 05:32:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:32:42.302670 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c78fde5-0309-461b-82b0-cfe94db29b0e None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:32:42.335005 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a15a02-2211-4c3f-ac2f-024ff6825ae7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:32:42.335005 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a15a02-2211-4c3f-ac2f-024ff6825ae7 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:42.335005 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a15a02-2211-4c3f-ac2f-024ff6825ae7 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:42.335350 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a15a02-2211-4c3f-ac2f-024ff6825ae7 None admin] PATH_INFO: `/v3/users/a2f283ad42644e4d81b1009117055350` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:42.355507 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a15a02-2211-4c3f-ac2f-024ff6825ae7 None admin] RBAC: Authorizing `identity:get_user(user_id=a2f283ad42644e4d81b1009117055350)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:32:42.356977 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a15a02-2211-4c3f-ac2f-024ff6825ae7 None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:32:42.358864 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 96/190] 10.222.0.26 () {56 vars in 1177 bytes} [Wed Aug 24 05:32:42 2022] GET /identity/v3/users/a2f283ad42644e4d81b1009117055350 => generated 283 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:32:42.359967 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4913dbe3-e180-4f81-8704-f0360cfa85ea None None] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:42.360247 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4913dbe3-e180-4f81-8704-f0360cfa85ea None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:42.360517 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4913dbe3-e180-4f81-8704-f0360cfa85ea None None] PATH_INFO: `/` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:42.362460 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 97/191] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 24 05:32:42 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:32:42.362460 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4913dbe3-e180-4f81-8704-f0360cfa85ea None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:32:42.399987 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:32:42.423774 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c78fde5-0309-461b-82b0-cfe94db29b0e None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:32:42.448260 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:32:42.458441 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa3b13d-68a7-45d2-aebc-c37f63d6e314 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:32:42.459051 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa3b13d-68a7-45d2-aebc-c37f63d6e314 None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:42.459325 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa3b13d-68a7-45d2-aebc-c37f63d6e314 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:42.459596 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa3b13d-68a7-45d2-aebc-c37f63d6e314 None admin] PATH_INFO: `/v3/roles` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:42.460255 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa3b13d-68a7-45d2-aebc-c37f63d6e314 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:32:42.460559 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa3b13d-68a7-45d2-aebc-c37f63d6e314 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:32:42.461932 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa3b13d-68a7-45d2-aebc-c37f63d6e314 None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:32:42.466784 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4913dbe3-e180-4f81-8704-f0360cfa85ea None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:32:42.469671 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 95/192] 10.222.0.26 () {56 vars in 1111 bytes} [Wed Aug 24 05:32:42 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:32:42.474509 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa3b13d-68a7-45d2-aebc-c37f63d6e314 None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:32:42.500397 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f295bb46-6c72-471a-b216-451af08b67f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:32:42.500997 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f295bb46-6c72-471a-b216-451af08b67f5 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:42.501270 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f295bb46-6c72-471a-b216-451af08b67f5 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:42.501542 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f295bb46-6c72-471a-b216-451af08b67f5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:42.502297 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f295bb46-6c72-471a-b216-451af08b67f5 None admin] RBAC: Adding query filter params (role.id=f7aa4a2c74c94c1b9ca8ecdcccccda5c, scope.project.id=f3919ce03c0d4a24a2c47e7b17d55a4e, user.id=3f18e05ea2ca4efea2d541eedaad23e0) {{(pid=88113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:32:42.502602 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f295bb46-6c72-471a-b216-451af08b67f5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:32:42.504636 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f295bb46-6c72-471a-b216-451af08b67f5 None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:32:42.510444 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 98/193] 10.222.0.26 () {56 vars in 1374 bytes} [Wed Aug 24 05:32:42 2022] GET /identity/v3/role_assignments?user.id=3f18e05ea2ca4efea2d541eedaad23e0&scope.project.id=f3919ce03c0d4a24a2c47e7b17d55a4e&role.id=f7aa4a2c74c94c1b9ca8ecdcccccda5c => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:32:42.511625 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81b853e-77d5-436c-bd16-5b58a6648b02 None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:42.511911 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81b853e-77d5-436c-bd16-5b58a6648b02 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:42.512183 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81b853e-77d5-436c-bd16-5b58a6648b02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:42.531100 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-a81b853e-77d5-436c-bd16-5b58a6648b02 None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:32:42.532347 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-a81b853e-77d5-436c-bd16-5b58a6648b02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:32:42.597517 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa3b13d-68a7-45d2-aebc-c37f63d6e314 None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:32:42.611298 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 99/194] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 24 05:32:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 05:32:42.612101 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81b853e-77d5-436c-bd16-5b58a6648b02 None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:32:42.648297 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf00a2a8-e57a-483e-94db-6296847abc75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:32:42.649038 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf00a2a8-e57a-483e-94db-6296847abc75 None admin] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:42.649320 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf00a2a8-e57a-483e-94db-6296847abc75 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:42.649593 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf00a2a8-e57a-483e-94db-6296847abc75 None admin] PATH_INFO: `/v3/users` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:42.651174 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf00a2a8-e57a-483e-94db-6296847abc75 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:32:42.653122 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf00a2a8-e57a-483e-94db-6296847abc75 None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:32:42.663806 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:32:42.678134 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 96/195] 10.222.0.26 () {60 vars in 1132 bytes} [Wed Aug 24 05:32:42 2022] POST /identity/v3/users => generated 297 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:32:42.685975 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf00a2a8-e57a-483e-94db-6296847abc75 None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:32:42.722190 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:32:42.756297 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81b853e-77d5-436c-bd16-5b58a6648b02 None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:32:42.805854 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2a970a-b653-457c-9e13-574054652196 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:32:42.806523 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2a970a-b653-457c-9e13-574054652196 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:42.806805 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2a970a-b653-457c-9e13-574054652196 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:42.807588 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2a970a-b653-457c-9e13-574054652196 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:42.843492 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf00a2a8-e57a-483e-94db-6296847abc75 None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:32:42.889911 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b60083-d81f-4d51-a522-f5ace43d9bca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:32:42.890535 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b60083-d81f-4d51-a522-f5ace43d9bca None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:42.890852 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b60083-d81f-4d51-a522-f5ace43d9bca None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:42.891190 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b60083-d81f-4d51-a522-f5ace43d9bca None admin] PATH_INFO: `/v3/users/a2f283ad42644e4d81b1009117055350` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:42.892444 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b60083-d81f-4d51-a522-f5ace43d9bca None admin] RBAC: Authorizing `identity:get_user(user_id=a2f283ad42644e4d81b1009117055350)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:32:42.893895 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b60083-d81f-4d51-a522-f5ace43d9bca None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:32:42.895890 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 97/196] 10.222.0.26 () {56 vars in 1177 bytes} [Wed Aug 24 05:32:42 2022] GET /identity/v3/users/a2f283ad42644e4d81b1009117055350 => generated 283 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:32:42.898728 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2a970a-b653-457c-9e13-574054652196 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:32:42.900215 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2a970a-b653-457c-9e13-574054652196 None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:32:42.901516 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b60083-d81f-4d51-a522-f5ace43d9bca None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:32:42.976702 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:32:43.004163 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:32:43.035966 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b60083-d81f-4d51-a522-f5ace43d9bca None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:32:43.036173 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 100/197] 10.222.0.26 () {58 vars in 1282 bytes} [Wed Aug 24 05:32:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 05:32:43.036750 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2a970a-b653-457c-9e13-574054652196 None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:32:43.077738 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b170a5-a3e4-4e6d-8499-e9f3389aff68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:32:43.078491 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b170a5-a3e4-4e6d-8499-e9f3389aff68 None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:43.078843 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b170a5-a3e4-4e6d-8499-e9f3389aff68 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:43.079978 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b170a5-a3e4-4e6d-8499-e9f3389aff68 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:43.172208 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2a970a-b653-457c-9e13-574054652196 None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:32:43.172394 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b170a5-a3e4-4e6d-8499-e9f3389aff68 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:32:43.173788 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b170a5-a3e4-4e6d-8499-e9f3389aff68 None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:32:43.211628 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47969d16-2511-476f-9446-841f048f26a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:32:43.212583 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47969d16-2511-476f-9446-841f048f26a9 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:43.213033 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47969d16-2511-476f-9446-841f048f26a9 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:43.213474 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47969d16-2511-476f-9446-841f048f26a9 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:43.224886 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47969d16-2511-476f-9446-841f048f26a9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:32:43.229965 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application [None req-47969d16-2511-476f-9446-841f048f26a9 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 05:32:43.229965 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:32:43.229965 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:32:43.229965 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:32:43.229965 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:32:43.229965 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:32:43.229965 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:32:43.229965 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:32:43.229965 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:32:43.229965 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:32:43.229965 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:32:43.229965 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:32:43.229965 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:32:43.229965 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:32:43.229965 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:32:43.229965 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:32:43.230844 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:32:43.230844 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:32:43.230844 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:32:43.230844 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:32:43.230844 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:32:43.230844 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:32:43.230844 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:32:43.230844 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:32:43.230844 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:32:43.230844 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:32:43.230844 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:32:43.230844 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application with Lock( Aug 24 05:32:43.230844 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:32:43.230844 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:32:43.230844 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:32:43.230844 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:32:43.231614 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:32:43.231614 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:32:43.231614 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:32:43.231614 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:32:43.231614 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:32:43.231614 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:32:43.231614 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:32:43.231614 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:32:43.231614 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:32:43.231614 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:32:43.231614 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 05:32:43.231614 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Aug 24 05:32:43.233732 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 101/198] 10.222.0.26 () {56 vars in 1099 bytes} [Wed Aug 24 05:32:43 2022] GET /identity/v3/roles/reader => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:32:43.234888 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47969d16-2511-476f-9446-841f048f26a9 None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:32:43.237616 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:32:43.277380 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:32:43.284752 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 98/199] 10.222.0.26 () {58 vars in 1282 bytes} [Wed Aug 24 05:32:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 05:32:43.284752 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b170a5-a3e4-4e6d-8499-e9f3389aff68 None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:32:43.352431 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47969d16-2511-476f-9446-841f048f26a9 None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:32:43.389179 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a078c8-4394-4038-87f3-dd5190814d40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:32:43.390188 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a078c8-4394-4038-87f3-dd5190814d40 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:43.390681 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a078c8-4394-4038-87f3-dd5190814d40 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:43.391169 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a078c8-4394-4038-87f3-dd5190814d40 None admin] PATH_INFO: `/v3/projects/354a816414fb4c1d8f99d5307047be89` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:43.392587 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a078c8-4394-4038-87f3-dd5190814d40 None admin] RBAC: Authorizing `identity:get_project(project_id=354a816414fb4c1d8f99d5307047be89)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:32:43.393478 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b170a5-a3e4-4e6d-8499-e9f3389aff68 None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:32:43.394819 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a078c8-4394-4038-87f3-dd5190814d40 None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:32:43.397099 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 102/200] 10.222.0.26 () {56 vars in 1186 bytes} [Wed Aug 24 05:32:43 2022] GET /identity/v3/projects/354a816414fb4c1d8f99d5307047be89 => generated 302 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:32:43.398102 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a078c8-4394-4038-87f3-dd5190814d40 None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:32:43.442449 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19fd752-d1bc-492e-9644-32adeb726848 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:32:43.444103 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19fd752-d1bc-492e-9644-32adeb726848 None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:43.444681 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19fd752-d1bc-492e-9644-32adeb726848 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:43.445156 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19fd752-d1bc-492e-9644-32adeb726848 None admin] PATH_INFO: `/v3/roles` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:43.446227 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19fd752-d1bc-492e-9644-32adeb726848 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:32:43.447124 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19fd752-d1bc-492e-9644-32adeb726848 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:32:43.449127 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19fd752-d1bc-492e-9644-32adeb726848 None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:32:43.460282 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 99/201] 10.222.0.26 () {56 vars in 1101 bytes} [Wed Aug 24 05:32:43 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:32:43.462009 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19fd752-d1bc-492e-9644-32adeb726848 None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:32:43.499303 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:32:43.517422 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a078c8-4394-4038-87f3-dd5190814d40 None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:32:43.520721 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:32:43.571554 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd3b8a1-fe13-4de3-892c-5d71a52d240f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:32:43.572751 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd3b8a1-fe13-4de3-892c-5d71a52d240f None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:43.573239 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd3b8a1-fe13-4de3-892c-5d71a52d240f None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:43.573741 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd3b8a1-fe13-4de3-892c-5d71a52d240f None admin] PATH_INFO: `/v3/projects/354a816414fb4c1d8f99d5307047be89` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:43.575798 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd3b8a1-fe13-4de3-892c-5d71a52d240f None admin] RBAC: Authorizing `identity:get_project(project_id=354a816414fb4c1d8f99d5307047be89)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:32:43.578010 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd3b8a1-fe13-4de3-892c-5d71a52d240f None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:32:43.580253 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 103/202] 10.222.0.26 () {56 vars in 1186 bytes} [Wed Aug 24 05:32:43 2022] GET /identity/v3/projects/354a816414fb4c1d8f99d5307047be89 => generated 302 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:32:43.581199 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd3b8a1-fe13-4de3-892c-5d71a52d240f None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:32:43.596690 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19fd752-d1bc-492e-9644-32adeb726848 None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:32:43.632691 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fac86e6-95fc-4539-9955-29eaaba09b75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:32:43.633634 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fac86e6-95fc-4539-9955-29eaaba09b75 None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:43.634142 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fac86e6-95fc-4539-9955-29eaaba09b75 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:43.634622 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fac86e6-95fc-4539-9955-29eaaba09b75 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:43.635525 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fac86e6-95fc-4539-9955-29eaaba09b75 None admin] RBAC: Adding query filter params (role.id=640bda0879494e60b72680ee505285f0, scope.project.id=354a816414fb4c1d8f99d5307047be89, user.id=a2f283ad42644e4d81b1009117055350) {{(pid=88112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:32:43.636033 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fac86e6-95fc-4539-9955-29eaaba09b75 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:32:43.637658 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fac86e6-95fc-4539-9955-29eaaba09b75 None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:32:43.643349 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 100/203] 10.222.0.26 () {56 vars in 1374 bytes} [Wed Aug 24 05:32:43 2022] GET /identity/v3/role_assignments?user.id=a2f283ad42644e4d81b1009117055350&scope.project.id=354a816414fb4c1d8f99d5307047be89&role.id=640bda0879494e60b72680ee505285f0 => generated 259 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:32:43.644359 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fac86e6-95fc-4539-9955-29eaaba09b75 None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:32:43.756569 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd3b8a1-fe13-4de3-892c-5d71a52d240f None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:32:43.764707 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:32:43.780963 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fac86e6-95fc-4539-9955-29eaaba09b75 None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:32:43.828101 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f167c7-7791-46f0-b59d-22b9290a6945 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:32:43.828650 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f167c7-7791-46f0-b59d-22b9290a6945 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:43.828938 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f167c7-7791-46f0-b59d-22b9290a6945 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:43.829209 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f167c7-7791-46f0-b59d-22b9290a6945 None admin] PATH_INFO: `/v3/users/4741d05f701246fe9bc52f7dabbfde5f` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:43.835131 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f167c7-7791-46f0-b59d-22b9290a6945 None admin] RBAC: Authorizing `identity:get_user(user_id=4741d05f701246fe9bc52f7dabbfde5f)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:32:43.836642 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f167c7-7791-46f0-b59d-22b9290a6945 None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:32:43.842754 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 104/204] 10.222.0.26 () {56 vars in 1177 bytes} [Wed Aug 24 05:32:43 2022] GET /identity/v3/users/4741d05f701246fe9bc52f7dabbfde5f => generated 289 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:32:43.849155 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f167c7-7791-46f0-b59d-22b9290a6945 None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:32:43.853181 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e88cbb-3ed2-4653-bcc7-545ad5ac9aeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:32:43.854064 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e88cbb-3ed2-4653-bcc7-545ad5ac9aeb None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:43.854490 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e88cbb-3ed2-4653-bcc7-545ad5ac9aeb None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:43.854926 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e88cbb-3ed2-4653-bcc7-545ad5ac9aeb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:43.855818 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e88cbb-3ed2-4653-bcc7-545ad5ac9aeb None admin] RBAC: Adding query filter params (role.id=109c3556f4644bd291e81b0aa7fe2598, scope.project.id=354a816414fb4c1d8f99d5307047be89, user.id=a2f283ad42644e4d81b1009117055350) {{(pid=88112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:32:43.856269 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e88cbb-3ed2-4653-bcc7-545ad5ac9aeb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:32:43.857868 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e88cbb-3ed2-4653-bcc7-545ad5ac9aeb None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:32:43.872018 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 101/205] 10.222.0.26 () {56 vars in 1374 bytes} [Wed Aug 24 05:32:43 2022] GET /identity/v3/role_assignments?user.id=a2f283ad42644e4d81b1009117055350&scope.project.id=354a816414fb4c1d8f99d5307047be89&role.id=109c3556f4644bd291e81b0aa7fe2598 => generated 259 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:32:43.898319 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:32:43.971347 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f167c7-7791-46f0-b59d-22b9290a6945 None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:32:44.010678 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1acd05-be39-4aee-82f7-c679c3a88ee5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:32:44.011218 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1acd05-be39-4aee-82f7-c679c3a88ee5 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:44.011500 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1acd05-be39-4aee-82f7-c679c3a88ee5 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:44.011767 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1acd05-be39-4aee-82f7-c679c3a88ee5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:44.109521 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1acd05-be39-4aee-82f7-c679c3a88ee5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:32:44.111269 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1acd05-be39-4aee-82f7-c679c3a88ee5 None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:32:44.163804 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:32:44.235627 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 105/206] 10.222.0.26 () {58 vars in 1282 bytes} [Wed Aug 24 05:32:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 05:32:44.241572 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e88cbb-3ed2-4653-bcc7-545ad5ac9aeb None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:32:44.377775 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e88cbb-3ed2-4653-bcc7-545ad5ac9aeb None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:32:44.414795 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfc3e34-960b-463c-845c-7b59671d237f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:32:44.415556 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfc3e34-960b-463c-845c-7b59671d237f None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:44.415730 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfc3e34-960b-463c-845c-7b59671d237f None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:44.415987 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfc3e34-960b-463c-845c-7b59671d237f None admin] PATH_INFO: `/v3/projects/d4bde08b78fc4447a53a2928b2d22185` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:44.417120 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfc3e34-960b-463c-845c-7b59671d237f None admin] RBAC: Authorizing `identity:get_project(project_id=d4bde08b78fc4447a53a2928b2d22185)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:32:44.418599 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfc3e34-960b-463c-845c-7b59671d237f None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:32:44.420544 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 102/207] 10.222.0.26 () {56 vars in 1186 bytes} [Wed Aug 24 05:32:44 2022] GET /identity/v3/projects/d4bde08b78fc4447a53a2928b2d22185 => generated 298 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:32:44.426294 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1acd05-be39-4aee-82f7-c679c3a88ee5 None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:32:44.562580 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1acd05-be39-4aee-82f7-c679c3a88ee5 None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:32:44.616795 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87e0ea4-910f-4451-9c37-5bc08d979024 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:32:44.617407 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87e0ea4-910f-4451-9c37-5bc08d979024 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:44.617686 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87e0ea4-910f-4451-9c37-5bc08d979024 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:44.617970 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87e0ea4-910f-4451-9c37-5bc08d979024 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:44.618773 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87e0ea4-910f-4451-9c37-5bc08d979024 None admin] RBAC: Adding query filter params (role.id=129798c59b2c43978b555869931dada4, scope.project.id=d4bde08b78fc4447a53a2928b2d22185, user.id=4741d05f701246fe9bc52f7dabbfde5f) {{(pid=88113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:32:44.619078 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87e0ea4-910f-4451-9c37-5bc08d979024 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:32:44.620574 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87e0ea4-910f-4451-9c37-5bc08d979024 None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:32:44.626514 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 106/208] 10.222.0.26 () {56 vars in 1374 bytes} [Wed Aug 24 05:32:44 2022] GET /identity/v3/role_assignments?user.id=4741d05f701246fe9bc52f7dabbfde5f&scope.project.id=d4bde08b78fc4447a53a2928b2d22185&role.id=129798c59b2c43978b555869931dada4 => generated 608 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:32:44.955177 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436c180e-16bb-4840-b737-b28603b0b86a None None] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:44.955565 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436c180e-16bb-4840-b737-b28603b0b86a None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:44.955748 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436c180e-16bb-4840-b737-b28603b0b86a None None] PATH_INFO: `/` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:44.957633 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 103/209] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 24 05:32:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:32:44.962957 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4028cacc-cd18-41e0-8d07-34b0171fc2b7 None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:44.963239 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4028cacc-cd18-41e0-8d07-34b0171fc2b7 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:44.963510 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4028cacc-cd18-41e0-8d07-34b0171fc2b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:44.970783 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:32:44.982795 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-4028cacc-cd18-41e0-8d07-34b0171fc2b7 None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:32:44.984123 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-4028cacc-cd18-41e0-8d07-34b0171fc2b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:32:45.054592 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 107/210] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 24 05:32:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 05:32:45.111585 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fd73d0-80fd-4eb8-9005-2b277f51f1dd None None] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:45.111873 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fd73d0-80fd-4eb8-9005-2b277f51f1dd None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:45.112151 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fd73d0-80fd-4eb8-9005-2b277f51f1dd None None] PATH_INFO: `/` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:45.113552 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 104/211] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 24 05:32:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:32:45.119146 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b40795d-2ff7-468f-9194-d19309ea28ad None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:45.119681 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b40795d-2ff7-468f-9194-d19309ea28ad None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:45.119681 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b40795d-2ff7-468f-9194-d19309ea28ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:45.140454 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-7b40795d-2ff7-468f-9194-d19309ea28ad None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:32:45.141644 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-7b40795d-2ff7-468f-9194-d19309ea28ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:32:45.219315 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 108/212] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 24 05:32:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 05:32:45.354820 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fd73d0-80fd-4eb8-9005-2b277f51f1dd None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:32:45.378001 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:32:45.460133 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fd73d0-80fd-4eb8-9005-2b277f51f1dd None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:32:45.494512 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85abb21a-f00c-43d9-946b-a07ecaff245e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:32:45.497631 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85abb21a-f00c-43d9-946b-a07ecaff245e None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:45.497910 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85abb21a-f00c-43d9-946b-a07ecaff245e None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:45.498210 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85abb21a-f00c-43d9-946b-a07ecaff245e None admin] PATH_INFO: `/v3/roles/member` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:45.508850 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85abb21a-f00c-43d9-946b-a07ecaff245e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:32:45.513986 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application [None req-85abb21a-f00c-43d9-946b-a07ecaff245e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 05:32:45.513986 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:32:45.513986 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:32:45.513986 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:32:45.513986 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:32:45.513986 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:32:45.513986 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:32:45.513986 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:32:45.513986 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:32:45.513986 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:32:45.513986 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:32:45.513986 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:32:45.513986 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:32:45.513986 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:32:45.513986 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:32:45.513986 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:32:45.514841 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:32:45.514841 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:32:45.514841 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:32:45.514841 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:32:45.514841 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:32:45.514841 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:32:45.514841 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:32:45.514841 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:32:45.514841 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:32:45.514841 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:32:45.514841 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:32:45.514841 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application with Lock( Aug 24 05:32:45.514841 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:32:45.514841 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:32:45.514841 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:32:45.514841 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:32:45.515609 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:32:45.515609 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:32:45.515609 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:32:45.515609 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:32:45.515609 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:32:45.515609 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:32:45.515609 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:32:45.515609 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:32:45.515609 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:32:45.515609 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:32:45.515609 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 05:32:45.515609 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Aug 24 05:32:45.516190 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b40795d-2ff7-468f-9194-d19309ea28ad None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:32:45.516274 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 105/213] 10.222.0.26 () {56 vars in 1099 bytes} [Wed Aug 24 05:32:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:32:45.521280 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85abb21a-f00c-43d9-946b-a07ecaff245e None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:32:45.582982 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:32:45.611419 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:32:45.627428 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b40795d-2ff7-468f-9194-d19309ea28ad None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:32:45.632253 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85abb21a-f00c-43d9-946b-a07ecaff245e None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:32:45.664428 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46199e93-2fb5-4fb6-9a20-f79d8174c2d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:32:45.665124 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46199e93-2fb5-4fb6-9a20-f79d8174c2d8 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:45.665398 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46199e93-2fb5-4fb6-9a20-f79d8174c2d8 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:45.665664 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46199e93-2fb5-4fb6-9a20-f79d8174c2d8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:45.667251 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46199e93-2fb5-4fb6-9a20-f79d8174c2d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:32:45.668354 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46199e93-2fb5-4fb6-9a20-f79d8174c2d8 None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:32:45.669800 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b57cac1-f91d-4be2-81e1-cb5a60cf6239 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:32:45.670444 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b57cac1-f91d-4be2-81e1-cb5a60cf6239 None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:45.670723 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b57cac1-f91d-4be2-81e1-cb5a60cf6239 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:45.670996 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b57cac1-f91d-4be2-81e1-cb5a60cf6239 None admin] PATH_INFO: `/v3/roles` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:45.671673 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b57cac1-f91d-4be2-81e1-cb5a60cf6239 None admin] RBAC: Adding query filter params (name=member) {{(pid=88112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:32:45.671973 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b57cac1-f91d-4be2-81e1-cb5a60cf6239 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:32:45.673347 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b57cac1-f91d-4be2-81e1-cb5a60cf6239 None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:32:45.674965 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 109/214] 10.222.0.26 () {56 vars in 1108 bytes} [Wed Aug 24 05:32:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:32:45.675937 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46199e93-2fb5-4fb6-9a20-f79d8174c2d8 None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:32:45.683050 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 106/215] 10.222.0.26 () {56 vars in 1101 bytes} [Wed Aug 24 05:32:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:32:45.688548 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b57cac1-f91d-4be2-81e1-cb5a60cf6239 None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:32:45.786637 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46199e93-2fb5-4fb6-9a20-f79d8174c2d8 None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:32:45.815195 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b57cac1-f91d-4be2-81e1-cb5a60cf6239 None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:32:45.823766 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:32:45.837100 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae70407-e4f4-43a4-b3ec-37bd4c18b184 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:32:45.837824 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae70407-e4f4-43a4-b3ec-37bd4c18b184 None admin] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:45.838141 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae70407-e4f4-43a4-b3ec-37bd4c18b184 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:45.838417 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae70407-e4f4-43a4-b3ec-37bd4c18b184 None admin] PATH_INFO: `/v3/users` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:45.839072 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae70407-e4f4-43a4-b3ec-37bd4c18b184 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:32:45.840635 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae70407-e4f4-43a4-b3ec-37bd4c18b184 None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:32:45.861705 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba9d592-f93d-484c-9ccd-c075822f7b75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:32:45.862636 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba9d592-f93d-484c-9ccd-c075822f7b75 None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:45.862922 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba9d592-f93d-484c-9ccd-c075822f7b75 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:45.863229 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba9d592-f93d-484c-9ccd-c075822f7b75 None admin] PATH_INFO: `/v3/users/677a3f88f74c4cb0812021cd878d8a8d` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:45.869442 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 110/216] 10.222.0.26 () {60 vars in 1132 bytes} [Wed Aug 24 05:32:45 2022] POST /identity/v3/users => generated 297 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:32:45.889043 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:32:45.893663 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba9d592-f93d-484c-9ccd-c075822f7b75 None admin] RBAC: Authorizing `identity:get_user(user_id=677a3f88f74c4cb0812021cd878d8a8d)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:32:45.895313 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba9d592-f93d-484c-9ccd-c075822f7b75 None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:32:45.898198 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 107/217] 10.222.0.26 () {56 vars in 1177 bytes} [Wed Aug 24 05:32:45 2022] GET /identity/v3/users/677a3f88f74c4cb0812021cd878d8a8d => generated 297 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:32:45.903641 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae70407-e4f4-43a4-b3ec-37bd4c18b184 None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:32:45.943731 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2524a3-7f39-4fd8-93d9-a46a6dde4926 None None] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:45.944092 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2524a3-7f39-4fd8-93d9-a46a6dde4926 None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:45.944276 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2524a3-7f39-4fd8-93d9-a46a6dde4926 None None] PATH_INFO: `/` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:45.947083 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 108/218] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 24 05:32:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:32:45.951803 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4ed489-9b6b-4d08-a232-2daa9fe97075 None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:45.952075 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4ed489-9b6b-4d08-a232-2daa9fe97075 None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:45.952414 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4ed489-9b6b-4d08-a232-2daa9fe97075 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:45.973447 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-ff4ed489-9b6b-4d08-a232-2daa9fe97075 None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:32:45.975305 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-ff4ed489-9b6b-4d08-a232-2daa9fe97075 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:32:46.048876 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae70407-e4f4-43a4-b3ec-37bd4c18b184 None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:32:46.062837 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 109/219] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 24 05:32:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 05:32:46.089475 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc40f07-cecc-42a1-b560-9ca3a16781c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:32:46.090352 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc40f07-cecc-42a1-b560-9ca3a16781c7 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:46.090848 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc40f07-cecc-42a1-b560-9ca3a16781c7 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:46.091282 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc40f07-cecc-42a1-b560-9ca3a16781c7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:46.147054 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3087cb9-5aab-4de9-a83c-645cc49da787 None None] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:46.147054 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3087cb9-5aab-4de9-a83c-645cc49da787 None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:46.147324 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3087cb9-5aab-4de9-a83c-645cc49da787 None None] PATH_INFO: `/` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:46.148835 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 110/220] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 24 05:32:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 05:32:46.151214 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:32:46.154606 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e229402-8ee4-4dd0-a7d1-aec9135e6af3 None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:46.154944 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e229402-8ee4-4dd0-a7d1-aec9135e6af3 None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:46.155334 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e229402-8ee4-4dd0-a7d1-aec9135e6af3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:46.167027 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc40f07-cecc-42a1-b560-9ca3a16781c7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:32:46.168694 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc40f07-cecc-42a1-b560-9ca3a16781c7 None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:32:46.179593 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-2e229402-8ee4-4dd0-a7d1-aec9135e6af3 None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:32:46.180807 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-2e229402-8ee4-4dd0-a7d1-aec9135e6af3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:32:46.274520 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 111/221] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 24 05:32:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 05:32:46.291188 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 111/222] 10.222.0.26 () {58 vars in 1282 bytes} [Wed Aug 24 05:32:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 05:32:46.296859 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e229402-8ee4-4dd0-a7d1-aec9135e6af3 None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:32:46.360738 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc40f07-cecc-42a1-b560-9ca3a16781c7 None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:32:46.365141 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:32:46.412319 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e229402-8ee4-4dd0-a7d1-aec9135e6af3 None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:32:46.454690 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d314abbd-6f12-4137-83b7-33398c1a5daa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:32:46.455342 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d314abbd-6f12-4137-83b7-33398c1a5daa None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:46.455767 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d314abbd-6f12-4137-83b7-33398c1a5daa None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:46.456169 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d314abbd-6f12-4137-83b7-33398c1a5daa None admin] PATH_INFO: `/v3/projects/354a816414fb4c1d8f99d5307047be89` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:46.457592 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d314abbd-6f12-4137-83b7-33398c1a5daa None admin] RBAC: Authorizing `identity:get_project(project_id=354a816414fb4c1d8f99d5307047be89)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:32:46.459981 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d314abbd-6f12-4137-83b7-33398c1a5daa None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:32:46.461644 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 112/223] 10.222.0.26 () {56 vars in 1186 bytes} [Wed Aug 24 05:32:46 2022] GET /identity/v3/projects/354a816414fb4c1d8f99d5307047be89 => generated 302 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:32:46.467500 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d314abbd-6f12-4137-83b7-33398c1a5daa None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:32:46.483561 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:32:46.501431 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc40f07-cecc-42a1-b560-9ca3a16781c7 None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:32:46.543930 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de5a6f8-6543-4f0f-8ff1-c3f2184f947a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:32:46.545222 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de5a6f8-6543-4f0f-8ff1-c3f2184f947a None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:46.546004 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de5a6f8-6543-4f0f-8ff1-c3f2184f947a None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:46.546414 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de5a6f8-6543-4f0f-8ff1-c3f2184f947a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:46.561072 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de5a6f8-6543-4f0f-8ff1-c3f2184f947a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:32:46.567677 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application [None req-1de5a6f8-6543-4f0f-8ff1-c3f2184f947a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 05:32:46.567677 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:32:46.567677 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:32:46.567677 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:32:46.567677 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:32:46.567677 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:32:46.567677 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:32:46.567677 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:32:46.567677 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:32:46.567677 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:32:46.567677 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:32:46.567677 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:32:46.567677 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:32:46.567677 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:32:46.567677 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:32:46.567677 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:32:46.568859 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:32:46.568859 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:32:46.568859 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:32:46.568859 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:32:46.568859 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:32:46.568859 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:32:46.568859 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:32:46.568859 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:32:46.568859 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:32:46.568859 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:32:46.568859 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:32:46.568859 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application with Lock( Aug 24 05:32:46.568859 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:32:46.568859 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:32:46.568859 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:32:46.568859 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:32:46.569635 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:32:46.569635 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:32:46.569635 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:32:46.569635 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:32:46.569635 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:32:46.569635 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:32:46.569635 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:32:46.569635 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:32:46.569635 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:32:46.569635 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:32:46.569635 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 05:32:46.569635 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Aug 24 05:32:46.572601 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 112/224] 10.222.0.26 () {56 vars in 1096 bytes} [Wed Aug 24 05:32:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 05:32:46.582917 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de5a6f8-6543-4f0f-8ff1-c3f2184f947a None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:32:46.599086 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d314abbd-6f12-4137-83b7-33398c1a5daa None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:32:46.641086 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:32:46.652921 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c657fe5c-7507-4def-8c61-a481be36b25c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:32:46.654434 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c657fe5c-7507-4def-8c61-a481be36b25c None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:46.654915 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c657fe5c-7507-4def-8c61-a481be36b25c None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:46.655378 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c657fe5c-7507-4def-8c61-a481be36b25c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:46.656465 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c657fe5c-7507-4def-8c61-a481be36b25c None admin] RBAC: Adding query filter params (role.id=f7aa4a2c74c94c1b9ca8ecdcccccda5c, scope.project.id=354a816414fb4c1d8f99d5307047be89, user.id=677a3f88f74c4cb0812021cd878d8a8d) {{(pid=88112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:32:46.656966 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c657fe5c-7507-4def-8c61-a481be36b25c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:32:46.659571 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c657fe5c-7507-4def-8c61-a481be36b25c None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:32:46.674227 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 113/225] 10.222.0.26 () {56 vars in 1374 bytes} [Wed Aug 24 05:32:46 2022] GET /identity/v3/role_assignments?user.id=677a3f88f74c4cb0812021cd878d8a8d&scope.project.id=354a816414fb4c1d8f99d5307047be89&role.id=f7aa4a2c74c94c1b9ca8ecdcccccda5c => generated 259 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:32:46.674227 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c657fe5c-7507-4def-8c61-a481be36b25c None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:32:46.769905 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de5a6f8-6543-4f0f-8ff1-c3f2184f947a None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:32:46.821512 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d74197-51cd-4227-96da-5db699647886 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:32:46.822173 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d74197-51cd-4227-96da-5db699647886 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:46.822651 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d74197-51cd-4227-96da-5db699647886 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:46.822938 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d74197-51cd-4227-96da-5db699647886 None admin] PATH_INFO: `/v3/roles` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:46.823633 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d74197-51cd-4227-96da-5db699647886 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:32:46.823937 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d74197-51cd-4227-96da-5db699647886 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:32:46.825356 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d74197-51cd-4227-96da-5db699647886 None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:32:46.834889 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 113/226] 10.222.0.26 () {56 vars in 1099 bytes} [Wed Aug 24 05:32:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:32:46.840554 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d74197-51cd-4227-96da-5db699647886 None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:32:46.856312 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:32:46.873906 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c657fe5c-7507-4def-8c61-a481be36b25c None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:32:46.923751 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877a3b6a-0510-4315-b906-e4cfee337345 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:32:46.924361 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877a3b6a-0510-4315-b906-e4cfee337345 None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:46.924643 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877a3b6a-0510-4315-b906-e4cfee337345 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:46.924914 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877a3b6a-0510-4315-b906-e4cfee337345 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:46.947718 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877a3b6a-0510-4315-b906-e4cfee337345 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:32:46.953197 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application [None req-877a3b6a-0510-4315-b906-e4cfee337345 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 05:32:46.953197 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:32:46.953197 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:32:46.953197 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:32:46.953197 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:32:46.953197 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:32:46.953197 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:32:46.953197 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:32:46.953197 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:32:46.953197 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:32:46.953197 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:32:46.953197 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:32:46.953197 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:32:46.953197 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:32:46.953197 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:32:46.953197 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:32:46.954110 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:32:46.954110 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:32:46.954110 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:32:46.954110 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:32:46.954110 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:32:46.954110 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:32:46.954110 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:32:46.954110 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:32:46.954110 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:32:46.954110 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:32:46.954110 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:32:46.954110 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application with Lock( Aug 24 05:32:46.954110 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:32:46.954110 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:32:46.954110 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:32:46.954110 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:32:46.955284 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:32:46.955284 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:32:46.955284 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:32:46.955284 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:32:46.955284 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:32:46.955284 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:32:46.955284 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:32:46.955284 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:32:46.955284 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:32:46.955284 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:32:46.955284 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 05:32:46.955284 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Aug 24 05:32:46.955284 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 114/227] 10.222.0.26 () {56 vars in 1114 bytes} [Wed Aug 24 05:32:46 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:32:46.960633 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877a3b6a-0510-4315-b906-e4cfee337345 None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:32:46.969734 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d74197-51cd-4227-96da-5db699647886 None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:32:47.008856 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64df8cc8-9cac-4b9c-80d6-31717cde97ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:32:47.009850 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64df8cc8-9cac-4b9c-80d6-31717cde97ef None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:47.010354 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64df8cc8-9cac-4b9c-80d6-31717cde97ef None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:47.011290 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64df8cc8-9cac-4b9c-80d6-31717cde97ef None admin] PATH_INFO: `/v3/users/a2f283ad42644e4d81b1009117055350` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:47.012767 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64df8cc8-9cac-4b9c-80d6-31717cde97ef None admin] RBAC: Authorizing `identity:get_user(user_id=a2f283ad42644e4d81b1009117055350)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:32:47.014601 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64df8cc8-9cac-4b9c-80d6-31717cde97ef None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:32:47.016716 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 114/228] 10.222.0.26 () {56 vars in 1177 bytes} [Wed Aug 24 05:32:46 2022] GET /identity/v3/users/a2f283ad42644e4d81b1009117055350 => generated 283 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:32:47.022750 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64df8cc8-9cac-4b9c-80d6-31717cde97ef None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:32:47.074686 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:32:47.155864 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:32:47.178846 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64df8cc8-9cac-4b9c-80d6-31717cde97ef None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:32:47.215132 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877a3b6a-0510-4315-b906-e4cfee337345 None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:32:47.215351 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cf8a50-41ef-4ca5-87c2-6fa6275007e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:32:47.215984 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cf8a50-41ef-4ca5-87c2-6fa6275007e5 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:47.216266 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cf8a50-41ef-4ca5-87c2-6fa6275007e5 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:47.216550 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cf8a50-41ef-4ca5-87c2-6fa6275007e5 None admin] PATH_INFO: `/v3/projects/354a816414fb4c1d8f99d5307047be89` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:47.223244 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cf8a50-41ef-4ca5-87c2-6fa6275007e5 None admin] RBAC: Authorizing `identity:get_project(project_id=354a816414fb4c1d8f99d5307047be89)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:32:47.224709 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cf8a50-41ef-4ca5-87c2-6fa6275007e5 None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:32:47.228900 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 115/229] 10.222.0.26 () {56 vars in 1186 bytes} [Wed Aug 24 05:32:47 2022] GET /identity/v3/projects/354a816414fb4c1d8f99d5307047be89 => generated 302 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:32:47.233156 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cf8a50-41ef-4ca5-87c2-6fa6275007e5 None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:32:47.290646 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9120ca-f95d-404c-bf54-e358a1190b57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:32:47.291672 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9120ca-f95d-404c-bf54-e358a1190b57 None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:47.292425 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9120ca-f95d-404c-bf54-e358a1190b57 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:47.292898 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9120ca-f95d-404c-bf54-e358a1190b57 None admin] PATH_INFO: `/v3/roles` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:47.293766 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9120ca-f95d-404c-bf54-e358a1190b57 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:32:47.294280 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9120ca-f95d-404c-bf54-e358a1190b57 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:32:47.295878 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9120ca-f95d-404c-bf54-e358a1190b57 None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:32:47.313247 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 115/230] 10.222.0.26 () {56 vars in 1111 bytes} [Wed Aug 24 05:32:46 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 353 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:32:47.326932 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9120ca-f95d-404c-bf54-e358a1190b57 None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:32:47.357238 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cf8a50-41ef-4ca5-87c2-6fa6275007e5 None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:32:47.393708 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339ee237-9092-4b15-9183-5093a583d554 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:32:47.394452 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339ee237-9092-4b15-9183-5093a583d554 None admin] REQUEST_METHOD: `PUT` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:47.395247 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339ee237-9092-4b15-9183-5093a583d554 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:47.395522 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339ee237-9092-4b15-9183-5093a583d554 None admin] PATH_INFO: `/v3/projects/354a816414fb4c1d8f99d5307047be89/users/a2f283ad42644e4d81b1009117055350/roles/640bda0879494e60b72680ee505285f0` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:47.397623 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339ee237-9092-4b15-9183-5093a583d554 None admin] RBAC: Authorizing `identity:create_grant(project_id=354a816414fb4c1d8f99d5307047be89, user_id=a2f283ad42644e4d81b1009117055350, role_id=640bda0879494e60b72680ee505285f0)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:32:47.399252 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339ee237-9092-4b15-9183-5093a583d554 None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:32:47.416019 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 116/231] 10.222.0.26 () {58 vars in 1439 bytes} [Wed Aug 24 05:32:47 2022] PUT /identity/v3/projects/354a816414fb4c1d8f99d5307047be89/users/a2f283ad42644e4d81b1009117055350/roles/640bda0879494e60b72680ee505285f0 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:32:47.497835 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9120ca-f95d-404c-bf54-e358a1190b57 None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:32:47.514701 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:32:47.538303 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf4d971-14fc-438a-b0a4-cfec3c40b9ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:32:47.539015 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf4d971-14fc-438a-b0a4-cfec3c40b9ff None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:47.539305 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf4d971-14fc-438a-b0a4-cfec3c40b9ff None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:47.539583 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf4d971-14fc-438a-b0a4-cfec3c40b9ff None admin] PATH_INFO: `/v3/users/a2f283ad42644e4d81b1009117055350` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:47.540869 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf4d971-14fc-438a-b0a4-cfec3c40b9ff None admin] RBAC: Authorizing `identity:get_user(user_id=a2f283ad42644e4d81b1009117055350)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:32:47.542729 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf4d971-14fc-438a-b0a4-cfec3c40b9ff None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:32:47.544779 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 116/232] 10.222.0.26 () {56 vars in 1177 bytes} [Wed Aug 24 05:32:47 2022] GET /identity/v3/users/a2f283ad42644e4d81b1009117055350 => generated 283 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:32:47.550403 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339ee237-9092-4b15-9183-5093a583d554 None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:32:47.570392 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:32:47.664188 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339ee237-9092-4b15-9183-5093a583d554 None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:32:47.701008 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e03793a-3d67-4df3-a799-21b6f1d7b207 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:32:47.703050 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e03793a-3d67-4df3-a799-21b6f1d7b207 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:47.703050 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e03793a-3d67-4df3-a799-21b6f1d7b207 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:47.703050 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e03793a-3d67-4df3-a799-21b6f1d7b207 None admin] PATH_INFO: `/v3/projects/354a816414fb4c1d8f99d5307047be89` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:47.703467 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e03793a-3d67-4df3-a799-21b6f1d7b207 None admin] RBAC: Authorizing `identity:get_project(project_id=354a816414fb4c1d8f99d5307047be89)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:32:47.705104 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e03793a-3d67-4df3-a799-21b6f1d7b207 None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:32:47.707040 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 117/233] 10.222.0.26 () {56 vars in 1186 bytes} [Wed Aug 24 05:32:47 2022] GET /identity/v3/projects/354a816414fb4c1d8f99d5307047be89 => generated 302 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:32:47.712919 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf4d971-14fc-438a-b0a4-cfec3c40b9ff None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:32:47.826054 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf4d971-14fc-438a-b0a4-cfec3c40b9ff None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:32:47.856974 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834eb5ab-d2a1-4b2b-a862-4b586a7e5fe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:32:47.857642 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834eb5ab-d2a1-4b2b-a862-4b586a7e5fe8 None admin] REQUEST_METHOD: `PUT` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:47.857976 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834eb5ab-d2a1-4b2b-a862-4b586a7e5fe8 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:47.858261 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834eb5ab-d2a1-4b2b-a862-4b586a7e5fe8 None admin] PATH_INFO: `/v3/projects/354a816414fb4c1d8f99d5307047be89/users/a2f283ad42644e4d81b1009117055350/roles/109c3556f4644bd291e81b0aa7fe2598` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:47.864713 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834eb5ab-d2a1-4b2b-a862-4b586a7e5fe8 None admin] RBAC: Authorizing `identity:create_grant(project_id=354a816414fb4c1d8f99d5307047be89, user_id=a2f283ad42644e4d81b1009117055350, role_id=109c3556f4644bd291e81b0aa7fe2598)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:32:47.864713 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834eb5ab-d2a1-4b2b-a862-4b586a7e5fe8 None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:32:47.881220 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 117/234] 10.222.0.26 () {58 vars in 1439 bytes} [Wed Aug 24 05:32:47 2022] PUT /identity/v3/projects/354a816414fb4c1d8f99d5307047be89/users/a2f283ad42644e4d81b1009117055350/roles/109c3556f4644bd291e81b0aa7fe2598 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:32:48.292307 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266d1e01-36e2-4206-87b2-808578376775 None None] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:48.292307 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266d1e01-36e2-4206-87b2-808578376775 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:48.292307 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266d1e01-36e2-4206-87b2-808578376775 None None] PATH_INFO: `/` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:48.292307 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 118/235] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 24 05:32:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:32:48.299376 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebdd587-af6f-4210-81ef-a69307bd6473 None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:48.299673 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebdd587-af6f-4210-81ef-a69307bd6473 None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:48.299924 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebdd587-af6f-4210-81ef-a69307bd6473 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:48.323454 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-bebdd587-af6f-4210-81ef-a69307bd6473 None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:32:48.324643 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-bebdd587-af6f-4210-81ef-a69307bd6473 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:32:48.374201 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:32:48.420852 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 118/236] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 24 05:32:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 05:32:48.610326 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195b88ce-6663-49f8-a169-cee39ecb7cdf None None] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:48.610619 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195b88ce-6663-49f8-a169-cee39ecb7cdf None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:48.610797 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195b88ce-6663-49f8-a169-cee39ecb7cdf None None] PATH_INFO: `/` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:48.612769 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 119/237] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 24 05:32:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:32:48.627491 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee832f81-33b6-4c6f-8567-ba10aa2c18a6 None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:48.627962 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee832f81-33b6-4c6f-8567-ba10aa2c18a6 None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:48.628035 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee832f81-33b6-4c6f-8567-ba10aa2c18a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:48.657994 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-ee832f81-33b6-4c6f-8567-ba10aa2c18a6 None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:32:48.657994 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-ee832f81-33b6-4c6f-8567-ba10aa2c18a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:32:48.736573 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 119/238] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 24 05:32:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 05:32:48.810206 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195b88ce-6663-49f8-a169-cee39ecb7cdf None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:32:48.923485 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:32:48.952773 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195b88ce-6663-49f8-a169-cee39ecb7cdf None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:32:48.987546 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c006c9-7caa-4e95-ae40-3f728a411223 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:32:48.988728 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c006c9-7caa-4e95-ae40-3f728a411223 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:48.989010 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c006c9-7caa-4e95-ae40-3f728a411223 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:48.989280 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c006c9-7caa-4e95-ae40-3f728a411223 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:48.999600 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c006c9-7caa-4e95-ae40-3f728a411223 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:32:49.004885 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application [None req-40c006c9-7caa-4e95-ae40-3f728a411223 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 05:32:49.004885 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:32:49.004885 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:32:49.004885 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:32:49.004885 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:32:49.004885 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:32:49.004885 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:32:49.004885 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:32:49.004885 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:32:49.004885 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:32:49.004885 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:32:49.004885 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:32:49.004885 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:32:49.004885 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:32:49.004885 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:32:49.004885 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:32:49.005731 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:32:49.005731 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:32:49.005731 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:32:49.005731 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:32:49.005731 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:32:49.005731 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:32:49.005731 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:32:49.005731 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:32:49.005731 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:32:49.005731 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:32:49.005731 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:32:49.005731 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application with Lock( Aug 24 05:32:49.005731 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:32:49.005731 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:32:49.005731 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:32:49.005731 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:32:49.006926 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:32:49.006926 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:32:49.006926 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:32:49.006926 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:32:49.006926 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:32:49.006926 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:32:49.006926 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:32:49.006926 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:32:49.006926 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:32:49.006926 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:32:49.006926 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 05:32:49.006926 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Aug 24 05:32:49.006926 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 120/239] 10.222.0.26 () {56 vars in 1099 bytes} [Wed Aug 24 05:32:48 2022] GET /identity/v3/roles/reader => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:32:49.015395 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee832f81-33b6-4c6f-8567-ba10aa2c18a6 None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:32:49.042270 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c006c9-7caa-4e95-ae40-3f728a411223 None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:32:49.185717 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee832f81-33b6-4c6f-8567-ba10aa2c18a6 None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:32:49.187768 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:32:49.191780 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c006c9-7caa-4e95-ae40-3f728a411223 None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:32:49.227899 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06588cee-e47f-45b8-bbc4-68be94970457 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:32:49.228698 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06588cee-e47f-45b8-bbc4-68be94970457 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:49.229043 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06588cee-e47f-45b8-bbc4-68be94970457 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:49.229384 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06588cee-e47f-45b8-bbc4-68be94970457 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:49.229846 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f05c51b-fb6e-47b0-a47c-713c231441ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:32:49.230605 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f05c51b-fb6e-47b0-a47c-713c231441ca None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:49.230712 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06588cee-e47f-45b8-bbc4-68be94970457 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:32:49.230931 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f05c51b-fb6e-47b0-a47c-713c231441ca None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:49.231210 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f05c51b-fb6e-47b0-a47c-713c231441ca None admin] PATH_INFO: `/v3/roles` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:49.231904 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f05c51b-fb6e-47b0-a47c-713c231441ca None admin] RBAC: Adding query filter params (name=reader) {{(pid=88112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:32:49.232208 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f05c51b-fb6e-47b0-a47c-713c231441ca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:32:49.232500 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06588cee-e47f-45b8-bbc4-68be94970457 None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:32:49.233619 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f05c51b-fb6e-47b0-a47c-713c231441ca None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:32:49.239071 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 121/240] 10.222.0.26 () {56 vars in 1108 bytes} [Wed Aug 24 05:32:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:32:49.240565 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a82e76c-7714-4add-bb15-c5688c58a0fa None None] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:49.240920 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a82e76c-7714-4add-bb15-c5688c58a0fa None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:49.241262 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a82e76c-7714-4add-bb15-c5688c58a0fa None None] PATH_INFO: `/` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:49.242924 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 122/241] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 24 05:32:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:32:49.243444 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 120/242] 10.222.0.26 () {56 vars in 1101 bytes} [Wed Aug 24 05:32:49 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:32:49.243739 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a82e76c-7714-4add-bb15-c5688c58a0fa None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:32:49.248835 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f05c51b-fb6e-47b0-a47c-713c231441ca None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:32:49.250525 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:32:49.351123 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a82e76c-7714-4add-bb15-c5688c58a0fa None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:32:49.356270 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f05c51b-fb6e-47b0-a47c-713c231441ca None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:32:49.384741 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b966a1e-6a7b-43b0-bb63-7706e0998a6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:32:49.385607 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b966a1e-6a7b-43b0-bb63-7706e0998a6b None admin] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:49.386074 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b966a1e-6a7b-43b0-bb63-7706e0998a6b None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:49.386527 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b966a1e-6a7b-43b0-bb63-7706e0998a6b None admin] PATH_INFO: `/v3/users` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:49.387321 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b966a1e-6a7b-43b0-bb63-7706e0998a6b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:32:49.388966 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b966a1e-6a7b-43b0-bb63-7706e0998a6b None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:32:49.392377 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34199d2-c0af-43af-aaf7-5672e4ac3702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:32:49.393063 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34199d2-c0af-43af-aaf7-5672e4ac3702 None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:49.393346 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34199d2-c0af-43af-aaf7-5672e4ac3702 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:49.393619 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34199d2-c0af-43af-aaf7-5672e4ac3702 None admin] PATH_INFO: `/v3/users/df6b0181ce9346a48b86b7d1d3d55d70` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:49.409273 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34199d2-c0af-43af-aaf7-5672e4ac3702 None admin] RBAC: Authorizing `identity:get_user(user_id=df6b0181ce9346a48b86b7d1d3d55d70)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:32:49.411441 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34199d2-c0af-43af-aaf7-5672e4ac3702 None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:32:49.413169 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 121/243] 10.222.0.26 () {56 vars in 1177 bytes} [Wed Aug 24 05:32:49 2022] GET /identity/v3/users/df6b0181ce9346a48b86b7d1d3d55d70 => generated 297 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:32:49.415261 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 123/244] 10.222.0.26 () {60 vars in 1132 bytes} [Wed Aug 24 05:32:49 2022] POST /identity/v3/users => generated 293 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:32:49.422021 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90de2fce-333a-43db-ba4d-96b680d0c9db None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:49.422021 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90de2fce-333a-43db-ba4d-96b680d0c9db None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:49.422021 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90de2fce-333a-43db-ba4d-96b680d0c9db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:49.423493 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b966a1e-6a7b-43b0-bb63-7706e0998a6b None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:32:49.439874 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-90de2fce-333a-43db-ba4d-96b680d0c9db None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:32:49.441238 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-90de2fce-333a-43db-ba4d-96b680d0c9db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:32:49.461069 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:32:49.516821 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 122/245] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 24 05:32:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 05:32:49.548852 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:32:49.586920 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b966a1e-6a7b-43b0-bb63-7706e0998a6b None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:32:49.623642 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc6bc0a-79c4-4b03-abd4-005d3a3d8f67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:32:49.624442 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc6bc0a-79c4-4b03-abd4-005d3a3d8f67 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:49.625022 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc6bc0a-79c4-4b03-abd4-005d3a3d8f67 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:49.625414 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc6bc0a-79c4-4b03-abd4-005d3a3d8f67 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:49.699802 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc6bc0a-79c4-4b03-abd4-005d3a3d8f67 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:32:49.701375 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc6bc0a-79c4-4b03-abd4-005d3a3d8f67 None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:32:49.774337 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:32:49.805564 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 124/246] 10.222.0.26 () {58 vars in 1282 bytes} [Wed Aug 24 05:32:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 05:32:49.811224 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90de2fce-333a-43db-ba4d-96b680d0c9db None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:32:49.903147 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc6bc0a-79c4-4b03-abd4-005d3a3d8f67 None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:32:49.923649 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90de2fce-333a-43db-ba4d-96b680d0c9db None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:32:49.961338 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15de057-a14e-4c4d-98d8-b2a65a7ff7d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:32:49.961893 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15de057-a14e-4c4d-98d8-b2a65a7ff7d2 None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:49.962218 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15de057-a14e-4c4d-98d8-b2a65a7ff7d2 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:49.962488 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15de057-a14e-4c4d-98d8-b2a65a7ff7d2 None admin] PATH_INFO: `/v3/projects/354a816414fb4c1d8f99d5307047be89` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:49.965445 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15de057-a14e-4c4d-98d8-b2a65a7ff7d2 None admin] RBAC: Authorizing `identity:get_project(project_id=354a816414fb4c1d8f99d5307047be89)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:32:49.966936 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15de057-a14e-4c4d-98d8-b2a65a7ff7d2 None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:32:49.968802 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 123/247] 10.222.0.26 () {56 vars in 1186 bytes} [Wed Aug 24 05:32:49 2022] GET /identity/v3/projects/354a816414fb4c1d8f99d5307047be89 => generated 302 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:32:49.978973 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15de057-a14e-4c4d-98d8-b2a65a7ff7d2 None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:32:50.002978 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:32:50.040859 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc6bc0a-79c4-4b03-abd4-005d3a3d8f67 None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:32:50.085337 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97ec755-d936-4794-baac-88bf1dd21927 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:32:50.085990 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97ec755-d936-4794-baac-88bf1dd21927 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:50.086279 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97ec755-d936-4794-baac-88bf1dd21927 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:50.086553 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97ec755-d936-4794-baac-88bf1dd21927 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:50.099843 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97ec755-d936-4794-baac-88bf1dd21927 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:32:50.103268 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15de057-a14e-4c4d-98d8-b2a65a7ff7d2 None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:32:50.105994 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application [None req-a97ec755-d936-4794-baac-88bf1dd21927 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 05:32:50.105994 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:32:50.105994 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:32:50.105994 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:32:50.105994 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:32:50.105994 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:32:50.105994 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:32:50.105994 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:32:50.105994 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:32:50.105994 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:32:50.105994 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:32:50.105994 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:32:50.105994 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:32:50.105994 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:32:50.105994 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:32:50.105994 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:32:50.107673 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:32:50.107673 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:32:50.107673 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:32:50.107673 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:32:50.107673 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:32:50.107673 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:32:50.107673 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:32:50.107673 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:32:50.107673 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:32:50.107673 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:32:50.107673 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:32:50.107673 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application with Lock( Aug 24 05:32:50.107673 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:32:50.107673 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:32:50.107673 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:32:50.107673 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:32:50.109329 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:32:50.109329 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:32:50.109329 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:32:50.109329 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:32:50.109329 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:32:50.109329 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:32:50.109329 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:32:50.109329 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:32:50.109329 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:32:50.109329 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:32:50.109329 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 05:32:50.109329 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Aug 24 05:32:50.109329 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 125/248] 10.222.0.26 () {56 vars in 1099 bytes} [Wed Aug 24 05:32:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 05:32:50.117180 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97ec755-d936-4794-baac-88bf1dd21927 None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:32:50.140198 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:32:50.153221 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf01f6b1-a1ec-4df6-9559-932faed80195 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:32:50.153785 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf01f6b1-a1ec-4df6-9559-932faed80195 None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:50.154151 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf01f6b1-a1ec-4df6-9559-932faed80195 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:50.154425 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf01f6b1-a1ec-4df6-9559-932faed80195 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:50.155152 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf01f6b1-a1ec-4df6-9559-932faed80195 None admin] RBAC: Adding query filter params (role.id=129798c59b2c43978b555869931dada4, scope.project.id=354a816414fb4c1d8f99d5307047be89, user.id=df6b0181ce9346a48b86b7d1d3d55d70) {{(pid=88112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:32:50.155783 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf01f6b1-a1ec-4df6-9559-932faed80195 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:32:50.156886 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf01f6b1-a1ec-4df6-9559-932faed80195 None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:32:50.166807 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 124/249] 10.222.0.26 () {56 vars in 1374 bytes} [Wed Aug 24 05:32:49 2022] GET /identity/v3/role_assignments?user.id=df6b0181ce9346a48b86b7d1d3d55d70&scope.project.id=354a816414fb4c1d8f99d5307047be89&role.id=129798c59b2c43978b555869931dada4 => generated 259 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:32:50.167994 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167e8a4f-8766-41cf-81ad-c461fd38c3cd None None] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:50.168277 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167e8a4f-8766-41cf-81ad-c461fd38c3cd None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:50.169018 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167e8a4f-8766-41cf-81ad-c461fd38c3cd None None] PATH_INFO: `/` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:50.170574 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 125/250] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 24 05:32:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:32:50.177126 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00263d2-9bff-4169-b745-2c829f251fa2 None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:50.177411 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00263d2-9bff-4169-b745-2c829f251fa2 None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:50.177677 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00263d2-9bff-4169-b745-2c829f251fa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:50.203087 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-f00263d2-9bff-4169-b745-2c829f251fa2 None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:32:50.204337 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-f00263d2-9bff-4169-b745-2c829f251fa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:32:50.280076 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97ec755-d936-4794-baac-88bf1dd21927 None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:32:50.309738 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 126/251] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 24 05:32:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 05:32:50.329378 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8dac16-6256-4104-a017-6506fa3b60aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:32:50.330332 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8dac16-6256-4104-a017-6506fa3b60aa None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:50.330826 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8dac16-6256-4104-a017-6506fa3b60aa None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:50.331234 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8dac16-6256-4104-a017-6506fa3b60aa None admin] PATH_INFO: `/v3/roles` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:50.332710 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8dac16-6256-4104-a017-6506fa3b60aa None admin] RBAC: Adding query filter params (name=member) {{(pid=88113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:32:50.333152 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8dac16-6256-4104-a017-6506fa3b60aa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:32:50.334751 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8dac16-6256-4104-a017-6506fa3b60aa None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:32:50.346760 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 126/252] 10.222.0.26 () {56 vars in 1101 bytes} [Wed Aug 24 05:32:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:32:50.352694 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00263d2-9bff-4169-b745-2c829f251fa2 None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:32:50.357835 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308863a4-333a-47d2-b12d-89e4132da320 None None] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:50.358648 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308863a4-333a-47d2-b12d-89e4132da320 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:50.360186 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308863a4-333a-47d2-b12d-89e4132da320 None None] PATH_INFO: `/` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:50.361725 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 127/253] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 24 05:32:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 05:32:50.367829 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c55b3a2-b561-4acf-9a54-f8d0c5719710 None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:50.368291 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c55b3a2-b561-4acf-9a54-f8d0c5719710 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:50.368704 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c55b3a2-b561-4acf-9a54-f8d0c5719710 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:50.374747 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:32:50.392235 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-0c55b3a2-b561-4acf-9a54-f8d0c5719710 None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:32:50.393430 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-0c55b3a2-b561-4acf-9a54-f8d0c5719710 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:32:50.491247 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 128/254] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 24 05:32:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 05:32:50.538831 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00263d2-9bff-4169-b745-2c829f251fa2 None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:32:50.585021 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ca2f4a-22db-41b7-8836-e5fd2bb961ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:32:50.585655 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ca2f4a-22db-41b7-8836-e5fd2bb961ef None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:50.585926 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ca2f4a-22db-41b7-8836-e5fd2bb961ef None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:50.586224 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ca2f4a-22db-41b7-8836-e5fd2bb961ef None admin] PATH_INFO: `/v3/users/677a3f88f74c4cb0812021cd878d8a8d` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:50.587389 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ca2f4a-22db-41b7-8836-e5fd2bb961ef None admin] RBAC: Authorizing `identity:get_user(user_id=677a3f88f74c4cb0812021cd878d8a8d)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:32:50.588831 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ca2f4a-22db-41b7-8836-e5fd2bb961ef None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:32:50.590776 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 127/255] 10.222.0.26 () {56 vars in 1177 bytes} [Wed Aug 24 05:32:50 2022] GET /identity/v3/users/677a3f88f74c4cb0812021cd878d8a8d => generated 297 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:32:50.598203 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c55b3a2-b561-4acf-9a54-f8d0c5719710 None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:32:50.615123 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:32:50.713993 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ca2f4a-22db-41b7-8836-e5fd2bb961ef None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:32:50.730781 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c55b3a2-b561-4acf-9a54-f8d0c5719710 None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:32:50.810754 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee6e547-edf1-4cad-91c5-d6b871b57fd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:32:50.811326 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee6e547-edf1-4cad-91c5-d6b871b57fd8 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:50.811608 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee6e547-edf1-4cad-91c5-d6b871b57fd8 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:50.811878 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee6e547-edf1-4cad-91c5-d6b871b57fd8 None admin] PATH_INFO: `/v3/projects/354a816414fb4c1d8f99d5307047be89` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:50.813047 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee6e547-edf1-4cad-91c5-d6b871b57fd8 None admin] RBAC: Authorizing `identity:get_project(project_id=354a816414fb4c1d8f99d5307047be89)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:32:50.814549 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee6e547-edf1-4cad-91c5-d6b871b57fd8 None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:32:50.817037 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 129/256] 10.222.0.26 () {56 vars in 1186 bytes} [Wed Aug 24 05:32:50 2022] GET /identity/v3/projects/354a816414fb4c1d8f99d5307047be89 => generated 302 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:32:50.823274 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee6e547-edf1-4cad-91c5-d6b871b57fd8 None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:32:50.886300 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:32:50.940125 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ca2f4a-22db-41b7-8836-e5fd2bb961ef None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:32:50.997088 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:32:51.027758 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f68b28-090f-439e-92c4-31cf06567ebf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:32:51.028404 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f68b28-090f-439e-92c4-31cf06567ebf None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:51.028685 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f68b28-090f-439e-92c4-31cf06567ebf None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:51.028959 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f68b28-090f-439e-92c4-31cf06567ebf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:51.034422 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee6e547-edf1-4cad-91c5-d6b871b57fd8 None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:32:51.049274 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f68b28-090f-439e-92c4-31cf06567ebf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:32:51.054920 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application [None req-17f68b28-090f-439e-92c4-31cf06567ebf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 05:32:51.054920 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:32:51.054920 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:32:51.054920 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:32:51.054920 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:32:51.054920 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:32:51.054920 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:32:51.054920 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:32:51.054920 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:32:51.054920 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:32:51.054920 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:32:51.054920 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:32:51.054920 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:32:51.054920 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:32:51.054920 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:32:51.054920 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:32:51.055767 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:32:51.055767 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:32:51.055767 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:32:51.055767 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:32:51.055767 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:32:51.055767 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:32:51.055767 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:32:51.055767 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:32:51.055767 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:32:51.055767 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:32:51.055767 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:32:51.055767 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application with Lock( Aug 24 05:32:51.055767 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:32:51.055767 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:32:51.055767 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:32:51.055767 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:32:51.056533 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:32:51.056533 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:32:51.056533 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:32:51.056533 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:32:51.056533 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:32:51.056533 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:32:51.056533 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:32:51.056533 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:32:51.056533 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:32:51.056533 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:32:51.056533 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 05:32:51.056533 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Aug 24 05:32:51.056533 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 128/257] 10.222.0.26 () {56 vars in 1096 bytes} [Wed Aug 24 05:32:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 343 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:32:51.057170 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f68b28-090f-439e-92c4-31cf06567ebf None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:32:51.110746 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59991413-da04-470b-9b30-ca5e77519502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:32:51.111332 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59991413-da04-470b-9b30-ca5e77519502 None admin] REQUEST_METHOD: `PUT` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:51.111611 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59991413-da04-470b-9b30-ca5e77519502 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:51.111887 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59991413-da04-470b-9b30-ca5e77519502 None admin] PATH_INFO: `/v3/projects/354a816414fb4c1d8f99d5307047be89/users/677a3f88f74c4cb0812021cd878d8a8d/roles/f7aa4a2c74c94c1b9ca8ecdcccccda5c` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:51.115957 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59991413-da04-470b-9b30-ca5e77519502 None admin] RBAC: Authorizing `identity:create_grant(project_id=354a816414fb4c1d8f99d5307047be89, user_id=677a3f88f74c4cb0812021cd878d8a8d, role_id=f7aa4a2c74c94c1b9ca8ecdcccccda5c)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:32:51.117418 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59991413-da04-470b-9b30-ca5e77519502 None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:32:51.142898 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 130/258] 10.222.0.26 () {58 vars in 1439 bytes} [Wed Aug 24 05:32:50 2022] PUT /identity/v3/projects/354a816414fb4c1d8f99d5307047be89/users/677a3f88f74c4cb0812021cd878d8a8d/roles/f7aa4a2c74c94c1b9ca8ecdcccccda5c => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:32:51.143859 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59991413-da04-470b-9b30-ca5e77519502 None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:32:51.206790 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f68b28-090f-439e-92c4-31cf06567ebf None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:32:51.244994 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13404f41-ac8d-411d-9800-50b7432096e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:32:51.245762 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13404f41-ac8d-411d-9800-50b7432096e7 None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:51.246149 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13404f41-ac8d-411d-9800-50b7432096e7 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:51.246522 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13404f41-ac8d-411d-9800-50b7432096e7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:51.258359 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13404f41-ac8d-411d-9800-50b7432096e7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:32:51.263319 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application [None req-13404f41-ac8d-411d-9800-50b7432096e7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 05:32:51.263319 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:32:51.263319 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:32:51.263319 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:32:51.263319 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:32:51.263319 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:32:51.263319 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:32:51.263319 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:32:51.263319 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:32:51.263319 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:32:51.263319 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:32:51.263319 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:32:51.263319 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:32:51.263319 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:32:51.263319 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:32:51.263319 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:32:51.264237 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:32:51.264237 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:32:51.264237 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:32:51.264237 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:32:51.264237 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:32:51.264237 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:32:51.264237 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:32:51.264237 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:32:51.264237 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:32:51.264237 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:32:51.264237 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:32:51.264237 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application with Lock( Aug 24 05:32:51.264237 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:32:51.264237 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:32:51.264237 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:32:51.264237 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:32:51.265052 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:32:51.265052 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:32:51.265052 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:32:51.265052 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:32:51.265052 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:32:51.265052 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:32:51.265052 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:32:51.265052 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:32:51.265052 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:32:51.265052 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:32:51.265052 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 05:32:51.265052 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Aug 24 05:32:51.265052 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 129/259] 10.222.0.26 () {56 vars in 1114 bytes} [Wed Aug 24 05:32:51 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:32:51.275183 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13404f41-ac8d-411d-9800-50b7432096e7 None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:32:51.302326 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:32:51.383713 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59991413-da04-470b-9b30-ca5e77519502 None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:32:51.444850 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89f50e0-970b-47d8-a2a9-1090814409ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:32:51.445837 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89f50e0-970b-47d8-a2a9-1090814409ae None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:51.446332 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89f50e0-970b-47d8-a2a9-1090814409ae None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:51.446791 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89f50e0-970b-47d8-a2a9-1090814409ae None admin] PATH_INFO: `/v3/roles` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:51.447800 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89f50e0-970b-47d8-a2a9-1090814409ae None admin] RBAC: Adding query filter params (name=admin) {{(pid=88113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:32:51.448473 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89f50e0-970b-47d8-a2a9-1090814409ae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:32:51.450077 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89f50e0-970b-47d8-a2a9-1090814409ae None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:32:51.451076 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13404f41-ac8d-411d-9800-50b7432096e7 None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:32:51.459751 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:32:51.464453 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 131/260] 10.222.0.26 () {56 vars in 1099 bytes} [Wed Aug 24 05:32:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:32:51.491834 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89f50e0-970b-47d8-a2a9-1090814409ae None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:32:51.499182 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1106f0f-fbe2-43c6-952d-ec8bb3542e41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:32:51.499810 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1106f0f-fbe2-43c6-952d-ec8bb3542e41 None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:51.500092 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1106f0f-fbe2-43c6-952d-ec8bb3542e41 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:51.500366 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1106f0f-fbe2-43c6-952d-ec8bb3542e41 None admin] PATH_INFO: `/v3/roles` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:51.501051 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1106f0f-fbe2-43c6-952d-ec8bb3542e41 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:32:51.501357 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1106f0f-fbe2-43c6-952d-ec8bb3542e41 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:32:51.506000 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1106f0f-fbe2-43c6-952d-ec8bb3542e41 None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:32:51.512437 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 130/261] 10.222.0.26 () {56 vars in 1111 bytes} [Wed Aug 24 05:32:51 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:32:51.517448 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1106f0f-fbe2-43c6-952d-ec8bb3542e41 None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:32:51.595585 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:32:51.623153 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89f50e0-970b-47d8-a2a9-1090814409ae None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:32:51.666736 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1106f0f-fbe2-43c6-952d-ec8bb3542e41 None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:32:51.669964 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1b52cd-a810-4cca-af28-6f4593635d0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:32:51.670616 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1b52cd-a810-4cca-af28-6f4593635d0f None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:51.670892 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1b52cd-a810-4cca-af28-6f4593635d0f None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:51.671160 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1b52cd-a810-4cca-af28-6f4593635d0f None admin] PATH_INFO: `/v3/users/a2f283ad42644e4d81b1009117055350` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:51.673083 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1b52cd-a810-4cca-af28-6f4593635d0f None admin] RBAC: Authorizing `identity:get_user(user_id=a2f283ad42644e4d81b1009117055350)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:32:51.674563 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1b52cd-a810-4cca-af28-6f4593635d0f None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:32:51.676697 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 132/262] 10.222.0.26 () {56 vars in 1177 bytes} [Wed Aug 24 05:32:51 2022] GET /identity/v3/users/a2f283ad42644e4d81b1009117055350 => generated 283 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:32:51.688603 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1b52cd-a810-4cca-af28-6f4593635d0f None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:32:51.752534 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b96d957-59c3-4981-9b6a-46ee2fba2981 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:32:51.753221 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b96d957-59c3-4981-9b6a-46ee2fba2981 None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:51.753522 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b96d957-59c3-4981-9b6a-46ee2fba2981 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:51.753803 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b96d957-59c3-4981-9b6a-46ee2fba2981 None admin] PATH_INFO: `/v3/users/a2f283ad42644e4d81b1009117055350` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:51.759104 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b96d957-59c3-4981-9b6a-46ee2fba2981 None admin] RBAC: Authorizing `identity:get_user(user_id=a2f283ad42644e4d81b1009117055350)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:32:51.760859 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b96d957-59c3-4981-9b6a-46ee2fba2981 None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:32:51.763177 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 131/263] 10.222.0.26 () {56 vars in 1177 bytes} [Wed Aug 24 05:32:51 2022] GET /identity/v3/users/a2f283ad42644e4d81b1009117055350 => generated 283 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:32:51.769324 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b96d957-59c3-4981-9b6a-46ee2fba2981 None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:32:51.843433 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:32:51.927596 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1b52cd-a810-4cca-af28-6f4593635d0f None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:32:51.977035 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b96d957-59c3-4981-9b6a-46ee2fba2981 None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:32:52.003328 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07638e85-63eb-475f-990f-bc9a01335583 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:32:52.004317 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07638e85-63eb-475f-990f-bc9a01335583 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:52.004805 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07638e85-63eb-475f-990f-bc9a01335583 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:52.005309 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07638e85-63eb-475f-990f-bc9a01335583 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:52.051440 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:32:52.070598 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb975ca1-5951-468c-86b7-085fac8fd0ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:32:52.071416 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb975ca1-5951-468c-86b7-085fac8fd0ba None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:52.071843 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb975ca1-5951-468c-86b7-085fac8fd0ba None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:52.072286 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb975ca1-5951-468c-86b7-085fac8fd0ba None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:52.129678 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07638e85-63eb-475f-990f-bc9a01335583 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:32:52.131387 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07638e85-63eb-475f-990f-bc9a01335583 None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:32:52.198736 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb975ca1-5951-468c-86b7-085fac8fd0ba None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:32:52.203613 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb975ca1-5951-468c-86b7-085fac8fd0ba None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:32:52.326987 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 133/264] 10.222.0.26 () {58 vars in 1282 bytes} [Wed Aug 24 05:32:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 639 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 05:32:52.330631 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:32:52.333054 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07638e85-63eb-475f-990f-bc9a01335583 None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:32:52.365458 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 132/265] 10.222.0.26 () {58 vars in 1282 bytes} [Wed Aug 24 05:32:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 597 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 05:32:52.370951 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb975ca1-5951-468c-86b7-085fac8fd0ba None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:32:52.411018 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:32:52.528730 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07638e85-63eb-475f-990f-bc9a01335583 None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:32:52.560813 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb975ca1-5951-468c-86b7-085fac8fd0ba None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:32:52.622672 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce24c032-99ad-4972-a811-eca40945f367 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:32:52.623319 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce24c032-99ad-4972-a811-eca40945f367 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:52.623605 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce24c032-99ad-4972-a811-eca40945f367 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:52.623877 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce24c032-99ad-4972-a811-eca40945f367 None admin] PATH_INFO: `/v3/projects/354a816414fb4c1d8f99d5307047be89` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:52.625112 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce24c032-99ad-4972-a811-eca40945f367 None admin] RBAC: Authorizing `identity:get_project(project_id=354a816414fb4c1d8f99d5307047be89)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:32:52.626664 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce24c032-99ad-4972-a811-eca40945f367 None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:32:52.628316 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 134/266] 10.222.0.26 () {56 vars in 1186 bytes} [Wed Aug 24 05:32:52 2022] GET /identity/v3/projects/354a816414fb4c1d8f99d5307047be89 => generated 302 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:32:52.634055 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc385f49-9d8c-47b4-abd6-1c9dd495280e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:32:52.634619 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce24c032-99ad-4972-a811-eca40945f367 None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:32:52.634730 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc385f49-9d8c-47b4-abd6-1c9dd495280e None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:52.634991 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc385f49-9d8c-47b4-abd6-1c9dd495280e None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:52.635239 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc385f49-9d8c-47b4-abd6-1c9dd495280e None admin] PATH_INFO: `/v3/projects/354a816414fb4c1d8f99d5307047be89` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:52.640929 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc385f49-9d8c-47b4-abd6-1c9dd495280e None admin] RBAC: Authorizing `identity:get_project(project_id=354a816414fb4c1d8f99d5307047be89)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:32:52.642454 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc385f49-9d8c-47b4-abd6-1c9dd495280e None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:32:52.644825 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 133/267] 10.222.0.26 () {56 vars in 1186 bytes} [Wed Aug 24 05:32:52 2022] GET /identity/v3/projects/354a816414fb4c1d8f99d5307047be89 => generated 302 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:32:52.645980 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2a8a14-77b0-4bce-abcd-049142abdf12 None None] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:52.646259 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2a8a14-77b0-4bce-abcd-049142abdf12 None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:52.646528 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2a8a14-77b0-4bce-abcd-049142abdf12 None None] PATH_INFO: `/` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:52.647978 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 134/268] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 24 05:32:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:32:52.651909 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2a8a14-77b0-4bce-abcd-049142abdf12 None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:32:52.686498 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:32:52.757582 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce24c032-99ad-4972-a811-eca40945f367 None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:32:52.802188 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff511820-290b-4ed1-a70a-67bea4f0b74b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:32:52.803503 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff511820-290b-4ed1-a70a-67bea4f0b74b None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:52.803984 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff511820-290b-4ed1-a70a-67bea4f0b74b None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:52.804449 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff511820-290b-4ed1-a70a-67bea4f0b74b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:52.805370 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff511820-290b-4ed1-a70a-67bea4f0b74b None admin] RBAC: Adding query filter params (role.id=640bda0879494e60b72680ee505285f0, scope.project.id=354a816414fb4c1d8f99d5307047be89, user.id=a2f283ad42644e4d81b1009117055350) {{(pid=88113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:32:52.805872 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff511820-290b-4ed1-a70a-67bea4f0b74b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:32:52.807676 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff511820-290b-4ed1-a70a-67bea4f0b74b None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:32:52.815100 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 135/269] 10.222.0.26 () {56 vars in 1374 bytes} [Wed Aug 24 05:32:52 2022] GET /identity/v3/role_assignments?user.id=a2f283ad42644e4d81b1009117055350&scope.project.id=354a816414fb4c1d8f99d5307047be89&role.id=640bda0879494e60b72680ee505285f0 => generated 608 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:32:52.817300 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17796940-0ed1-46f5-8965-1949aeaec6f4 None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:52.817796 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17796940-0ed1-46f5-8965-1949aeaec6f4 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:52.818605 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17796940-0ed1-46f5-8965-1949aeaec6f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:52.867120 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-17796940-0ed1-46f5-8965-1949aeaec6f4 None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:32:52.868365 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-17796940-0ed1-46f5-8965-1949aeaec6f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:32:52.890286 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:32:52.896122 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2a8a14-77b0-4bce-abcd-049142abdf12 None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:32:52.989681 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 136/270] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 24 05:32:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 05:32:52.991329 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a205728a-595a-4997-898c-10be73fa532d None None] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:52.991586 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32950252-5d2f-4045-81f4-a8c579d3b084 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:32:52.992208 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32950252-5d2f-4045-81f4-a8c579d3b084 None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:52.992489 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32950252-5d2f-4045-81f4-a8c579d3b084 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:52.992760 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32950252-5d2f-4045-81f4-a8c579d3b084 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:52.992964 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a205728a-595a-4997-898c-10be73fa532d None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:52.993416 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a205728a-595a-4997-898c-10be73fa532d None None] PATH_INFO: `/` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:52.993514 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32950252-5d2f-4045-81f4-a8c579d3b084 None admin] RBAC: Adding query filter params (role.id=109c3556f4644bd291e81b0aa7fe2598, scope.project.id=354a816414fb4c1d8f99d5307047be89, user.id=a2f283ad42644e4d81b1009117055350) {{(pid=88112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:32:52.993786 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32950252-5d2f-4045-81f4-a8c579d3b084 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:32:52.995142 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 137/271] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 24 05:32:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:32:52.995260 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32950252-5d2f-4045-81f4-a8c579d3b084 None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:32:53.000503 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af928123-59f8-43fa-a0c9-b0873cfbbf00 None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:53.001238 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af928123-59f8-43fa-a0c9-b0873cfbbf00 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:53.001719 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af928123-59f8-43fa-a0c9-b0873cfbbf00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:53.012720 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 135/272] 10.222.0.26 () {56 vars in 1374 bytes} [Wed Aug 24 05:32:52 2022] GET /identity/v3/role_assignments?user.id=a2f283ad42644e4d81b1009117055350&scope.project.id=354a816414fb4c1d8f99d5307047be89&role.id=109c3556f4644bd291e81b0aa7fe2598 => generated 608 bytes in 361 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:32:53.026977 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-af928123-59f8-43fa-a0c9-b0873cfbbf00 None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:32:53.028501 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-af928123-59f8-43fa-a0c9-b0873cfbbf00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:32:53.074424 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:32:53.130784 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 138/273] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 24 05:32:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 05:32:53.138246 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798f9aac-366d-49c9-b0db-3f0fb3069810 None None] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:53.138570 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798f9aac-366d-49c9-b0db-3f0fb3069810 None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:53.138804 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798f9aac-366d-49c9-b0db-3f0fb3069810 None None] PATH_INFO: `/` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:53.140563 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 136/274] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 24 05:32:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:32:53.145845 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb02b5e-8b95-4608-83ee-bb069915afb0 None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:53.146176 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb02b5e-8b95-4608-83ee-bb069915afb0 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:53.146417 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb02b5e-8b95-4608-83ee-bb069915afb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:53.175033 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-1bb02b5e-8b95-4608-83ee-bb069915afb0 None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:32:53.176792 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-1bb02b5e-8b95-4608-83ee-bb069915afb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:32:53.253753 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 139/275] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 24 05:32:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 05:32:53.346670 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798f9aac-366d-49c9-b0db-3f0fb3069810 None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:32:53.438556 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb02b5e-8b95-4608-83ee-bb069915afb0 None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:32:53.464605 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798f9aac-366d-49c9-b0db-3f0fb3069810 None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:32:53.516131 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b5b834-3c3b-4168-9412-403aa0e0c2e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:32:53.516784 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b5b834-3c3b-4168-9412-403aa0e0c2e2 None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:53.517062 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b5b834-3c3b-4168-9412-403aa0e0c2e2 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:53.517331 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b5b834-3c3b-4168-9412-403aa0e0c2e2 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:53.534492 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b5b834-3c3b-4168-9412-403aa0e0c2e2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:32:53.541609 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application [None req-c7b5b834-3c3b-4168-9412-403aa0e0c2e2 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 05:32:53.541609 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:32:53.541609 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:32:53.541609 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:32:53.541609 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:32:53.541609 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:32:53.541609 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:32:53.541609 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:32:53.541609 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:32:53.541609 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:32:53.541609 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:32:53.541609 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:32:53.541609 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:32:53.541609 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:32:53.541609 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:32:53.541609 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:32:53.542726 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:32:53.542726 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:32:53.542726 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:32:53.542726 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:32:53.542726 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:32:53.542726 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:32:53.542726 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:32:53.542726 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:32:53.542726 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:32:53.542726 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:32:53.542726 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:32:53.542726 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application with Lock( Aug 24 05:32:53.542726 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:32:53.542726 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:32:53.542726 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:32:53.542726 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:32:53.543694 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:32:53.543694 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:32:53.543694 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:32:53.543694 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:32:53.543694 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:32:53.543694 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:32:53.543694 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:32:53.543694 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:32:53.543694 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:32:53.543694 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:32:53.543694 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 05:32:53.543694 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Aug 24 05:32:53.545850 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 137/276] 10.222.0.26 () {56 vars in 1099 bytes} [Wed Aug 24 05:32:53 2022] GET /identity/v3/roles/reader => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:32:53.552468 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b5b834-3c3b-4168-9412-403aa0e0c2e2 None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:32:53.560294 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:32:53.571653 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb02b5e-8b95-4608-83ee-bb069915afb0 None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:32:53.578732 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:32:53.609448 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c8a33c-9177-418c-9b17-75edc5bd077f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:32:53.610338 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c8a33c-9177-418c-9b17-75edc5bd077f None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:53.610619 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c8a33c-9177-418c-9b17-75edc5bd077f None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:53.611051 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c8a33c-9177-418c-9b17-75edc5bd077f None admin] PATH_INFO: `/v3/roles/member` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:53.621862 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c8a33c-9177-418c-9b17-75edc5bd077f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:32:53.626580 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application [None req-09c8a33c-9177-418c-9b17-75edc5bd077f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 05:32:53.626580 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:32:53.626580 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:32:53.626580 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:32:53.626580 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:32:53.626580 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:32:53.626580 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:32:53.626580 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:32:53.626580 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:32:53.626580 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:32:53.626580 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:32:53.626580 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:32:53.626580 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:32:53.626580 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:32:53.626580 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:32:53.626580 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:32:53.627463 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:32:53.627463 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:32:53.627463 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:32:53.627463 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:32:53.627463 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:32:53.627463 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:32:53.627463 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:32:53.627463 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:32:53.627463 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:32:53.627463 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:32:53.627463 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:32:53.627463 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application with Lock( Aug 24 05:32:53.627463 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:32:53.627463 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:32:53.627463 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:32:53.627463 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:32:53.628247 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:32:53.628247 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:32:53.628247 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:32:53.628247 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:32:53.628247 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:32:53.628247 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:32:53.628247 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:32:53.628247 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:32:53.628247 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:32:53.628247 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:32:53.628247 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 05:32:53.628247 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Aug 24 05:32:53.628247 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 140/277] 10.222.0.26 () {56 vars in 1099 bytes} [Wed Aug 24 05:32:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 05:32:53.629012 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c8a33c-9177-418c-9b17-75edc5bd077f None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:32:53.663034 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b5b834-3c3b-4168-9412-403aa0e0c2e2 None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:32:53.704823 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627df5fa-40be-4628-bc48-1f88b0fa7e41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:32:53.705488 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627df5fa-40be-4628-bc48-1f88b0fa7e41 None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:53.705769 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627df5fa-40be-4628-bc48-1f88b0fa7e41 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:53.706070 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627df5fa-40be-4628-bc48-1f88b0fa7e41 None admin] PATH_INFO: `/v3/roles` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:53.707261 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627df5fa-40be-4628-bc48-1f88b0fa7e41 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:32:53.707560 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627df5fa-40be-4628-bc48-1f88b0fa7e41 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:32:53.709425 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627df5fa-40be-4628-bc48-1f88b0fa7e41 None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:32:53.718069 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 138/278] 10.222.0.26 () {56 vars in 1101 bytes} [Wed Aug 24 05:32:53 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:32:53.718877 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627df5fa-40be-4628-bc48-1f88b0fa7e41 None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:32:53.743869 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c8a33c-9177-418c-9b17-75edc5bd077f None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:32:53.779124 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9aafe3-55e8-47c8-8101-75b99d25245d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:32:53.779747 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9aafe3-55e8-47c8-8101-75b99d25245d None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:53.780021 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9aafe3-55e8-47c8-8101-75b99d25245d None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:53.780285 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9aafe3-55e8-47c8-8101-75b99d25245d None admin] PATH_INFO: `/v3/domains/default` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:53.781375 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9aafe3-55e8-47c8-8101-75b99d25245d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:32:53.782845 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9aafe3-55e8-47c8-8101-75b99d25245d None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:32:53.785470 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 141/279] 10.222.0.26 () {56 vars in 1108 bytes} [Wed Aug 24 05:32:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:32:53.786165 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9aafe3-55e8-47c8-8101-75b99d25245d None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:32:53.808265 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:32:53.816166 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:32:53.832561 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627df5fa-40be-4628-bc48-1f88b0fa7e41 None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:32:53.866230 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50a1b34-f358-44e5-9bf4-2566d3028db6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:32:53.866774 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50a1b34-f358-44e5-9bf4-2566d3028db6 None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:53.867055 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50a1b34-f358-44e5-9bf4-2566d3028db6 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:53.867331 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50a1b34-f358-44e5-9bf4-2566d3028db6 None admin] PATH_INFO: `/v3/roles` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:53.867995 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50a1b34-f358-44e5-9bf4-2566d3028db6 None admin] RBAC: Adding query filter params (name=member) {{(pid=88112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:32:53.868300 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50a1b34-f358-44e5-9bf4-2566d3028db6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:32:53.869681 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50a1b34-f358-44e5-9bf4-2566d3028db6 None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:32:53.877577 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 139/280] 10.222.0.26 () {56 vars in 1101 bytes} [Wed Aug 24 05:32:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:32:53.878398 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50a1b34-f358-44e5-9bf4-2566d3028db6 None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:32:53.894805 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9aafe3-55e8-47c8-8101-75b99d25245d None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:32:53.928423 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99149d33-e162-45fe-a52c-06c6888924e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:32:53.929040 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99149d33-e162-45fe-a52c-06c6888924e2 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:53.929324 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99149d33-e162-45fe-a52c-06c6888924e2 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:53.929652 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99149d33-e162-45fe-a52c-06c6888924e2 None admin] PATH_INFO: `/v3/users/df6b0181ce9346a48b86b7d1d3d55d70` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:53.930824 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99149d33-e162-45fe-a52c-06c6888924e2 None admin] RBAC: Authorizing `identity:get_user(user_id=df6b0181ce9346a48b86b7d1d3d55d70)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:32:53.932314 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99149d33-e162-45fe-a52c-06c6888924e2 None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:32:53.933927 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 142/281] 10.222.0.26 () {56 vars in 1177 bytes} [Wed Aug 24 05:32:53 2022] GET /identity/v3/users/df6b0181ce9346a48b86b7d1d3d55d70 => generated 297 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:32:53.935055 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34374aed-0f8d-4c06-927a-e153c0b6466f None None] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:53.935335 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34374aed-0f8d-4c06-927a-e153c0b6466f None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:53.935603 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34374aed-0f8d-4c06-927a-e153c0b6466f None None] PATH_INFO: `/` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:53.936783 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 143/282] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 24 05:32:53 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:32:53.937466 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34374aed-0f8d-4c06-927a-e153c0b6466f None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:32:53.978920 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50a1b34-f358-44e5-9bf4-2566d3028db6 None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:32:54.011712 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013ad241-b4fc-45e7-930f-d67317035881 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:32:54.012348 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013ad241-b4fc-45e7-930f-d67317035881 None admin] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:54.012590 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013ad241-b4fc-45e7-930f-d67317035881 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:54.012865 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013ad241-b4fc-45e7-930f-d67317035881 None admin] PATH_INFO: `/v3/users` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:54.013510 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013ad241-b4fc-45e7-930f-d67317035881 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:32:54.014999 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013ad241-b4fc-45e7-930f-d67317035881 None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:32:54.023207 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:32:54.035866 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 140/283] 10.222.0.26 () {60 vars in 1132 bytes} [Wed Aug 24 05:32:53 2022] POST /identity/v3/users => generated 293 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:32:54.036772 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013ad241-b4fc-45e7-930f-d67317035881 None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:32:54.045188 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34374aed-0f8d-4c06-927a-e153c0b6466f None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:32:54.058405 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:32:54.087087 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b68560-3016-4078-905a-eed5b4bd5f3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:32:54.088025 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b68560-3016-4078-905a-eed5b4bd5f3f None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:54.088304 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b68560-3016-4078-905a-eed5b4bd5f3f None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:54.088578 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b68560-3016-4078-905a-eed5b4bd5f3f None admin] PATH_INFO: `/v3/users/e09285e9d44543519d73540c18117fbc` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:54.108103 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b68560-3016-4078-905a-eed5b4bd5f3f None admin] RBAC: Authorizing `identity:get_user(user_id=e09285e9d44543519d73540c18117fbc)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:32:54.110334 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b68560-3016-4078-905a-eed5b4bd5f3f None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:32:54.118072 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 144/284] 10.222.0.26 () {56 vars in 1177 bytes} [Wed Aug 24 05:32:53 2022] GET /identity/v3/users/e09285e9d44543519d73540c18117fbc => generated 293 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:32:54.118072 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08189d9-1b83-4f55-90ca-16aa335ebe2d None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:54.118072 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08189d9-1b83-4f55-90ca-16aa335ebe2d None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:54.118072 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08189d9-1b83-4f55-90ca-16aa335ebe2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:54.139434 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-d08189d9-1b83-4f55-90ca-16aa335ebe2d None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:32:54.141338 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-d08189d9-1b83-4f55-90ca-16aa335ebe2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:32:54.167694 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013ad241-b4fc-45e7-930f-d67317035881 None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:32:54.204789 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e3731f-f10a-45fe-a28d-3e52e288344c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:32:54.205427 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e3731f-f10a-45fe-a28d-3e52e288344c None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:54.205704 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e3731f-f10a-45fe-a28d-3e52e288344c None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:54.206007 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e3731f-f10a-45fe-a28d-3e52e288344c None admin] PATH_INFO: `/v3/projects/354a816414fb4c1d8f99d5307047be89` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:54.207705 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e3731f-f10a-45fe-a28d-3e52e288344c None admin] RBAC: Authorizing `identity:get_project(project_id=354a816414fb4c1d8f99d5307047be89)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:32:54.209131 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e3731f-f10a-45fe-a28d-3e52e288344c None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:32:54.210804 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 141/285] 10.222.0.26 () {56 vars in 1186 bytes} [Wed Aug 24 05:32:54 2022] GET /identity/v3/projects/354a816414fb4c1d8f99d5307047be89 => generated 302 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:32:54.211650 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e3731f-f10a-45fe-a28d-3e52e288344c None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:32:54.223674 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 145/286] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 24 05:32:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 05:32:54.224342 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08189d9-1b83-4f55-90ca-16aa335ebe2d None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:32:54.292926 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:32:54.316890 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:32:54.334360 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e3731f-f10a-45fe-a28d-3e52e288344c None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:32:54.347433 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08189d9-1b83-4f55-90ca-16aa335ebe2d None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:32:54.375487 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17586d06-977f-4351-adcc-644ef4f85a6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:32:54.376038 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17586d06-977f-4351-adcc-644ef4f85a6e None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:54.376322 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17586d06-977f-4351-adcc-644ef4f85a6e None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:54.376938 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17586d06-977f-4351-adcc-644ef4f85a6e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:54.377987 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17586d06-977f-4351-adcc-644ef4f85a6e None admin] RBAC: Adding query filter params (role.id=f7aa4a2c74c94c1b9ca8ecdcccccda5c, user.id=e09285e9d44543519d73540c18117fbc, scope.system=all) {{(pid=88112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:32:54.378299 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17586d06-977f-4351-adcc-644ef4f85a6e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:32:54.380514 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17586d06-977f-4351-adcc-644ef4f85a6e None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:32:54.387497 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 142/287] 10.222.0.26 () {56 vars in 1308 bytes} [Wed Aug 24 05:32:54 2022] GET /identity/v3/role_assignments?user.id=e09285e9d44543519d73540c18117fbc&scope.system=all&role.id=f7aa4a2c74c94c1b9ca8ecdcccccda5c => generated 226 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:32:54.391995 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7727377a-a3c5-4ed6-b052-14cba4be6c47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:32:54.392684 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7727377a-a3c5-4ed6-b052-14cba4be6c47 None admin] REQUEST_METHOD: `PUT` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:54.392963 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7727377a-a3c5-4ed6-b052-14cba4be6c47 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:54.393233 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7727377a-a3c5-4ed6-b052-14cba4be6c47 None admin] PATH_INFO: `/v3/projects/354a816414fb4c1d8f99d5307047be89/users/df6b0181ce9346a48b86b7d1d3d55d70/roles/129798c59b2c43978b555869931dada4` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:54.395281 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7727377a-a3c5-4ed6-b052-14cba4be6c47 None admin] RBAC: Authorizing `identity:create_grant(project_id=354a816414fb4c1d8f99d5307047be89, user_id=df6b0181ce9346a48b86b7d1d3d55d70, role_id=129798c59b2c43978b555869931dada4)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:32:54.396764 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7727377a-a3c5-4ed6-b052-14cba4be6c47 None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:32:54.414890 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 146/288] 10.222.0.26 () {58 vars in 1439 bytes} [Wed Aug 24 05:32:54 2022] PUT /identity/v3/projects/354a816414fb4c1d8f99d5307047be89/users/df6b0181ce9346a48b86b7d1d3d55d70/roles/129798c59b2c43978b555869931dada4 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:32:54.523630 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17586d06-977f-4351-adcc-644ef4f85a6e None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:32:54.643733 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17586d06-977f-4351-adcc-644ef4f85a6e None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:32:54.682426 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129d61af-c31d-4d58-983c-4494ae96b7e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:32:54.683060 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129d61af-c31d-4d58-983c-4494ae96b7e5 None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:54.683337 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129d61af-c31d-4d58-983c-4494ae96b7e5 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:54.683602 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129d61af-c31d-4d58-983c-4494ae96b7e5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:54.686406 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:32:54.697390 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129d61af-c31d-4d58-983c-4494ae96b7e5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:32:54.702676 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application [None req-129d61af-c31d-4d58-983c-4494ae96b7e5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 05:32:54.702676 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:32:54.702676 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:32:54.702676 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:32:54.702676 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:32:54.702676 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:32:54.702676 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:32:54.702676 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:32:54.702676 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:32:54.702676 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:32:54.702676 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:32:54.702676 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:32:54.702676 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:32:54.702676 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:32:54.702676 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:32:54.702676 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:32:54.703544 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:32:54.703544 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:32:54.703544 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:32:54.703544 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:32:54.703544 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:32:54.703544 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:32:54.703544 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:32:54.703544 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:32:54.703544 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:32:54.703544 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:32:54.703544 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:32:54.703544 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application with Lock( Aug 24 05:32:54.703544 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:32:54.703544 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:32:54.703544 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:32:54.703544 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:32:54.704340 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:32:54.704340 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:32:54.704340 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:32:54.704340 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:32:54.704340 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:32:54.704340 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:32:54.704340 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:32:54.704340 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:32:54.704340 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:32:54.704340 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:32:54.704340 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 05:32:54.704340 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Aug 24 05:32:54.708592 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 143/289] 10.222.0.26 () {56 vars in 1099 bytes} [Wed Aug 24 05:32:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:32:54.709978 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7727377a-a3c5-4ed6-b052-14cba4be6c47 None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:32:54.821783 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7727377a-a3c5-4ed6-b052-14cba4be6c47 None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:32:54.857804 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea2ac6a-8b80-4940-bdba-21980aed65a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:32:54.858447 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea2ac6a-8b80-4940-bdba-21980aed65a6 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:54.858721 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea2ac6a-8b80-4940-bdba-21980aed65a6 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:54.858979 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea2ac6a-8b80-4940-bdba-21980aed65a6 None admin] PATH_INFO: `/v3/roles` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:54.859701 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea2ac6a-8b80-4940-bdba-21980aed65a6 None admin] RBAC: Adding query filter params (name=member) {{(pid=88113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:32:54.860002 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea2ac6a-8b80-4940-bdba-21980aed65a6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:32:54.861360 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea2ac6a-8b80-4940-bdba-21980aed65a6 None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:32:54.862870 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:32:54.877501 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 147/290] 10.222.0.26 () {56 vars in 1101 bytes} [Wed Aug 24 05:32:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:32:54.878884 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129d61af-c31d-4d58-983c-4494ae96b7e5 None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:32:55.020780 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129d61af-c31d-4d58-983c-4494ae96b7e5 None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:32:55.063240 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b41e1e9-a261-40b1-a694-6afcd5bc3a50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:32:55.063876 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b41e1e9-a261-40b1-a694-6afcd5bc3a50 None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:55.064156 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b41e1e9-a261-40b1-a694-6afcd5bc3a50 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:55.064429 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b41e1e9-a261-40b1-a694-6afcd5bc3a50 None admin] PATH_INFO: `/v3/users/677a3f88f74c4cb0812021cd878d8a8d` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:55.065683 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b41e1e9-a261-40b1-a694-6afcd5bc3a50 None admin] RBAC: Authorizing `identity:get_user(user_id=677a3f88f74c4cb0812021cd878d8a8d)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:32:55.067224 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b41e1e9-a261-40b1-a694-6afcd5bc3a50 None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:32:55.069238 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 144/291] 10.222.0.26 () {56 vars in 1177 bytes} [Wed Aug 24 05:32:54 2022] GET /identity/v3/users/677a3f88f74c4cb0812021cd878d8a8d => generated 297 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:32:55.074900 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea2ac6a-8b80-4940-bdba-21980aed65a6 None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:32:55.212005 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea2ac6a-8b80-4940-bdba-21980aed65a6 None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:32:55.253496 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec42e4f-4283-4714-bbfc-c38ce075579c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:32:55.254149 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec42e4f-4283-4714-bbfc-c38ce075579c None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:55.254429 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec42e4f-4283-4714-bbfc-c38ce075579c None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:55.254700 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec42e4f-4283-4714-bbfc-c38ce075579c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:55.328140 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:32:55.337598 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec42e4f-4283-4714-bbfc-c38ce075579c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:32:55.339100 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec42e4f-4283-4714-bbfc-c38ce075579c None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:32:55.458155 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 148/292] 10.222.0.26 () {58 vars in 1282 bytes} [Wed Aug 24 05:32:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 05:32:55.467307 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b41e1e9-a261-40b1-a694-6afcd5bc3a50 None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:32:55.590305 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:32:55.638237 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b41e1e9-a261-40b1-a694-6afcd5bc3a50 None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:32:55.681427 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9feb9c05-0465-413c-88af-659d135835e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:32:55.682465 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9feb9c05-0465-413c-88af-659d135835e9 None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:55.682948 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9feb9c05-0465-413c-88af-659d135835e9 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:55.683446 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9feb9c05-0465-413c-88af-659d135835e9 None admin] PATH_INFO: `/v3/projects/354a816414fb4c1d8f99d5307047be89` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:55.684783 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9feb9c05-0465-413c-88af-659d135835e9 None admin] RBAC: Authorizing `identity:get_project(project_id=354a816414fb4c1d8f99d5307047be89)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:32:55.686464 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9feb9c05-0465-413c-88af-659d135835e9 None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:32:55.688295 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 145/293] 10.222.0.26 () {56 vars in 1186 bytes} [Wed Aug 24 05:32:55 2022] GET /identity/v3/projects/354a816414fb4c1d8f99d5307047be89 => generated 302 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:32:55.694607 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec42e4f-4283-4714-bbfc-c38ce075579c None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:32:55.827328 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:32:55.833911 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec42e4f-4283-4714-bbfc-c38ce075579c None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:32:55.889548 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1554e1e-b3ed-4dbd-af52-d832e7f03a9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:32:55.890082 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1554e1e-b3ed-4dbd-af52-d832e7f03a9e None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:55.890364 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1554e1e-b3ed-4dbd-af52-d832e7f03a9e None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:55.890636 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1554e1e-b3ed-4dbd-af52-d832e7f03a9e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:55.891366 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1554e1e-b3ed-4dbd-af52-d832e7f03a9e None admin] RBAC: Adding query filter params (role.id=f7aa4a2c74c94c1b9ca8ecdcccccda5c, scope.project.id=354a816414fb4c1d8f99d5307047be89, user.id=677a3f88f74c4cb0812021cd878d8a8d) {{(pid=88113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:32:55.891676 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1554e1e-b3ed-4dbd-af52-d832e7f03a9e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:32:55.893116 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1554e1e-b3ed-4dbd-af52-d832e7f03a9e None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:32:55.899936 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 149/294] 10.222.0.26 () {56 vars in 1374 bytes} [Wed Aug 24 05:32:55 2022] GET /identity/v3/role_assignments?user.id=677a3f88f74c4cb0812021cd878d8a8d&scope.project.id=354a816414fb4c1d8f99d5307047be89&role.id=f7aa4a2c74c94c1b9ca8ecdcccccda5c => generated 608 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:32:56.506148 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca04a6d5-65bc-4ff2-becd-3583183f0689 None None] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:56.506650 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca04a6d5-65bc-4ff2-becd-3583183f0689 None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:56.506723 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca04a6d5-65bc-4ff2-becd-3583183f0689 None None] PATH_INFO: `/` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:56.508292 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 146/295] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 24 05:32:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:32:56.514321 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09414dc0-b60b-48df-a0d4-6d1cd3d42f2f None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:56.514605 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09414dc0-b60b-48df-a0d4-6d1cd3d42f2f None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:56.514881 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09414dc0-b60b-48df-a0d4-6d1cd3d42f2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:56.535673 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-09414dc0-b60b-48df-a0d4-6d1cd3d42f2f None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:32:56.536875 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-09414dc0-b60b-48df-a0d4-6d1cd3d42f2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:32:56.612570 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 150/296] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 24 05:32:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 05:32:56.674099 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6020b8-4936-4398-96f8-781377c5b489 None None] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:56.674405 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6020b8-4936-4398-96f8-781377c5b489 None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:56.674650 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6020b8-4936-4398-96f8-781377c5b489 None None] PATH_INFO: `/` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:56.676808 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 147/297] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 24 05:32:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:32:56.682021 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e561df4-e89c-49fa-9a51-449eee874ce8 None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:56.682315 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e561df4-e89c-49fa-9a51-449eee874ce8 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:56.682593 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e561df4-e89c-49fa-9a51-449eee874ce8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:56.701640 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-4e561df4-e89c-49fa-9a51-449eee874ce8 None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:32:56.702952 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-4e561df4-e89c-49fa-9a51-449eee874ce8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:32:56.771213 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 151/298] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 24 05:32:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 05:32:56.795121 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4552dbe4-3bf9-4944-8f15-f3a072fa0de9 None None] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:56.795395 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4552dbe4-3bf9-4944-8f15-f3a072fa0de9 None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:56.795671 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4552dbe4-3bf9-4944-8f15-f3a072fa0de9 None None] PATH_INFO: `/` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:56.797010 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 148/299] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 24 05:32:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:32:56.802913 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ecae31-17fb-490c-88d3-017e3cf6c292 None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:56.803200 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ecae31-17fb-490c-88d3-017e3cf6c292 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:56.803475 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ecae31-17fb-490c-88d3-017e3cf6c292 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:56.822826 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-f0ecae31-17fb-490c-88d3-017e3cf6c292 None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:32:56.824005 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-f0ecae31-17fb-490c-88d3-017e3cf6c292 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:32:56.832370 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cc5e55-5f98-4339-9c74-f21ae7345182 None None] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:56.832953 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cc5e55-5f98-4339-9c74-f21ae7345182 None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:56.833452 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cc5e55-5f98-4339-9c74-f21ae7345182 None None] PATH_INFO: `/` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:56.835259 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 149/300] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 24 05:32:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:32:56.838639 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:32:56.840835 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e31b42-4b5f-497d-a360-c9c38fefdb96 None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:56.841319 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e31b42-4b5f-497d-a360-c9c38fefdb96 None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:56.841816 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e31b42-4b5f-497d-a360-c9c38fefdb96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:56.860299 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-d0e31b42-4b5f-497d-a360-c9c38fefdb96 None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:32:56.861795 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-d0e31b42-4b5f-497d-a360-c9c38fefdb96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:32:56.892607 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 152/301] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 24 05:32:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 05:32:56.893456 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ecae31-17fb-490c-88d3-017e3cf6c292 None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:32:56.946273 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 150/302] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 24 05:32:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 05:32:56.993765 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ecae31-17fb-490c-88d3-017e3cf6c292 None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:32:57.027334 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fcbd06-7587-4845-8273-083c0d4ca7d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:32:57.027888 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fcbd06-7587-4845-8273-083c0d4ca7d0 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:57.028165 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fcbd06-7587-4845-8273-083c0d4ca7d0 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:57.028435 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fcbd06-7587-4845-8273-083c0d4ca7d0 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:57.039151 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fcbd06-7587-4845-8273-083c0d4ca7d0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:32:57.043834 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application [None req-84fcbd06-7587-4845-8273-083c0d4ca7d0 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 05:32:57.043834 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:32:57.043834 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:32:57.043834 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:32:57.043834 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:32:57.043834 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:32:57.043834 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:32:57.043834 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:32:57.043834 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:32:57.043834 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:32:57.043834 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:32:57.043834 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:32:57.043834 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:32:57.043834 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:32:57.043834 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:32:57.043834 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:32:57.044685 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:32:57.044685 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:32:57.044685 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:32:57.044685 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:32:57.044685 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:32:57.044685 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:32:57.044685 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:32:57.044685 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:32:57.044685 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:32:57.044685 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:32:57.044685 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:32:57.044685 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application with Lock( Aug 24 05:32:57.044685 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:32:57.044685 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:32:57.044685 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:32:57.044685 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:32:57.045590 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:32:57.045590 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:32:57.045590 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:32:57.045590 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:32:57.045590 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:32:57.045590 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:32:57.045590 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:32:57.045590 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:32:57.045590 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:32:57.045590 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:32:57.045590 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 05:32:57.045590 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Aug 24 05:32:57.045590 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 153/303] 10.222.0.26 () {56 vars in 1099 bytes} [Wed Aug 24 05:32:56 2022] GET /identity/v3/roles/reader => generated 84 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:32:57.052276 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e31b42-4b5f-497d-a360-c9c38fefdb96 None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:32:57.055049 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fcbd06-7587-4845-8273-083c0d4ca7d0 None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:32:57.072315 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:32:57.135666 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:32:57.166257 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fcbd06-7587-4845-8273-083c0d4ca7d0 None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:32:57.183504 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e31b42-4b5f-497d-a360-c9c38fefdb96 None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:32:57.207297 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0591f83-b0cc-47d7-9ccb-6c8fe1dce843 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:32:57.207917 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0591f83-b0cc-47d7-9ccb-6c8fe1dce843 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:57.208192 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0591f83-b0cc-47d7-9ccb-6c8fe1dce843 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:57.208523 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0591f83-b0cc-47d7-9ccb-6c8fe1dce843 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:57.218652 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930e8a51-e755-4da5-8377-8447b1af6cd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:32:57.219076 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0591f83-b0cc-47d7-9ccb-6c8fe1dce843 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:32:57.219260 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930e8a51-e755-4da5-8377-8447b1af6cd1 None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:57.219541 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930e8a51-e755-4da5-8377-8447b1af6cd1 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:57.219815 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930e8a51-e755-4da5-8377-8447b1af6cd1 None admin] PATH_INFO: `/v3/roles` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:57.220488 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930e8a51-e755-4da5-8377-8447b1af6cd1 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:32:57.220792 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930e8a51-e755-4da5-8377-8447b1af6cd1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:32:57.222709 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930e8a51-e755-4da5-8377-8447b1af6cd1 None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:32:57.224311 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application [None req-f0591f83-b0cc-47d7-9ccb-6c8fe1dce843 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 05:32:57.224311 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:32:57.224311 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:32:57.224311 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:32:57.224311 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:32:57.224311 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:32:57.224311 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:32:57.224311 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:32:57.224311 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:32:57.224311 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:32:57.224311 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:32:57.224311 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:32:57.224311 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:32:57.224311 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:32:57.224311 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:32:57.224311 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:32:57.225206 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:32:57.225206 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:32:57.225206 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:32:57.225206 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:32:57.225206 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:32:57.225206 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:32:57.225206 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:32:57.225206 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:32:57.225206 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:32:57.225206 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:32:57.225206 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:32:57.225206 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application with Lock( Aug 24 05:32:57.225206 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:32:57.225206 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:32:57.225206 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:32:57.225206 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:32:57.225992 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:32:57.225992 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:32:57.225992 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:32:57.225992 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:32:57.225992 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:32:57.225992 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:32:57.225992 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:32:57.225992 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:32:57.225992 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:32:57.225992 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:32:57.225992 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 05:32:57.225992 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Aug 24 05:32:57.225992 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 154/304] 10.222.0.26 () {56 vars in 1099 bytes} [Wed Aug 24 05:32:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 05:32:57.226659 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0591f83-b0cc-47d7-9ccb-6c8fe1dce843 None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:32:57.230899 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 151/305] 10.222.0.26 () {56 vars in 1101 bytes} [Wed Aug 24 05:32:57 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:32:57.231695 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930e8a51-e755-4da5-8377-8447b1af6cd1 None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:32:57.296673 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:32:57.326287 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0591f83-b0cc-47d7-9ccb-6c8fe1dce843 None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:32:57.331653 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930e8a51-e755-4da5-8377-8447b1af6cd1 None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:32:57.354416 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:32:57.359923 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538d4c61-16f5-42d7-bd3b-c5f2de6c1a60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:32:57.360544 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538d4c61-16f5-42d7-bd3b-c5f2de6c1a60 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:57.360820 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538d4c61-16f5-42d7-bd3b-c5f2de6c1a60 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:57.361087 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538d4c61-16f5-42d7-bd3b-c5f2de6c1a60 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:57.362214 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538d4c61-16f5-42d7-bd3b-c5f2de6c1a60 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:32:57.364252 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538d4c61-16f5-42d7-bd3b-c5f2de6c1a60 None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:32:57.365409 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f05eec3-1fcc-4323-a738-0f69eb423ee2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:32:57.366056 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f05eec3-1fcc-4323-a738-0f69eb423ee2 None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:57.366167 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 155/306] 10.222.0.26 () {56 vars in 1108 bytes} [Wed Aug 24 05:32:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:32:57.366335 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f05eec3-1fcc-4323-a738-0f69eb423ee2 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:57.366604 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f05eec3-1fcc-4323-a738-0f69eb423ee2 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:57.366906 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538d4c61-16f5-42d7-bd3b-c5f2de6c1a60 None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:32:57.379031 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f05eec3-1fcc-4323-a738-0f69eb423ee2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:32:57.384175 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application [None req-1f05eec3-1fcc-4323-a738-0f69eb423ee2 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 05:32:57.384175 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:32:57.384175 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:32:57.384175 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:32:57.384175 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:32:57.384175 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:32:57.384175 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:32:57.384175 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:32:57.384175 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:32:57.384175 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:32:57.384175 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:32:57.384175 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:32:57.384175 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:32:57.384175 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:32:57.384175 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:32:57.384175 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:32:57.385254 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:32:57.385254 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:32:57.385254 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:32:57.385254 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:32:57.385254 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:32:57.385254 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:32:57.385254 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:32:57.385254 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:32:57.385254 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:32:57.385254 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:32:57.385254 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:32:57.385254 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application with Lock( Aug 24 05:32:57.385254 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:32:57.385254 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:32:57.385254 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:32:57.385254 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:32:57.386071 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:32:57.386071 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:32:57.386071 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:32:57.386071 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:32:57.386071 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:32:57.386071 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:32:57.386071 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:32:57.386071 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:32:57.386071 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:32:57.386071 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:32:57.386071 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 05:32:57.386071 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Aug 24 05:32:57.386071 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 152/307] 10.222.0.26 () {56 vars in 1099 bytes} [Wed Aug 24 05:32:57 2022] GET /identity/v3/roles/reader => generated 84 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:32:57.386071 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f05eec3-1fcc-4323-a738-0f69eb423ee2 None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:32:57.466123 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538d4c61-16f5-42d7-bd3b-c5f2de6c1a60 None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:32:57.486857 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f05eec3-1fcc-4323-a738-0f69eb423ee2 None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:32:57.499603 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb26e8c-744d-4cc8-9310-b1e513d008d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:32:57.500212 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb26e8c-744d-4cc8-9310-b1e513d008d4 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:57.500490 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb26e8c-744d-4cc8-9310-b1e513d008d4 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:57.500762 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb26e8c-744d-4cc8-9310-b1e513d008d4 None admin] PATH_INFO: `/v3/roles` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:57.501429 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb26e8c-744d-4cc8-9310-b1e513d008d4 None admin] RBAC: Adding query filter params (name=member) {{(pid=88113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:32:57.501731 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb26e8c-744d-4cc8-9310-b1e513d008d4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:32:57.503141 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb26e8c-744d-4cc8-9310-b1e513d008d4 None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:32:57.508202 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:32:57.512139 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 156/308] 10.222.0.26 () {56 vars in 1101 bytes} [Wed Aug 24 05:32:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:32:57.513151 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb26e8c-744d-4cc8-9310-b1e513d008d4 None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:32:57.527423 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efb0192-8aab-4f31-9539-94603f4622ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:32:57.528052 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efb0192-8aab-4f31-9539-94603f4622ff None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:57.528324 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efb0192-8aab-4f31-9539-94603f4622ff None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:57.528595 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efb0192-8aab-4f31-9539-94603f4622ff None admin] PATH_INFO: `/v3/users/5a104f9e85ae416280eb1b1dd215c6a1` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:57.542225 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efb0192-8aab-4f31-9539-94603f4622ff None admin] RBAC: Authorizing `identity:get_user(user_id=5a104f9e85ae416280eb1b1dd215c6a1)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:32:57.543685 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efb0192-8aab-4f31-9539-94603f4622ff None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:32:57.545298 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 153/309] 10.222.0.26 () {56 vars in 1177 bytes} [Wed Aug 24 05:32:57 2022] GET /identity/v3/users/5a104f9e85ae416280eb1b1dd215c6a1 => generated 293 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:32:57.546080 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efb0192-8aab-4f31-9539-94603f4622ff None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:32:57.588432 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:32:57.617504 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb26e8c-744d-4cc8-9310-b1e513d008d4 None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:32:57.642907 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efb0192-8aab-4f31-9539-94603f4622ff None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:32:57.650571 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1d3d51-7abf-4ae5-8c36-673dbe72d6a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:32:57.651166 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1d3d51-7abf-4ae5-8c36-673dbe72d6a5 None admin] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:57.651440 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1d3d51-7abf-4ae5-8c36-673dbe72d6a5 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:57.651704 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1d3d51-7abf-4ae5-8c36-673dbe72d6a5 None admin] PATH_INFO: `/v3/groups` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:57.652315 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1d3d51-7abf-4ae5-8c36-673dbe72d6a5 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:32:57.653731 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1d3d51-7abf-4ae5-8c36-673dbe72d6a5 None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:32:57.669050 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 157/310] 10.222.0.26 () {60 vars in 1134 bytes} [Wed Aug 24 05:32:57 2022] POST /identity/v3/groups => generated 229 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:32:57.670053 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1d3d51-7abf-4ae5-8c36-673dbe72d6a5 None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:32:57.678804 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d9e9cd-dc78-4196-b140-8c485082e6a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:32:57.679558 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d9e9cd-dc78-4196-b140-8c485082e6a0 None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:57.679831 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d9e9cd-dc78-4196-b140-8c485082e6a0 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:57.680098 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d9e9cd-dc78-4196-b140-8c485082e6a0 None admin] PATH_INFO: `/v3/roles` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:57.680783 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d9e9cd-dc78-4196-b140-8c485082e6a0 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:32:57.681083 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d9e9cd-dc78-4196-b140-8c485082e6a0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:32:57.682659 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d9e9cd-dc78-4196-b140-8c485082e6a0 None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:32:57.697220 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 154/311] 10.222.0.26 () {56 vars in 1101 bytes} [Wed Aug 24 05:32:57 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:32:57.697220 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d9e9cd-dc78-4196-b140-8c485082e6a0 None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:32:57.740113 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:32:57.791570 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1d3d51-7abf-4ae5-8c36-673dbe72d6a5 None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:32:57.810401 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d9e9cd-dc78-4196-b140-8c485082e6a0 None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:32:57.813460 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:32:57.830377 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a76da26-193e-4c2c-9c8e-9dfeaba2a9cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:32:57.831010 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a76da26-193e-4c2c-9c8e-9dfeaba2a9cf None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:57.831290 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a76da26-193e-4c2c-9c8e-9dfeaba2a9cf None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:57.831626 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a76da26-193e-4c2c-9c8e-9dfeaba2a9cf None admin] PATH_INFO: `/v3/users/e09285e9d44543519d73540c18117fbc` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:57.833245 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a76da26-193e-4c2c-9c8e-9dfeaba2a9cf None admin] RBAC: Authorizing `identity:get_user(user_id=e09285e9d44543519d73540c18117fbc)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:32:57.834748 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a76da26-193e-4c2c-9c8e-9dfeaba2a9cf None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:32:57.836517 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 158/312] 10.222.0.26 () {56 vars in 1177 bytes} [Wed Aug 24 05:32:57 2022] GET /identity/v3/users/e09285e9d44543519d73540c18117fbc => generated 293 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:32:57.837105 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a76da26-193e-4c2c-9c8e-9dfeaba2a9cf None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:32:57.855314 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9b9a3c-4677-4e84-b85a-0ce395794dae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:32:57.855859 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9b9a3c-4677-4e84-b85a-0ce395794dae None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:57.856124 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9b9a3c-4677-4e84-b85a-0ce395794dae None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:57.856389 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9b9a3c-4677-4e84-b85a-0ce395794dae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:57.857138 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9b9a3c-4677-4e84-b85a-0ce395794dae None admin] RBAC: Adding query filter params (role.id=129798c59b2c43978b555869931dada4, user.id=5a104f9e85ae416280eb1b1dd215c6a1, scope.system=all) {{(pid=88112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:32:57.857442 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9b9a3c-4677-4e84-b85a-0ce395794dae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:32:57.858912 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9b9a3c-4677-4e84-b85a-0ce395794dae None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:32:57.864550 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 155/313] 10.222.0.26 () {56 vars in 1308 bytes} [Wed Aug 24 05:32:57 2022] GET /identity/v3/role_assignments?user.id=5a104f9e85ae416280eb1b1dd215c6a1&scope.system=all&role.id=129798c59b2c43978b555869931dada4 => generated 226 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:32:57.865451 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9b9a3c-4677-4e84-b85a-0ce395794dae None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:32:57.974428 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a76da26-193e-4c2c-9c8e-9dfeaba2a9cf None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:32:58.004951 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9b9a3c-4677-4e84-b85a-0ce395794dae None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:32:58.005440 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:32:58.015552 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41238d84-0f45-4817-b082-a7f10a3c0124 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:32:58.016524 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41238d84-0f45-4817-b082-a7f10a3c0124 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:58.016997 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41238d84-0f45-4817-b082-a7f10a3c0124 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:58.017491 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41238d84-0f45-4817-b082-a7f10a3c0124 None admin] PATH_INFO: `/v3/users/df6b0181ce9346a48b86b7d1d3d55d70` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:58.018961 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41238d84-0f45-4817-b082-a7f10a3c0124 None admin] RBAC: Authorizing `identity:get_user(user_id=df6b0181ce9346a48b86b7d1d3d55d70)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:32:58.020654 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41238d84-0f45-4817-b082-a7f10a3c0124 None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:32:58.022539 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 159/314] 10.222.0.26 () {56 vars in 1177 bytes} [Wed Aug 24 05:32:57 2022] GET /identity/v3/users/df6b0181ce9346a48b86b7d1d3d55d70 => generated 297 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:32:58.028251 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41238d84-0f45-4817-b082-a7f10a3c0124 None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:32:58.047979 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74ea406-3a60-4a09-bfc8-d6d99b6ded88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:32:58.048878 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74ea406-3a60-4a09-bfc8-d6d99b6ded88 None admin] REQUEST_METHOD: `PUT` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:58.049157 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74ea406-3a60-4a09-bfc8-d6d99b6ded88 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:58.049427 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74ea406-3a60-4a09-bfc8-d6d99b6ded88 None admin] PATH_INFO: `/v3/system/users/e09285e9d44543519d73540c18117fbc/roles/f7aa4a2c74c94c1b9ca8ecdcccccda5c` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:58.051815 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74ea406-3a60-4a09-bfc8-d6d99b6ded88 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=e09285e9d44543519d73540c18117fbc, role_id=f7aa4a2c74c94c1b9ca8ecdcccccda5c)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:32:58.053188 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74ea406-3a60-4a09-bfc8-d6d99b6ded88 None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:32:58.065303 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 156/315] 10.222.0.26 () {58 vars in 1334 bytes} [Wed Aug 24 05:32:57 2022] PUT /identity/v3/system/users/e09285e9d44543519d73540c18117fbc/roles/f7aa4a2c74c94c1b9ca8ecdcccccda5c => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:32:58.160584 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41238d84-0f45-4817-b082-a7f10a3c0124 None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:32:58.199648 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e769bb-3c66-4912-b97c-2091f1fd6ee4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:32:58.200274 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e769bb-3c66-4912-b97c-2091f1fd6ee4 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:58.200560 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e769bb-3c66-4912-b97c-2091f1fd6ee4 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:58.200817 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e769bb-3c66-4912-b97c-2091f1fd6ee4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:58.269381 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:32:58.277664 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e769bb-3c66-4912-b97c-2091f1fd6ee4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:32:58.279553 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e769bb-3c66-4912-b97c-2091f1fd6ee4 None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:32:58.390789 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 160/316] 10.222.0.26 () {58 vars in 1282 bytes} [Wed Aug 24 05:32:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 05:32:58.396364 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74ea406-3a60-4a09-bfc8-d6d99b6ded88 None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:32:58.429021 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:32:58.503005 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74ea406-3a60-4a09-bfc8-d6d99b6ded88 None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:32:58.545441 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10b6a78-4565-4344-9137-80c4ad879352 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:32:58.546800 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10b6a78-4565-4344-9137-80c4ad879352 None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:58.547281 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10b6a78-4565-4344-9137-80c4ad879352 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:58.547750 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10b6a78-4565-4344-9137-80c4ad879352 None admin] PATH_INFO: `/v3/projects/354a816414fb4c1d8f99d5307047be89` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:58.549139 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10b6a78-4565-4344-9137-80c4ad879352 None admin] RBAC: Authorizing `identity:get_project(project_id=354a816414fb4c1d8f99d5307047be89)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:32:58.551022 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10b6a78-4565-4344-9137-80c4ad879352 None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:32:58.553250 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 157/317] 10.222.0.26 () {56 vars in 1186 bytes} [Wed Aug 24 05:32:58 2022] GET /identity/v3/projects/354a816414fb4c1d8f99d5307047be89 => generated 302 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:32:58.558734 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e769bb-3c66-4912-b97c-2091f1fd6ee4 None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:32:58.658035 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:32:58.665787 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e769bb-3c66-4912-b97c-2091f1fd6ee4 None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:32:58.702150 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d044a77-96d1-4cf1-a62b-2e0eed045b55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:32:58.702760 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d044a77-96d1-4cf1-a62b-2e0eed045b55 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:58.703034 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d044a77-96d1-4cf1-a62b-2e0eed045b55 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:58.703302 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d044a77-96d1-4cf1-a62b-2e0eed045b55 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:58.704021 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d044a77-96d1-4cf1-a62b-2e0eed045b55 None admin] RBAC: Adding query filter params (role.id=129798c59b2c43978b555869931dada4, scope.project.id=354a816414fb4c1d8f99d5307047be89, user.id=df6b0181ce9346a48b86b7d1d3d55d70) {{(pid=88113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:32:58.704323 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d044a77-96d1-4cf1-a62b-2e0eed045b55 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:32:58.705760 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d044a77-96d1-4cf1-a62b-2e0eed045b55 None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:32:58.712090 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 161/318] 10.222.0.26 () {56 vars in 1374 bytes} [Wed Aug 24 05:32:58 2022] GET /identity/v3/role_assignments?user.id=df6b0181ce9346a48b86b7d1d3d55d70&scope.project.id=354a816414fb4c1d8f99d5307047be89&role.id=129798c59b2c43978b555869931dada4 => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:32:59.651023 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc03181d-6977-4e6c-9583-8c70dbc7499c None None] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:59.651526 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc03181d-6977-4e6c-9583-8c70dbc7499c None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:59.651629 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc03181d-6977-4e6c-9583-8c70dbc7499c None None] PATH_INFO: `/` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:59.653065 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 158/319] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 24 05:32:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:32:59.658145 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5454e748-1149-4d4c-bdf1-f1a707b0106c None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:59.658516 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5454e748-1149-4d4c-bdf1-f1a707b0106c None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:59.658696 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5454e748-1149-4d4c-bdf1-f1a707b0106c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:59.677349 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-5454e748-1149-4d4c-bdf1-f1a707b0106c None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:32:59.678563 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-5454e748-1149-4d4c-bdf1-f1a707b0106c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:32:59.746379 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 162/320] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 24 05:32:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 05:32:59.785933 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf8c4c9-48b3-4c73-aa73-354f9c3f28a3 None None] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:59.786258 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf8c4c9-48b3-4c73-aa73-354f9c3f28a3 None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:59.786526 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf8c4c9-48b3-4c73-aa73-354f9c3f28a3 None None] PATH_INFO: `/` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:59.787986 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 159/321] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 24 05:32:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:32:59.793046 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38937c31-bbf7-43eb-adf3-76247eccd869 None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:32:59.793280 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38937c31-bbf7-43eb-adf3-76247eccd869 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:32:59.793547 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38937c31-bbf7-43eb-adf3-76247eccd869 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:32:59.811727 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-38937c31-bbf7-43eb-adf3-76247eccd869 None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:32:59.812897 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-38937c31-bbf7-43eb-adf3-76247eccd869 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:32:59.879200 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 163/322] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 24 05:32:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 05:33:00.013188 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf8c4c9-48b3-4c73-aa73-354f9c3f28a3 None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:00.017314 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c15dba-c382-4889-8f2b-8e4e23f2221c None None] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:00.017600 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c15dba-c382-4889-8f2b-8e4e23f2221c None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:00.017878 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c15dba-c382-4889-8f2b-8e4e23f2221c None None] PATH_INFO: `/` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:00.019458 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 164/323] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 24 05:33:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:33:00.024220 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790d7ccc-d3ae-4d56-a383-32b215349d9a None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:00.024525 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790d7ccc-d3ae-4d56-a383-32b215349d9a None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:00.025122 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790d7ccc-d3ae-4d56-a383-32b215349d9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:00.043477 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-790d7ccc-d3ae-4d56-a383-32b215349d9a None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:33:00.044578 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-790d7ccc-d3ae-4d56-a383-32b215349d9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:33:00.059902 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:00.122006 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 165/324] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 24 05:33:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 05:33:00.125276 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:00.130312 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf8c4c9-48b3-4c73-aa73-354f9c3f28a3 None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:00.151508 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790d7ccc-d3ae-4d56-a383-32b215349d9a None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:00.165856 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0ddf00-75a7-420c-b7a2-a1d5dc46e81f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:00.166633 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0ddf00-75a7-420c-b7a2-a1d5dc46e81f None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:00.167070 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0ddf00-75a7-420c-b7a2-a1d5dc46e81f None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:00.167351 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0ddf00-75a7-420c-b7a2-a1d5dc46e81f None admin] PATH_INFO: `/v3/domains/default` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:00.168450 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0ddf00-75a7-420c-b7a2-a1d5dc46e81f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:00.170305 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0ddf00-75a7-420c-b7a2-a1d5dc46e81f None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:00.174371 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 160/325] 10.222.0.26 () {56 vars in 1108 bytes} [Wed Aug 24 05:33:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:33:00.177194 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0ddf00-75a7-420c-b7a2-a1d5dc46e81f None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:00.261254 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790d7ccc-d3ae-4d56-a383-32b215349d9a None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:00.287183 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0ddf00-75a7-420c-b7a2-a1d5dc46e81f None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:00.295758 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e86e07e-1d74-4957-b536-1e5ca0038318 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:00.296326 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e86e07e-1d74-4957-b536-1e5ca0038318 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:00.296607 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e86e07e-1d74-4957-b536-1e5ca0038318 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:00.296881 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e86e07e-1d74-4957-b536-1e5ca0038318 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:00.307227 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e86e07e-1d74-4957-b536-1e5ca0038318 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:33:00.311981 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application [None req-1e86e07e-1d74-4957-b536-1e5ca0038318 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 05:33:00.311981 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:33:00.311981 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:33:00.311981 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:33:00.311981 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:33:00.311981 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:33:00.311981 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:33:00.311981 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:33:00.311981 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:33:00.311981 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:33:00.311981 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:33:00.311981 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:33:00.311981 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:33:00.311981 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:33:00.311981 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:33:00.311981 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:33:00.312832 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:33:00.312832 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:33:00.312832 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:33:00.312832 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:33:00.312832 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:33:00.312832 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:33:00.312832 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:33:00.312832 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:33:00.312832 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:33:00.312832 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:33:00.312832 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:33:00.312832 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application with Lock( Aug 24 05:33:00.312832 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:33:00.312832 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:33:00.312832 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:33:00.312832 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:33:00.313614 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:33:00.313614 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:33:00.313614 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:33:00.313614 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:33:00.313614 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:33:00.313614 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:33:00.313614 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:33:00.313614 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:33:00.313614 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:33:00.313614 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:33:00.313614 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 05:33:00.313614 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Aug 24 05:33:00.318724 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 166/326] 10.222.0.26 () {56 vars in 1099 bytes} [Wed Aug 24 05:33:00 2022] GET /identity/v3/roles/reader => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 05:33:00.319560 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e86e07e-1d74-4957-b536-1e5ca0038318 None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:00.324038 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1090606-0c87-4bdf-b1c4-cc8a44df6455 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:00.324393 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1090606-0c87-4bdf-b1c4-cc8a44df6455 None admin] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:00.324674 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1090606-0c87-4bdf-b1c4-cc8a44df6455 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:00.324945 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1090606-0c87-4bdf-b1c4-cc8a44df6455 None admin] PATH_INFO: `/v3/groups` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:00.325566 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1090606-0c87-4bdf-b1c4-cc8a44df6455 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:00.327051 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1090606-0c87-4bdf-b1c4-cc8a44df6455 None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:00.333157 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:00.346189 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 161/327] 10.222.0.26 () {60 vars in 1134 bytes} [Wed Aug 24 05:33:00 2022] POST /identity/v3/groups => generated 226 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 05:33:00.389633 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1090606-0c87-4bdf-b1c4-cc8a44df6455 None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:00.422519 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:00.434833 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e86e07e-1d74-4957-b536-1e5ca0038318 None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:00.474790 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473b4e58-ca50-402a-bd3c-291d53babf1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:00.475410 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473b4e58-ca50-402a-bd3c-291d53babf1e None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:00.475689 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473b4e58-ca50-402a-bd3c-291d53babf1e None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:00.475962 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473b4e58-ca50-402a-bd3c-291d53babf1e None admin] PATH_INFO: `/v3/roles` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:00.476643 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473b4e58-ca50-402a-bd3c-291d53babf1e None admin] RBAC: Adding query filter params (name=reader) {{(pid=88113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:33:00.476948 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473b4e58-ca50-402a-bd3c-291d53babf1e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:00.478376 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473b4e58-ca50-402a-bd3c-291d53babf1e None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:00.490036 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 167/328] 10.222.0.26 () {56 vars in 1101 bytes} [Wed Aug 24 05:33:00 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:33:00.494219 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473b4e58-ca50-402a-bd3c-291d53babf1e None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:00.516886 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1090606-0c87-4bdf-b1c4-cc8a44df6455 None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:00.556702 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b496c79-f3b7-40cf-8bd2-720194a58e76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:00.557535 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b496c79-f3b7-40cf-8bd2-720194a58e76 None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:00.558078 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b496c79-f3b7-40cf-8bd2-720194a58e76 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:00.558351 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b496c79-f3b7-40cf-8bd2-720194a58e76 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:00.573029 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:00.575045 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b496c79-f3b7-40cf-8bd2-720194a58e76 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:33:00.582323 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application [None req-2b496c79-f3b7-40cf-8bd2-720194a58e76 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 05:33:00.582323 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:33:00.582323 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:33:00.582323 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:33:00.582323 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:33:00.582323 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:33:00.582323 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:33:00.582323 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:33:00.582323 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:33:00.582323 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:33:00.582323 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:33:00.582323 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:33:00.582323 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:33:00.582323 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:33:00.582323 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:33:00.582323 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:33:00.583229 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:33:00.583229 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:33:00.583229 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:33:00.583229 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:33:00.583229 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:33:00.583229 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:33:00.583229 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:33:00.583229 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:33:00.583229 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:33:00.583229 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:33:00.583229 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:33:00.583229 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application with Lock( Aug 24 05:33:00.583229 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:33:00.583229 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:33:00.583229 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:33:00.583229 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:33:00.584167 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:33:00.584167 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:33:00.584167 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:33:00.584167 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:33:00.584167 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:33:00.584167 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:33:00.584167 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:33:00.584167 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:33:00.584167 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:33:00.584167 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:33:00.584167 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 05:33:00.584167 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Aug 24 05:33:00.584167 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 162/329] 10.222.0.26 () {56 vars in 1099 bytes} [Wed Aug 24 05:33:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 05:33:00.589995 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b496c79-f3b7-40cf-8bd2-720194a58e76 None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:00.614239 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473b4e58-ca50-402a-bd3c-291d53babf1e None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:00.662294 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3407256f-629a-4c52-9807-a76cf565ee35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:00.663888 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3407256f-629a-4c52-9807-a76cf565ee35 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:00.664792 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3407256f-629a-4c52-9807-a76cf565ee35 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:00.665211 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3407256f-629a-4c52-9807-a76cf565ee35 None admin] PATH_INFO: `/v3/users/5a104f9e85ae416280eb1b1dd215c6a1` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:00.666739 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3407256f-629a-4c52-9807-a76cf565ee35 None admin] RBAC: Authorizing `identity:get_user(user_id=5a104f9e85ae416280eb1b1dd215c6a1)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:00.668559 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3407256f-629a-4c52-9807-a76cf565ee35 None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:00.670793 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 168/330] 10.222.0.26 () {56 vars in 1177 bytes} [Wed Aug 24 05:33:00 2022] GET /identity/v3/users/5a104f9e85ae416280eb1b1dd215c6a1 => generated 293 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:33:00.676440 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3407256f-629a-4c52-9807-a76cf565ee35 None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:00.701185 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:00.715519 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b496c79-f3b7-40cf-8bd2-720194a58e76 None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:00.761744 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e900f0f3-89e8-4411-ba18-9b721b6536ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:00.762691 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e900f0f3-89e8-4411-ba18-9b721b6536ff None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:00.762970 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e900f0f3-89e8-4411-ba18-9b721b6536ff None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:00.763243 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e900f0f3-89e8-4411-ba18-9b721b6536ff None admin] PATH_INFO: `/v3/roles` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:00.763917 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e900f0f3-89e8-4411-ba18-9b721b6536ff None admin] RBAC: Adding query filter params (name=member) {{(pid=88112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:33:00.764216 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e900f0f3-89e8-4411-ba18-9b721b6536ff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:00.765591 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e900f0f3-89e8-4411-ba18-9b721b6536ff None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:00.777475 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 163/331] 10.222.0.26 () {56 vars in 1101 bytes} [Wed Aug 24 05:33:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:33:00.782783 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e900f0f3-89e8-4411-ba18-9b721b6536ff None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:00.800278 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3407256f-629a-4c52-9807-a76cf565ee35 None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:00.845565 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596017fa-ed75-4b4d-8f1b-4875ee548d9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:00.846658 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596017fa-ed75-4b4d-8f1b-4875ee548d9f None admin] REQUEST_METHOD: `PUT` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:00.847731 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596017fa-ed75-4b4d-8f1b-4875ee548d9f None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:00.848194 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596017fa-ed75-4b4d-8f1b-4875ee548d9f None admin] PATH_INFO: `/v3/system/users/5a104f9e85ae416280eb1b1dd215c6a1/roles/129798c59b2c43978b555869931dada4` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:00.849991 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596017fa-ed75-4b4d-8f1b-4875ee548d9f None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=5a104f9e85ae416280eb1b1dd215c6a1, role_id=129798c59b2c43978b555869931dada4)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:00.851671 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596017fa-ed75-4b4d-8f1b-4875ee548d9f None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:00.863364 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 169/332] 10.222.0.26 () {58 vars in 1334 bytes} [Wed Aug 24 05:33:00 2022] PUT /identity/v3/system/users/5a104f9e85ae416280eb1b1dd215c6a1/roles/129798c59b2c43978b555869931dada4 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 05:33:00.918194 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e900f0f3-89e8-4411-ba18-9b721b6536ff None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:00.957549 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4831b1-019d-4bb3-8eb6-208439149a73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:00.958247 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4831b1-019d-4bb3-8eb6-208439149a73 None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:00.958528 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4831b1-019d-4bb3-8eb6-208439149a73 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:00.958799 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4831b1-019d-4bb3-8eb6-208439149a73 None admin] PATH_INFO: `/v3/users/e09285e9d44543519d73540c18117fbc` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:00.960154 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4831b1-019d-4bb3-8eb6-208439149a73 None admin] RBAC: Authorizing `identity:get_user(user_id=e09285e9d44543519d73540c18117fbc)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:00.961782 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4831b1-019d-4bb3-8eb6-208439149a73 None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:00.963824 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 164/333] 10.222.0.26 () {56 vars in 1177 bytes} [Wed Aug 24 05:33:00 2022] GET /identity/v3/users/e09285e9d44543519d73540c18117fbc => generated 293 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:33:00.970283 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596017fa-ed75-4b4d-8f1b-4875ee548d9f None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:00.975845 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:01.083486 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596017fa-ed75-4b4d-8f1b-4875ee548d9f None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:01.124739 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8a3322-2c32-41fb-9631-b53777b9f53c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:01.125294 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8a3322-2c32-41fb-9631-b53777b9f53c None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:01.125572 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8a3322-2c32-41fb-9631-b53777b9f53c None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:01.125844 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8a3322-2c32-41fb-9631-b53777b9f53c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:01.126678 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8a3322-2c32-41fb-9631-b53777b9f53c None admin] RBAC: Adding query filter params (role.id=f7aa4a2c74c94c1b9ca8ecdcccccda5c, user.id=e09285e9d44543519d73540c18117fbc, scope.system=all) {{(pid=88113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:33:01.127036 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8a3322-2c32-41fb-9631-b53777b9f53c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:01.128630 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8a3322-2c32-41fb-9631-b53777b9f53c None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:01.146656 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 170/334] 10.222.0.26 () {56 vars in 1308 bytes} [Wed Aug 24 05:33:00 2022] GET /identity/v3/role_assignments?user.id=e09285e9d44543519d73540c18117fbc&scope.system=all&role.id=f7aa4a2c74c94c1b9ca8ecdcccccda5c => generated 510 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:33:02.852594 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba52878f-996a-44d5-a0a2-ce71027f9799 None None] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:02.853706 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba52878f-996a-44d5-a0a2-ce71027f9799 None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:02.854223 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba52878f-996a-44d5-a0a2-ce71027f9799 None None] PATH_INFO: `/` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:02.856115 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 165/335] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 24 05:33:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:33:02.861769 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b2d376-49a9-4f07-a587-8e3aeccce2d1 None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:02.863472 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b2d376-49a9-4f07-a587-8e3aeccce2d1 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:02.863984 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b2d376-49a9-4f07-a587-8e3aeccce2d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:02.883621 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-61b2d376-49a9-4f07-a587-8e3aeccce2d1 None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:33:02.885203 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-61b2d376-49a9-4f07-a587-8e3aeccce2d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:33:02.948539 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:02.961353 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 171/336] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 24 05:33:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 05:33:02.977131 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c38acd-5a46-411c-9f06-a1148e3524bd None None] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:02.977416 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c38acd-5a46-411c-9f06-a1148e3524bd None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:02.977699 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c38acd-5a46-411c-9f06-a1148e3524bd None None] PATH_INFO: `/` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:02.979341 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 166/337] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 24 05:33:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:33:02.984628 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4d831b-6b96-479e-b337-c670efb1bdd2 None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:02.984920 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4d831b-6b96-479e-b337-c670efb1bdd2 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:02.985196 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4d831b-6b96-479e-b337-c670efb1bdd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:03.015856 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-6e4d831b-6b96-479e-b337-c670efb1bdd2 None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:33:03.017160 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-6e4d831b-6b96-479e-b337-c670efb1bdd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:33:03.075406 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a94d95d-2128-48da-8e63-39e0adeaa448 None None] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:03.075721 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a94d95d-2128-48da-8e63-39e0adeaa448 None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:03.075962 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a94d95d-2128-48da-8e63-39e0adeaa448 None None] PATH_INFO: `/` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:03.077576 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 167/338] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 24 05:33:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:33:03.084356 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad521e4-221e-4a85-9448-09d94051c3ea None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:03.084883 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad521e4-221e-4a85-9448-09d94051c3ea None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:03.085364 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad521e4-221e-4a85-9448-09d94051c3ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:03.092687 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 172/339] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 24 05:33:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 05:33:03.120406 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-4ad521e4-221e-4a85-9448-09d94051c3ea None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:33:03.121908 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-4ad521e4-221e-4a85-9448-09d94051c3ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:33:03.144310 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:03.208939 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 168/340] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 24 05:33:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 05:33:03.520003 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4d831b-6b96-479e-b337-c670efb1bdd2 None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:03.557291 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad521e4-221e-4a85-9448-09d94051c3ea None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:03.640478 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4d831b-6b96-479e-b337-c670efb1bdd2 None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:03.668486 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:03.683276 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6ace7d-ca2f-433a-b13b-59a324d78462 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:03.684284 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6ace7d-ca2f-433a-b13b-59a324d78462 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:03.684876 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6ace7d-ca2f-433a-b13b-59a324d78462 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:03.685300 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6ace7d-ca2f-433a-b13b-59a324d78462 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:03.697175 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6ace7d-ca2f-433a-b13b-59a324d78462 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:33:03.703647 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application [None req-3f6ace7d-ca2f-433a-b13b-59a324d78462 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 05:33:03.703647 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:33:03.703647 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:33:03.703647 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:33:03.703647 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:33:03.703647 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:33:03.703647 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:33:03.703647 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:33:03.703647 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:33:03.703647 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:33:03.703647 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:33:03.703647 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:33:03.703647 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:33:03.703647 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:33:03.703647 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:33:03.703647 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:33:03.704767 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:33:03.704767 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:33:03.704767 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:33:03.704767 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:33:03.704767 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:33:03.704767 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:33:03.704767 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:33:03.704767 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:33:03.704767 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:33:03.704767 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:33:03.704767 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:33:03.704767 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application with Lock( Aug 24 05:33:03.704767 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:33:03.704767 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:33:03.704767 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:33:03.704767 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:33:03.705771 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:33:03.705771 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:33:03.705771 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:33:03.705771 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:33:03.705771 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:33:03.705771 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:33:03.705771 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:33:03.705771 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:33:03.705771 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:33:03.705771 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:33:03.705771 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 05:33:03.705771 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Aug 24 05:33:03.713334 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 173/341] 10.222.0.26 () {56 vars in 1099 bytes} [Wed Aug 24 05:33:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:33:03.714623 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6ace7d-ca2f-433a-b13b-59a324d78462 None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:03.752136 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad521e4-221e-4a85-9448-09d94051c3ea None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:03.791995 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087f2f77-394c-46ed-b49f-f327d2095993 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:03.792476 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087f2f77-394c-46ed-b49f-f327d2095993 None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:03.792754 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087f2f77-394c-46ed-b49f-f327d2095993 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:03.793023 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087f2f77-394c-46ed-b49f-f327d2095993 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:03.803870 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087f2f77-394c-46ed-b49f-f327d2095993 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:33:03.810872 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application [None req-087f2f77-394c-46ed-b49f-f327d2095993 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 05:33:03.810872 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:33:03.810872 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:33:03.810872 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:33:03.810872 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:33:03.810872 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:33:03.810872 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:33:03.810872 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:33:03.810872 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:33:03.810872 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:33:03.810872 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:33:03.810872 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:33:03.810872 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:33:03.810872 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:33:03.810872 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:33:03.810872 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:33:03.811972 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:33:03.811972 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:33:03.811972 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:33:03.811972 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:33:03.811972 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:33:03.811972 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:33:03.811972 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:33:03.811972 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:33:03.811972 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:33:03.811972 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:33:03.811972 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:33:03.811972 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application with Lock( Aug 24 05:33:03.811972 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:33:03.811972 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:33:03.811972 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:33:03.811972 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:33:03.812963 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:33:03.812963 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:33:03.812963 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:33:03.812963 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:33:03.812963 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:33:03.812963 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:33:03.812963 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:33:03.812963 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:33:03.812963 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:33:03.812963 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:33:03.812963 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 05:33:03.812963 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Aug 24 05:33:03.812963 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 169/342] 10.222.0.26 () {56 vars in 1114 bytes} [Wed Aug 24 05:33:03 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:33:03.815131 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d90d11-1a1b-4a91-a6a4-4bcd091a0c21 None None] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:03.816578 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d90d11-1a1b-4a91-a6a4-4bcd091a0c21 None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:03.816578 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d90d11-1a1b-4a91-a6a4-4bcd091a0c21 None None] PATH_INFO: `/` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:03.817498 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 170/343] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 24 05:33:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:33:03.822509 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d90d11-1a1b-4a91-a6a4-4bcd091a0c21 None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:03.836209 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:03.856268 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6ace7d-ca2f-433a-b13b-59a324d78462 None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:03.897583 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927ab533-898b-4e3d-9809-ac87de04eac8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:03.898265 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927ab533-898b-4e3d-9809-ac87de04eac8 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:03.898597 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927ab533-898b-4e3d-9809-ac87de04eac8 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:03.898871 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927ab533-898b-4e3d-9809-ac87de04eac8 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:03.914378 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927ab533-898b-4e3d-9809-ac87de04eac8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:33:03.921917 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application [None req-927ab533-898b-4e3d-9809-ac87de04eac8 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 05:33:03.921917 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:33:03.921917 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:33:03.921917 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:33:03.921917 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:33:03.921917 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:33:03.921917 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:33:03.921917 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:33:03.921917 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:33:03.921917 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:33:03.921917 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:33:03.921917 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:33:03.921917 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:33:03.921917 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:33:03.921917 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:33:03.921917 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:33:03.923050 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:33:03.923050 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:33:03.923050 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:33:03.923050 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:33:03.923050 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:33:03.923050 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:33:03.923050 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:33:03.923050 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:33:03.923050 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:33:03.923050 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:33:03.923050 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:33:03.923050 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application with Lock( Aug 24 05:33:03.923050 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:33:03.923050 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:33:03.923050 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:33:03.923050 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:33:03.924190 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:33:03.924190 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:33:03.924190 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:33:03.924190 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:33:03.924190 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:33:03.924190 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:33:03.924190 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:33:03.924190 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:33:03.924190 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:33:03.924190 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:33:03.924190 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 05:33:03.924190 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Aug 24 05:33:03.924190 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 174/344] 10.222.0.26 () {56 vars in 1099 bytes} [Wed Aug 24 05:33:03 2022] GET /identity/v3/roles/reader => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:33:03.924924 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927ab533-898b-4e3d-9809-ac87de04eac8 None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:03.974143 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d90d11-1a1b-4a91-a6a4-4bcd091a0c21 None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:03.983556 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:04.021782 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf6ce9e-56be-4633-a8f1-97d27bce66aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:04.022501 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf6ce9e-56be-4633-a8f1-97d27bce66aa None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:04.022789 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf6ce9e-56be-4633-a8f1-97d27bce66aa None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:04.023062 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf6ce9e-56be-4633-a8f1-97d27bce66aa None admin] PATH_INFO: `/v3/roles` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:04.023748 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf6ce9e-56be-4633-a8f1-97d27bce66aa None admin] RBAC: Adding query filter params (name=member) {{(pid=88112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:33:04.024053 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf6ce9e-56be-4633-a8f1-97d27bce66aa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:04.025444 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf6ce9e-56be-4633-a8f1-97d27bce66aa None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:04.037324 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 171/345] 10.222.0.26 () {56 vars in 1101 bytes} [Wed Aug 24 05:33:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:33:04.043088 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8a4267-cf8c-41c5-9319-65932ae568b5 None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:04.043322 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8a4267-cf8c-41c5-9319-65932ae568b5 None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:04.043599 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8a4267-cf8c-41c5-9319-65932ae568b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:04.059934 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927ab533-898b-4e3d-9809-ac87de04eac8 None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:04.062607 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-bf8a4267-cf8c-41c5-9319-65932ae568b5 None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:33:04.063866 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-bf8a4267-cf8c-41c5-9319-65932ae568b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:33:04.106725 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd5a261-1370-44cf-bcab-d31e4d4e52c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:04.109175 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd5a261-1370-44cf-bcab-d31e4d4e52c5 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:04.109684 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd5a261-1370-44cf-bcab-d31e4d4e52c5 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:04.110190 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd5a261-1370-44cf-bcab-d31e4d4e52c5 None admin] PATH_INFO: `/v3/roles` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:04.111091 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd5a261-1370-44cf-bcab-d31e4d4e52c5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:33:04.111601 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd5a261-1370-44cf-bcab-d31e4d4e52c5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:04.113853 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd5a261-1370-44cf-bcab-d31e4d4e52c5 None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:04.126587 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 175/346] 10.222.0.26 () {56 vars in 1111 bytes} [Wed Aug 24 05:33:03 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:33:04.127857 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd5a261-1370-44cf-bcab-d31e4d4e52c5 None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:04.143943 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:04.149622 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 172/347] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 24 05:33:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 05:33:04.150422 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8a4267-cf8c-41c5-9319-65932ae568b5 None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:04.250903 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd5a261-1370-44cf-bcab-d31e4d4e52c5 None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:04.253797 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:04.291932 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255fdb9d-96ab-4924-843e-598456789803 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:04.293084 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255fdb9d-96ab-4924-843e-598456789803 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:04.293583 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255fdb9d-96ab-4924-843e-598456789803 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:04.294191 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255fdb9d-96ab-4924-843e-598456789803 None admin] PATH_INFO: `/v3/roles` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:04.295144 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255fdb9d-96ab-4924-843e-598456789803 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:33:04.295612 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255fdb9d-96ab-4924-843e-598456789803 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:04.297133 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255fdb9d-96ab-4924-843e-598456789803 None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:04.308873 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 176/348] 10.222.0.26 () {56 vars in 1101 bytes} [Wed Aug 24 05:33:04 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:33:04.310306 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255fdb9d-96ab-4924-843e-598456789803 None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:04.391924 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8a4267-cf8c-41c5-9319-65932ae568b5 None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:04.434281 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255fdb9d-96ab-4924-843e-598456789803 None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:04.456732 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cabc468-63cc-4c33-a182-11bf1021de21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:04.457357 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cabc468-63cc-4c33-a182-11bf1021de21 None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:04.457640 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cabc468-63cc-4c33-a182-11bf1021de21 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:04.457913 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cabc468-63cc-4c33-a182-11bf1021de21 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:04.482329 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a7b639-3c80-40ae-9481-669fe0c83509 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:04.483571 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a7b639-3c80-40ae-9481-669fe0c83509 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:04.484081 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a7b639-3c80-40ae-9481-669fe0c83509 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:04.484555 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a7b639-3c80-40ae-9481-669fe0c83509 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:04.530924 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:04.552753 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:04.556425 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cabc468-63cc-4c33-a182-11bf1021de21 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:04.558881 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cabc468-63cc-4c33-a182-11bf1021de21 None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:04.580223 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a7b639-3c80-40ae-9481-669fe0c83509 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:04.580223 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a7b639-3c80-40ae-9481-669fe0c83509 None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:04.708328 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 173/349] 10.222.0.26 () {58 vars in 1282 bytes} [Wed Aug 24 05:33:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 558 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 05:33:04.710392 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cabc468-63cc-4c33-a182-11bf1021de21 None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:04.721987 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 177/350] 10.222.0.26 () {58 vars in 1282 bytes} [Wed Aug 24 05:33:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 05:33:04.721987 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b82b272-a87f-4ec0-b433-a4aecb87495b None None] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:04.721987 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b82b272-a87f-4ec0-b433-a4aecb87495b None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:04.721987 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b82b272-a87f-4ec0-b433-a4aecb87495b None None] PATH_INFO: `/` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:04.721987 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 178/351] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 24 05:33:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:33:04.722636 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b82b272-a87f-4ec0-b433-a4aecb87495b None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:04.808818 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:04.845282 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:04.849212 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cabc468-63cc-4c33-a182-11bf1021de21 None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:04.858155 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b82b272-a87f-4ec0-b433-a4aecb87495b None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:04.896123 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126ab503-3431-486c-ae4e-f005454afd44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:04.896763 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126ab503-3431-486c-ae4e-f005454afd44 None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:04.897042 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126ab503-3431-486c-ae4e-f005454afd44 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:04.897316 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126ab503-3431-486c-ae4e-f005454afd44 None admin] PATH_INFO: `/v3/users/5a104f9e85ae416280eb1b1dd215c6a1` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:04.898496 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126ab503-3431-486c-ae4e-f005454afd44 None admin] RBAC: Authorizing `identity:get_user(user_id=5a104f9e85ae416280eb1b1dd215c6a1)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:04.899953 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126ab503-3431-486c-ae4e-f005454afd44 None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:04.901059 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e792c6a-11e8-43cc-8b7a-c89f9a2b30ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:04.901527 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 174/352] 10.222.0.26 () {56 vars in 1177 bytes} [Wed Aug 24 05:33:04 2022] GET /identity/v3/users/5a104f9e85ae416280eb1b1dd215c6a1 => generated 293 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:33:04.901999 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e792c6a-11e8-43cc-8b7a-c89f9a2b30ee None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:04.901999 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e792c6a-11e8-43cc-8b7a-c89f9a2b30ee None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:04.902289 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e792c6a-11e8-43cc-8b7a-c89f9a2b30ee None admin] PATH_INFO: `/v3/roles/member` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:04.903610 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126ab503-3431-486c-ae4e-f005454afd44 None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:04.918656 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e792c6a-11e8-43cc-8b7a-c89f9a2b30ee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:33:04.923478 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application [None req-4e792c6a-11e8-43cc-8b7a-c89f9a2b30ee None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 05:33:04.923478 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:33:04.923478 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:33:04.923478 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:33:04.923478 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:33:04.923478 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:33:04.923478 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:33:04.923478 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:33:04.923478 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:33:04.923478 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:33:04.923478 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:33:04.923478 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:33:04.923478 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:33:04.923478 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:33:04.923478 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:33:04.923478 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:33:04.924337 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:33:04.924337 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:33:04.924337 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:33:04.924337 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:33:04.924337 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:33:04.924337 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:33:04.924337 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:33:04.924337 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:33:04.924337 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:33:04.924337 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:33:04.924337 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:33:04.924337 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application with Lock( Aug 24 05:33:04.924337 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:33:04.924337 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:33:04.924337 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:33:04.924337 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:33:04.925760 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:33:04.925760 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:33:04.925760 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:33:04.925760 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:33:04.925760 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:33:04.925760 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:33:04.925760 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:33:04.925760 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:33:04.925760 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:33:04.925760 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:33:04.925760 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 05:33:04.925760 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Aug 24 05:33:04.925760 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 179/353] 10.222.0.26 () {56 vars in 1099 bytes} [Wed Aug 24 05:33:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:33:04.927228 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71031e7e-77e8-4bfd-a9c1-f21c173c613d None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:04.927228 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71031e7e-77e8-4bfd-a9c1-f21c173c613d None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:04.927228 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71031e7e-77e8-4bfd-a9c1-f21c173c613d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:04.950183 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-71031e7e-77e8-4bfd-a9c1-f21c173c613d None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:33:04.951707 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-71031e7e-77e8-4bfd-a9c1-f21c173c613d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:33:05.034009 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126ab503-3431-486c-ae4e-f005454afd44 None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:05.039485 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 180/354] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 24 05:33:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 05:33:05.040329 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71031e7e-77e8-4bfd-a9c1-f21c173c613d None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:05.079758 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15433f37-f72c-4324-87ff-9acc8a87cad2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:05.080378 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15433f37-f72c-4324-87ff-9acc8a87cad2 None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:05.080658 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15433f37-f72c-4324-87ff-9acc8a87cad2 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:05.080975 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15433f37-f72c-4324-87ff-9acc8a87cad2 None admin] PATH_INFO: `/v3/projects/d4bde08b78fc4447a53a2928b2d22185` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:05.084116 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15433f37-f72c-4324-87ff-9acc8a87cad2 None admin] RBAC: Authorizing `identity:get_project(project_id=d4bde08b78fc4447a53a2928b2d22185)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:05.084116 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15433f37-f72c-4324-87ff-9acc8a87cad2 None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:05.086125 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 175/355] 10.222.0.26 () {56 vars in 1186 bytes} [Wed Aug 24 05:33:04 2022] GET /identity/v3/projects/d4bde08b78fc4447a53a2928b2d22185 => generated 298 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:33:05.086938 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15433f37-f72c-4324-87ff-9acc8a87cad2 None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:05.104513 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:05.127653 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:05.166399 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71031e7e-77e8-4bfd-a9c1-f21c173c613d None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:05.207008 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b11b401-535d-4e56-979f-a1cd050bf57a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:05.207645 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b11b401-535d-4e56-979f-a1cd050bf57a None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:05.207922 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b11b401-535d-4e56-979f-a1cd050bf57a None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:05.208188 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b11b401-535d-4e56-979f-a1cd050bf57a None admin] PATH_INFO: `/v3/projects/d4bde08b78fc4447a53a2928b2d22185` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:05.209317 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b11b401-535d-4e56-979f-a1cd050bf57a None admin] RBAC: Authorizing `identity:get_project(project_id=d4bde08b78fc4447a53a2928b2d22185)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:05.210815 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b11b401-535d-4e56-979f-a1cd050bf57a None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:05.211557 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15433f37-f72c-4324-87ff-9acc8a87cad2 None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:05.212592 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 181/356] 10.222.0.26 () {56 vars in 1186 bytes} [Wed Aug 24 05:33:05 2022] GET /identity/v3/projects/d4bde08b78fc4447a53a2928b2d22185 => generated 298 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:33:05.213183 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b11b401-535d-4e56-979f-a1cd050bf57a None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:05.260065 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ce9453-4417-4aa5-bd4a-e7fd7cbd9599 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:05.260733 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ce9453-4417-4aa5-bd4a-e7fd7cbd9599 None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:05.261018 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ce9453-4417-4aa5-bd4a-e7fd7cbd9599 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:05.261737 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ce9453-4417-4aa5-bd4a-e7fd7cbd9599 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:05.262589 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ce9453-4417-4aa5-bd4a-e7fd7cbd9599 None admin] RBAC: Adding query filter params (role.id=129798c59b2c43978b555869931dada4, user.id=5a104f9e85ae416280eb1b1dd215c6a1, scope.system=all) {{(pid=88112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:33:05.262847 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ce9453-4417-4aa5-bd4a-e7fd7cbd9599 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:05.264676 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ce9453-4417-4aa5-bd4a-e7fd7cbd9599 None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:05.279406 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 176/357] 10.222.0.26 () {56 vars in 1308 bytes} [Wed Aug 24 05:33:05 2022] GET /identity/v3/role_assignments?user.id=5a104f9e85ae416280eb1b1dd215c6a1&scope.system=all&role.id=129798c59b2c43978b555869931dada4 => generated 510 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:33:05.281095 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e90a47-7a27-4cb7-8e78-04109707ded3 None None] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:05.281395 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e90a47-7a27-4cb7-8e78-04109707ded3 None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:05.281803 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e90a47-7a27-4cb7-8e78-04109707ded3 None None] PATH_INFO: `/` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:05.284611 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 177/358] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 24 05:33:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:33:05.285430 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e90a47-7a27-4cb7-8e78-04109707ded3 None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:05.344567 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b11b401-535d-4e56-979f-a1cd050bf57a None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:05.375872 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:05.388979 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fee437-7061-4edd-964b-65c8acdbf893 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:05.389997 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fee437-7061-4edd-964b-65c8acdbf893 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:05.390479 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fee437-7061-4edd-964b-65c8acdbf893 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:05.390945 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fee437-7061-4edd-964b-65c8acdbf893 None admin] PATH_INFO: `/v3/roles` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:05.392627 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fee437-7061-4edd-964b-65c8acdbf893 None admin] RBAC: Adding query filter params (name=member) {{(pid=88113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:33:05.393164 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fee437-7061-4edd-964b-65c8acdbf893 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:05.394858 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fee437-7061-4edd-964b-65c8acdbf893 None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:05.406830 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 182/359] 10.222.0.26 () {56 vars in 1101 bytes} [Wed Aug 24 05:33:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:33:05.407938 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fee437-7061-4edd-964b-65c8acdbf893 None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:05.413633 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:05.424395 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e90a47-7a27-4cb7-8e78-04109707ded3 None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:05.475240 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c5adeb-e2f8-4d6b-8838-b898f30e3d48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:05.475889 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c5adeb-e2f8-4d6b-8838-b898f30e3d48 None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:05.476168 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c5adeb-e2f8-4d6b-8838-b898f30e3d48 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:05.476442 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c5adeb-e2f8-4d6b-8838-b898f30e3d48 None admin] PATH_INFO: `/v3/groups/f7c18e21d27e4c80b57795d2a79500b6` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:05.483986 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c5adeb-e2f8-4d6b-8838-b898f30e3d48 None admin] RBAC: Authorizing `identity:get_group(group_id=f7c18e21d27e4c80b57795d2a79500b6)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:05.485808 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c5adeb-e2f8-4d6b-8838-b898f30e3d48 None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:05.489779 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 178/360] 10.222.0.26 () {56 vars in 1180 bytes} [Wed Aug 24 05:33:05 2022] GET /identity/v3/groups/f7c18e21d27e4c80b57795d2a79500b6 => generated 226 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:33:05.491324 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca91893d-74bc-4d82-bd4c-1ff4efe4ab73 None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:05.491888 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca91893d-74bc-4d82-bd4c-1ff4efe4ab73 None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:05.492165 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca91893d-74bc-4d82-bd4c-1ff4efe4ab73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:05.520158 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-ca91893d-74bc-4d82-bd4c-1ff4efe4ab73 None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:33:05.521358 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-ca91893d-74bc-4d82-bd4c-1ff4efe4ab73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:33:05.541403 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fee437-7061-4edd-964b-65c8acdbf893 None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:05.579935 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2411584c-d5db-4c27-b029-ae216d2f90c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:05.580558 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2411584c-d5db-4c27-b029-ae216d2f90c5 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:05.580860 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2411584c-d5db-4c27-b029-ae216d2f90c5 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:05.581130 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2411584c-d5db-4c27-b029-ae216d2f90c5 None admin] PATH_INFO: `/v3/groups/f7c18e21d27e4c80b57795d2a79500b6` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:05.582271 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2411584c-d5db-4c27-b029-ae216d2f90c5 None admin] RBAC: Authorizing `identity:get_group(group_id=f7c18e21d27e4c80b57795d2a79500b6)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:05.583713 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2411584c-d5db-4c27-b029-ae216d2f90c5 None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:05.585277 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 183/361] 10.222.0.26 () {56 vars in 1180 bytes} [Wed Aug 24 05:33:05 2022] GET /identity/v3/groups/f7c18e21d27e4c80b57795d2a79500b6 => generated 226 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:33:05.586106 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2411584c-d5db-4c27-b029-ae216d2f90c5 None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:05.599154 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 179/362] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 24 05:33:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 05:33:05.599930 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca91893d-74bc-4d82-bd4c-1ff4efe4ab73 None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:05.665139 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:05.715446 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:05.731767 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca91893d-74bc-4d82-bd4c-1ff4efe4ab73 None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:05.735111 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2411584c-d5db-4c27-b029-ae216d2f90c5 None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:05.778480 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8858d02-e7f8-4a8b-b16c-cf158cc5885a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:05.779106 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8858d02-e7f8-4a8b-b16c-cf158cc5885a None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:05.779388 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8858d02-e7f8-4a8b-b16c-cf158cc5885a None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:05.779665 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8858d02-e7f8-4a8b-b16c-cf158cc5885a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:05.783518 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415da947-c25a-4c8f-a560-07425d77848f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:05.784994 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415da947-c25a-4c8f-a560-07425d77848f None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:05.785278 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415da947-c25a-4c8f-a560-07425d77848f None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:05.785550 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415da947-c25a-4c8f-a560-07425d77848f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:05.798023 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415da947-c25a-4c8f-a560-07425d77848f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:33:05.804458 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application [None req-415da947-c25a-4c8f-a560-07425d77848f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 05:33:05.804458 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:33:05.804458 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:33:05.804458 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:33:05.804458 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:33:05.804458 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:33:05.804458 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:33:05.804458 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:33:05.804458 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:33:05.804458 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:33:05.804458 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:33:05.804458 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:33:05.804458 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:33:05.804458 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:33:05.804458 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:33:05.804458 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:33:05.805364 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:33:05.805364 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:33:05.805364 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:33:05.805364 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:33:05.805364 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:33:05.805364 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:33:05.805364 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:33:05.805364 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:33:05.805364 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:33:05.805364 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:33:05.805364 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:33:05.805364 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application with Lock( Aug 24 05:33:05.805364 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:33:05.805364 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:33:05.805364 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:33:05.805364 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:33:05.806292 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:33:05.806292 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:33:05.806292 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:33:05.806292 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:33:05.806292 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:33:05.806292 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:33:05.806292 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:33:05.806292 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:33:05.806292 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:33:05.806292 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:33:05.806292 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 05:33:05.806292 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Aug 24 05:33:05.806292 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 184/363] 10.222.0.26 () {56 vars in 1114 bytes} [Wed Aug 24 05:33:05 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:33:05.806936 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415da947-c25a-4c8f-a560-07425d77848f None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:05.864159 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8858d02-e7f8-4a8b-b16c-cf158cc5885a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:05.865550 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8858d02-e7f8-4a8b-b16c-cf158cc5885a None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:05.931647 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415da947-c25a-4c8f-a560-07425d77848f None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:05.950179 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:05.978469 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fe191e-a51a-4270-b998-db42706f7785 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:05.979382 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fe191e-a51a-4270-b998-db42706f7785 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:05.979721 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fe191e-a51a-4270-b998-db42706f7785 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:05.980949 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fe191e-a51a-4270-b998-db42706f7785 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:05.980949 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fe191e-a51a-4270-b998-db42706f7785 None admin] RBAC: Adding query filter params (group.id=f7c18e21d27e4c80b57795d2a79500b6, role.id=f7aa4a2c74c94c1b9ca8ecdcccccda5c, scope.project.id=d4bde08b78fc4447a53a2928b2d22185) {{(pid=88113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:33:05.981186 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fe191e-a51a-4270-b998-db42706f7785 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:05.982672 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fe191e-a51a-4270-b998-db42706f7785 None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:05.983243 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:05.989663 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 185/364] 10.222.0.26 () {56 vars in 1376 bytes} [Wed Aug 24 05:33:05 2022] GET /identity/v3/role_assignments?group.id=f7c18e21d27e4c80b57795d2a79500b6&scope.project.id=d4bde08b78fc4447a53a2928b2d22185&role.id=f7aa4a2c74c94c1b9ca8ecdcccccda5c => generated 260 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:33:05.989839 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fe191e-a51a-4270-b998-db42706f7785 None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:06.003698 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 180/365] 10.222.0.26 () {58 vars in 1282 bytes} [Wed Aug 24 05:33:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 05:33:06.003895 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8858d02-e7f8-4a8b-b16c-cf158cc5885a None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:06.118916 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fe191e-a51a-4270-b998-db42706f7785 None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:06.145696 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8858d02-e7f8-4a8b-b16c-cf158cc5885a None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:06.169835 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c325a956-fce5-4416-b24c-4ca6eb5a6e40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:06.170485 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c325a956-fce5-4416-b24c-4ca6eb5a6e40 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:06.170768 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c325a956-fce5-4416-b24c-4ca6eb5a6e40 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:06.171045 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c325a956-fce5-4416-b24c-4ca6eb5a6e40 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:06.171811 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c325a956-fce5-4416-b24c-4ca6eb5a6e40 None admin] RBAC: Adding query filter params (group.id=f7c18e21d27e4c80b57795d2a79500b6, role.id=109c3556f4644bd291e81b0aa7fe2598, scope.project.id=d4bde08b78fc4447a53a2928b2d22185) {{(pid=88113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:33:06.172122 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c325a956-fce5-4416-b24c-4ca6eb5a6e40 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:06.173576 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c325a956-fce5-4416-b24c-4ca6eb5a6e40 None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:06.180771 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 186/366] 10.222.0.26 () {56 vars in 1376 bytes} [Wed Aug 24 05:33:05 2022] GET /identity/v3/role_assignments?group.id=f7c18e21d27e4c80b57795d2a79500b6&scope.project.id=d4bde08b78fc4447a53a2928b2d22185&role.id=109c3556f4644bd291e81b0aa7fe2598 => generated 260 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:33:06.181510 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c325a956-fce5-4416-b24c-4ca6eb5a6e40 None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:06.195393 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05d928b-8f5c-4d7e-b0cb-ba7100e00bb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:06.196519 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05d928b-8f5c-4d7e-b0cb-ba7100e00bb5 None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:06.197000 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05d928b-8f5c-4d7e-b0cb-ba7100e00bb5 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:06.198701 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05d928b-8f5c-4d7e-b0cb-ba7100e00bb5 None admin] PATH_INFO: `/v3/roles` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:06.199577 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05d928b-8f5c-4d7e-b0cb-ba7100e00bb5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:33:06.199989 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05d928b-8f5c-4d7e-b0cb-ba7100e00bb5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:06.201712 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05d928b-8f5c-4d7e-b0cb-ba7100e00bb5 None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:06.214019 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 181/367] 10.222.0.26 () {56 vars in 1111 bytes} [Wed Aug 24 05:33:06 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:33:06.214019 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05d928b-8f5c-4d7e-b0cb-ba7100e00bb5 None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:06.238675 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:06.285045 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:06.331763 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c325a956-fce5-4416-b24c-4ca6eb5a6e40 None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:06.360031 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05d928b-8f5c-4d7e-b0cb-ba7100e00bb5 None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:06.374538 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dae534-97d5-4e0e-a6ac-15a3d68ceb01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:06.375247 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dae534-97d5-4e0e-a6ac-15a3d68ceb01 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:06.375538 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dae534-97d5-4e0e-a6ac-15a3d68ceb01 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:06.375882 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dae534-97d5-4e0e-a6ac-15a3d68ceb01 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:06.396490 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dae534-97d5-4e0e-a6ac-15a3d68ceb01 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:33:06.401692 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac54fe6-ab14-4325-9518-813083fb4cf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:06.402596 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application [None req-25dae534-97d5-4e0e-a6ac-15a3d68ceb01 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 05:33:06.402596 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:33:06.402596 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:33:06.402596 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:33:06.402596 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:33:06.402596 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:33:06.402596 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:33:06.402596 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:33:06.402596 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:33:06.402596 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:33:06.402596 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:33:06.402596 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:33:06.402596 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:33:06.402596 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:33:06.402596 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:33:06.402596 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:33:06.403466 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:33:06.403466 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:33:06.403466 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:33:06.403466 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:33:06.403466 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:33:06.403466 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:33:06.403466 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:33:06.403466 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:33:06.403466 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:33:06.403466 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:33:06.403466 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:33:06.403466 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application with Lock( Aug 24 05:33:06.403466 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:33:06.403466 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:33:06.403466 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:33:06.403466 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:33:06.404268 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:33:06.404268 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:33:06.404268 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:33:06.404268 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:33:06.404268 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:33:06.404268 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:33:06.404268 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:33:06.404268 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:33:06.404268 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:33:06.404268 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:33:06.404268 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 05:33:06.404268 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Aug 24 05:33:06.404268 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 187/368] 10.222.0.26 () {56 vars in 1096 bytes} [Wed Aug 24 05:33:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:33:06.405037 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dae534-97d5-4e0e-a6ac-15a3d68ceb01 None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:06.405182 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac54fe6-ab14-4325-9518-813083fb4cf6 None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:06.405688 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac54fe6-ab14-4325-9518-813083fb4cf6 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:06.406174 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac54fe6-ab14-4325-9518-813083fb4cf6 None admin] PATH_INFO: `/v3/projects/354a816414fb4c1d8f99d5307047be89` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:06.408089 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac54fe6-ab14-4325-9518-813083fb4cf6 None admin] RBAC: Authorizing `identity:get_project(project_id=354a816414fb4c1d8f99d5307047be89)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:06.411368 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac54fe6-ab14-4325-9518-813083fb4cf6 None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:06.413273 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 182/369] 10.222.0.26 () {56 vars in 1186 bytes} [Wed Aug 24 05:33:06 2022] GET /identity/v3/projects/354a816414fb4c1d8f99d5307047be89 => generated 302 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:33:06.414474 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac54fe6-ab14-4325-9518-813083fb4cf6 None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:06.531403 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dae534-97d5-4e0e-a6ac-15a3d68ceb01 None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:06.536808 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:06.562319 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac54fe6-ab14-4325-9518-813083fb4cf6 None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:06.581591 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706b7f77-9e97-4a64-982f-68faf5749bbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:06.582244 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706b7f77-9e97-4a64-982f-68faf5749bbb None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:06.582763 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706b7f77-9e97-4a64-982f-68faf5749bbb None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:06.583049 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706b7f77-9e97-4a64-982f-68faf5749bbb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:06.586747 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:06.609151 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c94c7f-b142-4172-825a-4b82bce6912c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:06.610447 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c94c7f-b142-4172-825a-4b82bce6912c None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:06.610972 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c94c7f-b142-4172-825a-4b82bce6912c None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:06.611450 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c94c7f-b142-4172-825a-4b82bce6912c None admin] PATH_INFO: `/v3/roles` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:06.612340 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c94c7f-b142-4172-825a-4b82bce6912c None admin] RBAC: Adding query filter params (name=admin) {{(pid=88112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:33:06.613244 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c94c7f-b142-4172-825a-4b82bce6912c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:06.615291 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c94c7f-b142-4172-825a-4b82bce6912c None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:06.627734 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 183/370] 10.222.0.26 () {56 vars in 1099 bytes} [Wed Aug 24 05:33:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:33:06.628726 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c94c7f-b142-4172-825a-4b82bce6912c None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:06.675610 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706b7f77-9e97-4a64-982f-68faf5749bbb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:06.677459 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706b7f77-9e97-4a64-982f-68faf5749bbb None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:06.761906 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c94c7f-b142-4172-825a-4b82bce6912c None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:06.804801 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 188/371] 10.222.0.26 () {58 vars in 1282 bytes} [Wed Aug 24 05:33:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 05:33:06.806013 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706b7f77-9e97-4a64-982f-68faf5749bbb None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:06.811825 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65badb83-30c5-4fe8-9099-42f79086810d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:06.812474 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65badb83-30c5-4fe8-9099-42f79086810d None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:06.812767 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65badb83-30c5-4fe8-9099-42f79086810d None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:06.813043 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65badb83-30c5-4fe8-9099-42f79086810d None admin] PATH_INFO: `/v3/groups/f7c18e21d27e4c80b57795d2a79500b6` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:06.814943 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65badb83-30c5-4fe8-9099-42f79086810d None admin] RBAC: Authorizing `identity:get_group(group_id=f7c18e21d27e4c80b57795d2a79500b6)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:06.816948 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65badb83-30c5-4fe8-9099-42f79086810d None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:06.819171 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 184/372] 10.222.0.26 () {56 vars in 1180 bytes} [Wed Aug 24 05:33:06 2022] GET /identity/v3/groups/f7c18e21d27e4c80b57795d2a79500b6 => generated 226 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:33:06.820071 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65badb83-30c5-4fe8-9099-42f79086810d None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:06.833179 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:06.890424 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:06.931697 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706b7f77-9e97-4a64-982f-68faf5749bbb None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:06.953565 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65badb83-30c5-4fe8-9099-42f79086810d None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:06.971746 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f25f54a-1a64-4bde-8abb-0deebd83a165 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:06.972500 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f25f54a-1a64-4bde-8abb-0deebd83a165 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:06.973161 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f25f54a-1a64-4bde-8abb-0deebd83a165 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:06.973161 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f25f54a-1a64-4bde-8abb-0deebd83a165 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:06.998463 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2b45f2-cdf8-4059-9e9a-a91ac1c9d697 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:06.999372 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2b45f2-cdf8-4059-9e9a-a91ac1c9d697 None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:07.000256 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2b45f2-cdf8-4059-9e9a-a91ac1c9d697 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:07.000698 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2b45f2-cdf8-4059-9e9a-a91ac1c9d697 None admin] PATH_INFO: `/v3/projects/354a816414fb4c1d8f99d5307047be89` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:07.002293 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2b45f2-cdf8-4059-9e9a-a91ac1c9d697 None admin] RBAC: Authorizing `identity:get_project(project_id=354a816414fb4c1d8f99d5307047be89)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:07.005238 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2b45f2-cdf8-4059-9e9a-a91ac1c9d697 None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:07.008000 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 185/373] 10.222.0.26 () {56 vars in 1186 bytes} [Wed Aug 24 05:33:06 2022] GET /identity/v3/projects/354a816414fb4c1d8f99d5307047be89 => generated 302 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:33:07.009051 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2b45f2-cdf8-4059-9e9a-a91ac1c9d697 None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:07.056580 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f25f54a-1a64-4bde-8abb-0deebd83a165 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:07.057966 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f25f54a-1a64-4bde-8abb-0deebd83a165 None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:07.061873 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:07.146019 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2b45f2-cdf8-4059-9e9a-a91ac1c9d697 None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:07.167282 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:07.192695 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 189/374] 10.222.0.26 () {58 vars in 1282 bytes} [Wed Aug 24 05:33:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 05:33:07.195227 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f25f54a-1a64-4bde-8abb-0deebd83a165 None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:07.197851 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ff19b7-b2d0-44cf-b3b7-b92a53664bdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:07.198770 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ff19b7-b2d0-44cf-b3b7-b92a53664bdb None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:07.199051 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ff19b7-b2d0-44cf-b3b7-b92a53664bdb None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:07.199317 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ff19b7-b2d0-44cf-b3b7-b92a53664bdb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:07.200050 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ff19b7-b2d0-44cf-b3b7-b92a53664bdb None admin] RBAC: Adding query filter params (group.id=f7c18e21d27e4c80b57795d2a79500b6, role.id=f7aa4a2c74c94c1b9ca8ecdcccccda5c, scope.project.id=354a816414fb4c1d8f99d5307047be89) {{(pid=88112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:33:07.200353 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ff19b7-b2d0-44cf-b3b7-b92a53664bdb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:07.201773 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ff19b7-b2d0-44cf-b3b7-b92a53664bdb None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:07.209976 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 186/375] 10.222.0.26 () {56 vars in 1376 bytes} [Wed Aug 24 05:33:07 2022] GET /identity/v3/role_assignments?group.id=f7c18e21d27e4c80b57795d2a79500b6&scope.project.id=354a816414fb4c1d8f99d5307047be89&role.id=f7aa4a2c74c94c1b9ca8ecdcccccda5c => generated 260 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:33:07.210996 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ff19b7-b2d0-44cf-b3b7-b92a53664bdb None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:07.380538 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f25f54a-1a64-4bde-8abb-0deebd83a165 None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:07.382214 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:07.396208 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ff19b7-b2d0-44cf-b3b7-b92a53664bdb None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:07.426791 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ebd7b9-0a83-45d5-99e6-8c26dfb4aa59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:07.427429 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ebd7b9-0a83-45d5-99e6-8c26dfb4aa59 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:07.427708 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ebd7b9-0a83-45d5-99e6-8c26dfb4aa59 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:07.427979 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ebd7b9-0a83-45d5-99e6-8c26dfb4aa59 None admin] PATH_INFO: `/v3/groups/f7c18e21d27e4c80b57795d2a79500b6` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:07.429513 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ebd7b9-0a83-45d5-99e6-8c26dfb4aa59 None admin] RBAC: Authorizing `identity:get_group(group_id=f7c18e21d27e4c80b57795d2a79500b6)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:07.430562 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ebd7b9-0a83-45d5-99e6-8c26dfb4aa59 None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:07.434018 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 190/376] 10.222.0.26 () {56 vars in 1180 bytes} [Wed Aug 24 05:33:07 2022] GET /identity/v3/groups/f7c18e21d27e4c80b57795d2a79500b6 => generated 226 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:33:07.438252 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ebd7b9-0a83-45d5-99e6-8c26dfb4aa59 None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:07.439319 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2d7d82-2208-40e6-9f10-b6693fe6280a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:07.439970 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2d7d82-2208-40e6-9f10-b6693fe6280a None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:07.440873 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2d7d82-2208-40e6-9f10-b6693fe6280a None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:07.441149 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2d7d82-2208-40e6-9f10-b6693fe6280a None admin] PATH_INFO: `/v3/projects/9e0475c5e4ae4451b23bd74342fbe5f1` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:07.442327 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2d7d82-2208-40e6-9f10-b6693fe6280a None admin] RBAC: Authorizing `identity:get_project(project_id=9e0475c5e4ae4451b23bd74342fbe5f1)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:07.445695 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2d7d82-2208-40e6-9f10-b6693fe6280a None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:07.447096 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 187/377] 10.222.0.26 () {56 vars in 1186 bytes} [Wed Aug 24 05:33:07 2022] GET /identity/v3/projects/9e0475c5e4ae4451b23bd74342fbe5f1 => generated 344 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:33:07.453078 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2d7d82-2208-40e6-9f10-b6693fe6280a None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:07.544846 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:07.625422 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ebd7b9-0a83-45d5-99e6-8c26dfb4aa59 None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:07.637816 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2d7d82-2208-40e6-9f10-b6693fe6280a None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:07.663963 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61085610-4d9a-48cd-bdd5-86251b38cabb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:07.664544 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61085610-4d9a-48cd-bdd5-86251b38cabb None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:07.664823 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61085610-4d9a-48cd-bdd5-86251b38cabb None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:07.665094 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61085610-4d9a-48cd-bdd5-86251b38cabb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:07.665821 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61085610-4d9a-48cd-bdd5-86251b38cabb None admin] RBAC: Adding query filter params (group.id=f7c18e21d27e4c80b57795d2a79500b6, role.id=109c3556f4644bd291e81b0aa7fe2598, scope.project.id=354a816414fb4c1d8f99d5307047be89) {{(pid=88113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:33:07.666233 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61085610-4d9a-48cd-bdd5-86251b38cabb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:07.667672 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61085610-4d9a-48cd-bdd5-86251b38cabb None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:07.677758 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 191/378] 10.222.0.26 () {56 vars in 1376 bytes} [Wed Aug 24 05:33:07 2022] GET /identity/v3/role_assignments?group.id=f7c18e21d27e4c80b57795d2a79500b6&scope.project.id=354a816414fb4c1d8f99d5307047be89&role.id=109c3556f4644bd291e81b0aa7fe2598 => generated 260 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:33:07.708304 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6353e8-dc8b-43e3-a56b-951fdf58b054 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:07.708975 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6353e8-dc8b-43e3-a56b-951fdf58b054 None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:07.709263 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6353e8-dc8b-43e3-a56b-951fdf58b054 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:07.709547 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6353e8-dc8b-43e3-a56b-951fdf58b054 None admin] PATH_INFO: `/v3/groups/3a7b0e598b3343a7b6efede82264e89e` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:07.722787 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6353e8-dc8b-43e3-a56b-951fdf58b054 None admin] RBAC: Authorizing `identity:get_group(group_id=3a7b0e598b3343a7b6efede82264e89e)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:07.724316 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6353e8-dc8b-43e3-a56b-951fdf58b054 None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:07.726484 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 188/379] 10.222.0.26 () {56 vars in 1180 bytes} [Wed Aug 24 05:33:07 2022] GET /identity/v3/groups/3a7b0e598b3343a7b6efede82264e89e => generated 229 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:33:07.732272 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61085610-4d9a-48cd-bdd5-86251b38cabb None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:07.786577 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:07.873980 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61085610-4d9a-48cd-bdd5-86251b38cabb None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:07.912832 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4600d648-573f-4ba1-bb9b-4b8d1577955c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:07.913511 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4600d648-573f-4ba1-bb9b-4b8d1577955c None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:07.913791 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4600d648-573f-4ba1-bb9b-4b8d1577955c None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:07.914153 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4600d648-573f-4ba1-bb9b-4b8d1577955c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:07.914958 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4600d648-573f-4ba1-bb9b-4b8d1577955c None admin] RBAC: Adding query filter params (group.id=3a7b0e598b3343a7b6efede82264e89e, role.id=640bda0879494e60b72680ee505285f0, scope.project.id=9e0475c5e4ae4451b23bd74342fbe5f1) {{(pid=88113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:33:07.915267 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4600d648-573f-4ba1-bb9b-4b8d1577955c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:07.916764 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4600d648-573f-4ba1-bb9b-4b8d1577955c None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:07.923728 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 192/380] 10.222.0.26 () {56 vars in 1376 bytes} [Wed Aug 24 05:33:07 2022] GET /identity/v3/role_assignments?group.id=3a7b0e598b3343a7b6efede82264e89e&scope.project.id=9e0475c5e4ae4451b23bd74342fbe5f1&role.id=640bda0879494e60b72680ee505285f0 => generated 260 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:33:08.272219 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec8244b-e8b1-4bcc-a836-eab4a7c97bec None None] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:08.272739 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec8244b-e8b1-4bcc-a836-eab4a7c97bec None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:08.272739 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec8244b-e8b1-4bcc-a836-eab4a7c97bec None None] PATH_INFO: `/` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:08.274327 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 189/381] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 24 05:33:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:33:08.279553 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408cf8c2-6ec6-472b-8ea0-63afdd1f67e2 None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:08.279973 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408cf8c2-6ec6-472b-8ea0-63afdd1f67e2 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:08.280146 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408cf8c2-6ec6-472b-8ea0-63afdd1f67e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:08.303589 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-408cf8c2-6ec6-472b-8ea0-63afdd1f67e2 None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:33:08.304796 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-408cf8c2-6ec6-472b-8ea0-63afdd1f67e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:33:08.396358 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 193/382] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 24 05:33:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 05:33:08.406217 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107f824f-e99e-475f-acb3-3a15a3486e44 None None] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:08.406506 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107f824f-e99e-475f-acb3-3a15a3486e44 None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:08.406787 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107f824f-e99e-475f-acb3-3a15a3486e44 None None] PATH_INFO: `/` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:08.408417 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 190/383] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 24 05:33:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:33:08.414339 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a10bbf5-d7fd-400f-9c85-892e4af65168 None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:08.414621 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a10bbf5-d7fd-400f-9c85-892e4af65168 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:08.414955 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a10bbf5-d7fd-400f-9c85-892e4af65168 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:08.437227 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-0a10bbf5-d7fd-400f-9c85-892e4af65168 None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:33:08.438499 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-0a10bbf5-d7fd-400f-9c85-892e4af65168 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:33:08.474328 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:08.529966 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 194/384] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 24 05:33:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 05:33:08.752478 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107f824f-e99e-475f-acb3-3a15a3486e44 None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:08.879647 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107f824f-e99e-475f-acb3-3a15a3486e44 None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:08.893997 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:08.922628 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd26437-88f7-4ecc-880d-9f0c758c6f05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:08.923255 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd26437-88f7-4ecc-880d-9f0c758c6f05 None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:08.923534 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd26437-88f7-4ecc-880d-9f0c758c6f05 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:08.923807 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd26437-88f7-4ecc-880d-9f0c758c6f05 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:08.939045 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd26437-88f7-4ecc-880d-9f0c758c6f05 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:33:08.940629 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a10bbf5-d7fd-400f-9c85-892e4af65168 None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:08.944111 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application [None req-1dd26437-88f7-4ecc-880d-9f0c758c6f05 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 05:33:08.944111 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:33:08.944111 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:33:08.944111 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:33:08.944111 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:33:08.944111 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:33:08.944111 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:33:08.944111 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:33:08.944111 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:33:08.944111 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:33:08.944111 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:33:08.944111 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:33:08.944111 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:33:08.944111 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:33:08.944111 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:33:08.944111 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:33:08.944952 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:33:08.944952 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:33:08.944952 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:33:08.944952 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:33:08.944952 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:33:08.944952 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:33:08.944952 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:33:08.944952 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:33:08.944952 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:33:08.944952 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:33:08.944952 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:33:08.944952 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application with Lock( Aug 24 05:33:08.944952 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:33:08.944952 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:33:08.944952 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:33:08.944952 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:33:08.945739 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:33:08.945739 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:33:08.945739 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:33:08.945739 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:33:08.945739 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:33:08.945739 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:33:08.945739 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:33:08.945739 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:33:08.945739 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:33:08.945739 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:33:08.945739 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 05:33:08.945739 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Aug 24 05:33:08.945739 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 191/385] 10.222.0.26 () {56 vars in 1099 bytes} [Wed Aug 24 05:33:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:33:08.951090 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd26437-88f7-4ecc-880d-9f0c758c6f05 None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:09.110957 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a10bbf5-d7fd-400f-9c85-892e4af65168 None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:09.138042 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd26437-88f7-4ecc-880d-9f0c758c6f05 None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:09.181463 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bc714e-f5d2-4828-9793-9c666331dbd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:09.182118 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bc714e-f5d2-4828-9793-9c666331dbd8 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:09.182395 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bc714e-f5d2-4828-9793-9c666331dbd8 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:09.182659 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bc714e-f5d2-4828-9793-9c666331dbd8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:09.200635 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bc714e-f5d2-4828-9793-9c666331dbd8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:33:09.205334 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application [None req-50bc714e-f5d2-4828-9793-9c666331dbd8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 05:33:09.205334 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:33:09.205334 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:33:09.205334 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:33:09.205334 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:33:09.205334 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:33:09.205334 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:33:09.205334 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:33:09.205334 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:33:09.205334 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:33:09.205334 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:33:09.205334 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:33:09.205334 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:33:09.205334 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:33:09.205334 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:33:09.205334 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:33:09.206807 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:33:09.206807 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:33:09.206807 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:33:09.206807 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:33:09.206807 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:33:09.206807 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:33:09.206807 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:33:09.206807 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:33:09.206807 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:33:09.206807 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:33:09.206807 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:33:09.206807 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application with Lock( Aug 24 05:33:09.206807 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:33:09.206807 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:33:09.206807 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:33:09.206807 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:33:09.207588 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:33:09.207588 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:33:09.207588 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:33:09.207588 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:33:09.207588 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:33:09.207588 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:33:09.207588 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:33:09.207588 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:33:09.207588 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:33:09.207588 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:33:09.207588 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 05:33:09.207588 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Aug 24 05:33:09.207588 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 195/386] 10.222.0.26 () {56 vars in 1114 bytes} [Wed Aug 24 05:33:08 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:33:09.217202 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619acc0c-e265-4918-be68-3b6487a51505 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:09.217819 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619acc0c-e265-4918-be68-3b6487a51505 None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:09.218123 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619acc0c-e265-4918-be68-3b6487a51505 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:09.218391 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619acc0c-e265-4918-be68-3b6487a51505 None admin] PATH_INFO: `/v3/roles` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:09.219060 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619acc0c-e265-4918-be68-3b6487a51505 None admin] RBAC: Adding query filter params (name=member) {{(pid=88112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:33:09.219356 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619acc0c-e265-4918-be68-3b6487a51505 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:09.220725 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619acc0c-e265-4918-be68-3b6487a51505 None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:09.222870 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bc714e-f5d2-4828-9793-9c666331dbd8 None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:09.241843 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 192/387] 10.222.0.26 () {56 vars in 1101 bytes} [Wed Aug 24 05:33:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:33:09.245274 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619acc0c-e265-4918-be68-3b6487a51505 None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:09.279728 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:09.315688 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:09.430798 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bc714e-f5d2-4828-9793-9c666331dbd8 None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:09.438264 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619acc0c-e265-4918-be68-3b6487a51505 None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:09.484829 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f0de79-53da-480b-844f-a87b373147f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:09.485436 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f0de79-53da-480b-844f-a87b373147f4 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:09.485715 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f0de79-53da-480b-844f-a87b373147f4 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:09.486004 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f0de79-53da-480b-844f-a87b373147f4 None admin] PATH_INFO: `/v3/roles` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:09.486678 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f0de79-53da-480b-844f-a87b373147f4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:33:09.487537 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f0de79-53da-480b-844f-a87b373147f4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:09.488918 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f0de79-53da-480b-844f-a87b373147f4 None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:09.501130 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ced11c6-407c-45c8-a825-6ad5457e1754 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:09.501130 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ced11c6-407c-45c8-a825-6ad5457e1754 None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:09.501130 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ced11c6-407c-45c8-a825-6ad5457e1754 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:09.501130 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ced11c6-407c-45c8-a825-6ad5457e1754 None admin] PATH_INFO: `/v3/groups/f7c18e21d27e4c80b57795d2a79500b6` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:09.509972 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ced11c6-407c-45c8-a825-6ad5457e1754 None admin] RBAC: Authorizing `identity:get_group(group_id=f7c18e21d27e4c80b57795d2a79500b6)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:09.509972 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ced11c6-407c-45c8-a825-6ad5457e1754 None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:09.511449 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 193/388] 10.222.0.26 () {56 vars in 1180 bytes} [Wed Aug 24 05:33:09 2022] GET /identity/v3/groups/f7c18e21d27e4c80b57795d2a79500b6 => generated 226 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:33:09.511667 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 196/389] 10.222.0.26 () {56 vars in 1111 bytes} [Wed Aug 24 05:33:09 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:33:09.513409 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ced11c6-407c-45c8-a825-6ad5457e1754 None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:09.517116 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f0de79-53da-480b-844f-a87b373147f4 None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:09.671866 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:09.695091 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ced11c6-407c-45c8-a825-6ad5457e1754 None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:09.695260 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f0de79-53da-480b-844f-a87b373147f4 None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:09.696681 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:09.733373 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6882d152-510b-4472-8e42-3310c8100235 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:09.734684 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6882d152-510b-4472-8e42-3310c8100235 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:09.734985 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6882d152-510b-4472-8e42-3310c8100235 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:09.735511 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6882d152-510b-4472-8e42-3310c8100235 None admin] PATH_INFO: `/v3/groups/f7c18e21d27e4c80b57795d2a79500b6` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:09.737542 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6882d152-510b-4472-8e42-3310c8100235 None admin] RBAC: Authorizing `identity:get_group(group_id=f7c18e21d27e4c80b57795d2a79500b6)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:09.739450 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6882d152-510b-4472-8e42-3310c8100235 None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:09.739778 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510b587e-ce28-4b23-9392-155b3ba6e056 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:09.740412 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510b587e-ce28-4b23-9392-155b3ba6e056 None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:09.740691 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510b587e-ce28-4b23-9392-155b3ba6e056 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:09.740988 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510b587e-ce28-4b23-9392-155b3ba6e056 None admin] PATH_INFO: `/v3/projects/d4bde08b78fc4447a53a2928b2d22185` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:09.741326 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 197/390] 10.222.0.26 () {56 vars in 1180 bytes} [Wed Aug 24 05:33:09 2022] GET /identity/v3/groups/f7c18e21d27e4c80b57795d2a79500b6 => generated 226 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:33:09.742333 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510b587e-ce28-4b23-9392-155b3ba6e056 None admin] RBAC: Authorizing `identity:get_project(project_id=d4bde08b78fc4447a53a2928b2d22185)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:09.742613 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499ba6a1-2cda-46dc-821d-c9c575c6131e None None] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:09.742900 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499ba6a1-2cda-46dc-821d-c9c575c6131e None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:09.743180 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499ba6a1-2cda-46dc-821d-c9c575c6131e None None] PATH_INFO: `/` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:09.743771 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510b587e-ce28-4b23-9392-155b3ba6e056 None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:09.744674 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 198/391] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 24 05:33:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:33:09.749477 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 194/392] 10.222.0.26 () {56 vars in 1186 bytes} [Wed Aug 24 05:33:09 2022] GET /identity/v3/projects/d4bde08b78fc4447a53a2928b2d22185 => generated 298 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:33:09.750965 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499ba6a1-2cda-46dc-821d-c9c575c6131e None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:09.752684 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6dfc45-c3e8-4063-93bb-0d7a37494c33 None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:09.752965 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6dfc45-c3e8-4063-93bb-0d7a37494c33 None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:09.753234 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6dfc45-c3e8-4063-93bb-0d7a37494c33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:09.772763 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-3f6dfc45-c3e8-4063-93bb-0d7a37494c33 None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:33:09.774051 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-3f6dfc45-c3e8-4063-93bb-0d7a37494c33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:33:09.854823 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 195/393] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 24 05:33:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 05:33:09.855976 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6dfc45-c3e8-4063-93bb-0d7a37494c33 None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:09.900376 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499ba6a1-2cda-46dc-821d-c9c575c6131e None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:09.967693 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:09.972999 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6dfc45-c3e8-4063-93bb-0d7a37494c33 None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:09.974654 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9797a3d3-f36f-4a7b-9100-fbeaf519b5b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:09.975295 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9797a3d3-f36f-4a7b-9100-fbeaf519b5b5 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:09.975574 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9797a3d3-f36f-4a7b-9100-fbeaf519b5b5 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:09.975848 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9797a3d3-f36f-4a7b-9100-fbeaf519b5b5 None admin] PATH_INFO: `/v3/projects/d4bde08b78fc4447a53a2928b2d22185` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:09.978716 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9797a3d3-f36f-4a7b-9100-fbeaf519b5b5 None admin] RBAC: Authorizing `identity:get_project(project_id=d4bde08b78fc4447a53a2928b2d22185)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:09.980174 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9797a3d3-f36f-4a7b-9100-fbeaf519b5b5 None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:09.982192 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 199/394] 10.222.0.26 () {56 vars in 1186 bytes} [Wed Aug 24 05:33:09 2022] GET /identity/v3/projects/d4bde08b78fc4447a53a2928b2d22185 => generated 298 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:33:09.988281 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9797a3d3-f36f-4a7b-9100-fbeaf519b5b5 None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:10.011674 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9842409-1d28-41a2-9643-0adde2b375e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:10.012589 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9842409-1d28-41a2-9643-0adde2b375e6 None admin] REQUEST_METHOD: `PUT` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:10.013014 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9842409-1d28-41a2-9643-0adde2b375e6 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:10.013421 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9842409-1d28-41a2-9643-0adde2b375e6 None admin] PATH_INFO: `/v3/projects/d4bde08b78fc4447a53a2928b2d22185/groups/f7c18e21d27e4c80b57795d2a79500b6/roles/f7aa4a2c74c94c1b9ca8ecdcccccda5c` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:10.015616 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9842409-1d28-41a2-9643-0adde2b375e6 None admin] RBAC: Authorizing `identity:create_grant(project_id=d4bde08b78fc4447a53a2928b2d22185, group_id=f7c18e21d27e4c80b57795d2a79500b6, role_id=f7aa4a2c74c94c1b9ca8ecdcccccda5c)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:10.017932 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9842409-1d28-41a2-9643-0adde2b375e6 None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:10.032877 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:10.047044 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 196/395] 10.222.0.26 () {58 vars in 1442 bytes} [Wed Aug 24 05:33:09 2022] PUT /identity/v3/projects/d4bde08b78fc4447a53a2928b2d22185/groups/f7c18e21d27e4c80b57795d2a79500b6/roles/f7aa4a2c74c94c1b9ca8ecdcccccda5c => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:33:10.061181 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694d7b3d-d103-4662-a4aa-1564c1794012 None None] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:10.061515 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694d7b3d-d103-4662-a4aa-1564c1794012 None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:10.061791 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694d7b3d-d103-4662-a4aa-1564c1794012 None None] PATH_INFO: `/` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:10.063459 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 197/396] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 24 05:33:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 05:33:10.068946 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c5a444-0b88-4bd9-8f6d-940dc0169ae8 None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:10.069221 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c5a444-0b88-4bd9-8f6d-940dc0169ae8 None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:10.069561 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c5a444-0b88-4bd9-8f6d-940dc0169ae8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:10.107134 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-89c5a444-0b88-4bd9-8f6d-940dc0169ae8 None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:33:10.108342 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-89c5a444-0b88-4bd9-8f6d-940dc0169ae8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:33:10.158730 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9797a3d3-f36f-4a7b-9100-fbeaf519b5b5 None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:10.205164 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a038d23b-7cc5-47e5-940e-e682c05205fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:10.206729 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a038d23b-7cc5-47e5-940e-e682c05205fe None admin] REQUEST_METHOD: `PUT` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:10.207157 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a038d23b-7cc5-47e5-940e-e682c05205fe None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:10.207575 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a038d23b-7cc5-47e5-940e-e682c05205fe None admin] PATH_INFO: `/v3/projects/d4bde08b78fc4447a53a2928b2d22185/groups/f7c18e21d27e4c80b57795d2a79500b6/roles/109c3556f4644bd291e81b0aa7fe2598` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:10.210297 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a038d23b-7cc5-47e5-940e-e682c05205fe None admin] RBAC: Authorizing `identity:create_grant(project_id=d4bde08b78fc4447a53a2928b2d22185, group_id=f7c18e21d27e4c80b57795d2a79500b6, role_id=109c3556f4644bd291e81b0aa7fe2598)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:10.211938 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a038d23b-7cc5-47e5-940e-e682c05205fe None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:10.228803 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 200/397] 10.222.0.26 () {58 vars in 1442 bytes} [Wed Aug 24 05:33:09 2022] PUT /identity/v3/projects/d4bde08b78fc4447a53a2928b2d22185/groups/f7c18e21d27e4c80b57795d2a79500b6/roles/109c3556f4644bd291e81b0aa7fe2598 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 05:33:10.230762 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c544826-72b2-4912-9903-fe144e3322c9 None None] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:10.231050 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c544826-72b2-4912-9903-fe144e3322c9 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:10.231326 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c544826-72b2-4912-9903-fe144e3322c9 None None] PATH_INFO: `/` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:10.232074 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 198/398] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 24 05:33:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Aug 24 05:33:10.232768 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c5a444-0b88-4bd9-8f6d-940dc0169ae8 None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:10.232879 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 201/399] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 24 05:33:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:33:10.238978 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a6f00c-9977-4617-8e21-6ae831ffe2d3 None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:10.239283 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a6f00c-9977-4617-8e21-6ae831ffe2d3 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:10.239530 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a6f00c-9977-4617-8e21-6ae831ffe2d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:10.270141 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-29a6f00c-9977-4617-8e21-6ae831ffe2d3 None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:33:10.272772 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-29a6f00c-9977-4617-8e21-6ae831ffe2d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:33:10.346685 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:10.357979 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c5a444-0b88-4bd9-8f6d-940dc0169ae8 None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:10.368143 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 202/400] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 24 05:33:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 05:33:10.402329 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f4f30c-c9eb-42c4-acdf-2749b956e31a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:10.403366 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f4f30c-c9eb-42c4-acdf-2749b956e31a None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:10.403846 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f4f30c-c9eb-42c4-acdf-2749b956e31a None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:10.404268 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f4f30c-c9eb-42c4-acdf-2749b956e31a None admin] PATH_INFO: `/v3/roles/member` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:10.418232 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f4f30c-c9eb-42c4-acdf-2749b956e31a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:33:10.423429 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application [None req-85f4f30c-c9eb-42c4-acdf-2749b956e31a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 05:33:10.423429 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:33:10.423429 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:33:10.423429 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:33:10.423429 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:33:10.423429 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:33:10.423429 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:33:10.423429 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:33:10.423429 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:33:10.423429 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:33:10.423429 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:33:10.423429 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:33:10.423429 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:33:10.423429 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:33:10.423429 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:33:10.423429 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:33:10.424892 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:33:10.424892 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:33:10.424892 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:33:10.424892 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:33:10.424892 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:33:10.424892 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:33:10.424892 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:33:10.424892 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:33:10.424892 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:33:10.424892 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:33:10.424892 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:33:10.424892 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application with Lock( Aug 24 05:33:10.424892 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:33:10.424892 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:33:10.424892 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:33:10.424892 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:33:10.425915 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:33:10.425915 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:33:10.425915 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:33:10.425915 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:33:10.425915 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:33:10.425915 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:33:10.425915 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:33:10.425915 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:33:10.425915 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:33:10.425915 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:33:10.425915 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 05:33:10.425915 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Aug 24 05:33:10.425915 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 199/401] 10.222.0.26 () {56 vars in 1099 bytes} [Wed Aug 24 05:33:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:33:10.435052 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a6f00c-9977-4617-8e21-6ae831ffe2d3 None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:10.445541 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:10.547043 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a6f00c-9977-4617-8e21-6ae831ffe2d3 None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:10.558878 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f4f30c-c9eb-42c4-acdf-2749b956e31a None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:10.586929 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d37cfc3-b654-4698-a8ed-fe5269facf66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:10.587542 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d37cfc3-b654-4698-a8ed-fe5269facf66 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:10.588012 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d37cfc3-b654-4698-a8ed-fe5269facf66 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:10.588282 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d37cfc3-b654-4698-a8ed-fe5269facf66 None admin] PATH_INFO: `/v3/roles` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:10.589859 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d37cfc3-b654-4698-a8ed-fe5269facf66 None admin] RBAC: Adding query filter params (name=member) {{(pid=88113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:33:10.590185 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d37cfc3-b654-4698-a8ed-fe5269facf66 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:10.592273 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d37cfc3-b654-4698-a8ed-fe5269facf66 None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:10.603202 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 203/402] 10.222.0.26 () {56 vars in 1101 bytes} [Wed Aug 24 05:33:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:33:10.608773 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d37cfc3-b654-4698-a8ed-fe5269facf66 None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:10.678851 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f4f30c-c9eb-42c4-acdf-2749b956e31a None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:10.680389 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:10.719561 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d37cfc3-b654-4698-a8ed-fe5269facf66 None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:10.720140 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef83057-889a-4736-ad11-65dd0a0ddc1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:10.721103 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef83057-889a-4736-ad11-65dd0a0ddc1b None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:10.721643 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef83057-889a-4736-ad11-65dd0a0ddc1b None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:10.722213 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef83057-889a-4736-ad11-65dd0a0ddc1b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:10.733829 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef83057-889a-4736-ad11-65dd0a0ddc1b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:33:10.739777 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application [None req-5ef83057-889a-4736-ad11-65dd0a0ddc1b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 05:33:10.739777 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:33:10.739777 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:33:10.739777 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:33:10.739777 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:33:10.739777 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:33:10.739777 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:33:10.739777 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:33:10.739777 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:33:10.739777 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:33:10.739777 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:33:10.739777 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:33:10.739777 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:33:10.739777 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:33:10.739777 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:33:10.739777 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:33:10.740670 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:33:10.740670 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:33:10.740670 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:33:10.740670 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:33:10.740670 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:33:10.740670 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:33:10.740670 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:33:10.740670 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:33:10.740670 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:33:10.740670 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:33:10.740670 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:33:10.740670 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application with Lock( Aug 24 05:33:10.740670 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:33:10.740670 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:33:10.740670 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:33:10.740670 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:33:10.741488 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:33:10.741488 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:33:10.741488 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:33:10.741488 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:33:10.741488 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:33:10.741488 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:33:10.741488 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:33:10.741488 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:33:10.741488 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:33:10.741488 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:33:10.741488 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 05:33:10.741488 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Aug 24 05:33:10.744271 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 200/403] 10.222.0.26 () {56 vars in 1114 bytes} [Wed Aug 24 05:33:10 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:33:10.749788 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef83057-889a-4736-ad11-65dd0a0ddc1b None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:10.755617 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b92b535-be6a-4375-b4f2-d112725bc6f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:10.756294 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b92b535-be6a-4375-b4f2-d112725bc6f3 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:10.756579 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b92b535-be6a-4375-b4f2-d112725bc6f3 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:10.756852 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b92b535-be6a-4375-b4f2-d112725bc6f3 None admin] PATH_INFO: `/v3/groups/f7c18e21d27e4c80b57795d2a79500b6` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:10.758020 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b92b535-be6a-4375-b4f2-d112725bc6f3 None admin] RBAC: Authorizing `identity:get_group(group_id=f7c18e21d27e4c80b57795d2a79500b6)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:10.759472 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b92b535-be6a-4375-b4f2-d112725bc6f3 None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:10.761346 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 204/404] 10.222.0.26 () {56 vars in 1180 bytes} [Wed Aug 24 05:33:10 2022] GET /identity/v3/groups/f7c18e21d27e4c80b57795d2a79500b6 => generated 226 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:33:10.766286 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:10.767958 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b92b535-be6a-4375-b4f2-d112725bc6f3 None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:10.860061 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef83057-889a-4736-ad11-65dd0a0ddc1b None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:10.879931 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b92b535-be6a-4375-b4f2-d112725bc6f3 None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:10.900343 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de348c72-96e4-4d31-b498-264159bda7a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:10.901008 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de348c72-96e4-4d31-b498-264159bda7a9 None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:10.901369 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de348c72-96e4-4d31-b498-264159bda7a9 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:10.901645 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de348c72-96e4-4d31-b498-264159bda7a9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:10.914848 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de348c72-96e4-4d31-b498-264159bda7a9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:33:10.918012 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e27d53-9f0b-42fe-ae21-dc43ec47e3b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:10.918807 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e27d53-9f0b-42fe-ae21-dc43ec47e3b0 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:10.919244 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e27d53-9f0b-42fe-ae21-dc43ec47e3b0 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:10.919667 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e27d53-9f0b-42fe-ae21-dc43ec47e3b0 None admin] PATH_INFO: `/v3/roles` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:10.920051 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application [None req-de348c72-96e4-4d31-b498-264159bda7a9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 05:33:10.920051 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:33:10.920051 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:33:10.920051 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:33:10.920051 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:33:10.920051 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:33:10.920051 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:33:10.920051 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:33:10.920051 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:33:10.920051 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:33:10.920051 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:33:10.920051 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:33:10.920051 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:33:10.920051 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:33:10.920051 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:33:10.920051 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:33:10.921133 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:33:10.921133 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:33:10.921133 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:33:10.921133 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:33:10.921133 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:33:10.921133 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:33:10.921133 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:33:10.921133 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:33:10.921133 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:33:10.921133 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:33:10.921133 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:33:10.921133 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application with Lock( Aug 24 05:33:10.921133 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:33:10.921133 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:33:10.921133 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:33:10.921133 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:33:10.922067 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:33:10.922067 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:33:10.922067 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:33:10.922067 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:33:10.922067 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:33:10.922067 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:33:10.922067 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:33:10.922067 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:33:10.922067 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:33:10.922067 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:33:10.922067 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 05:33:10.922067 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Aug 24 05:33:10.923334 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e27d53-9f0b-42fe-ae21-dc43ec47e3b0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:33:10.923825 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e27d53-9f0b-42fe-ae21-dc43ec47e3b0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:10.925432 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e27d53-9f0b-42fe-ae21-dc43ec47e3b0 None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:10.926588 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 201/405] 10.222.0.26 () {56 vars in 1096 bytes} [Wed Aug 24 05:33:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:33:10.927552 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de348c72-96e4-4d31-b498-264159bda7a9 None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:10.928512 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:10.936994 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 205/406] 10.222.0.26 () {56 vars in 1111 bytes} [Wed Aug 24 05:33:10 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:33:10.938152 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e27d53-9f0b-42fe-ae21-dc43ec47e3b0 None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:11.003987 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:11.037629 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de348c72-96e4-4d31-b498-264159bda7a9 None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:11.046213 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e27d53-9f0b-42fe-ae21-dc43ec47e3b0 None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:11.073237 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640d9966-66ca-4026-a314-a520cccdbbdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:11.073870 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640d9966-66ca-4026-a314-a520cccdbbdb None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:11.074189 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640d9966-66ca-4026-a314-a520cccdbbdb None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:11.074460 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640d9966-66ca-4026-a314-a520cccdbbdb None admin] PATH_INFO: `/v3/projects/354a816414fb4c1d8f99d5307047be89` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:11.075572 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640d9966-66ca-4026-a314-a520cccdbbdb None admin] RBAC: Authorizing `identity:get_project(project_id=354a816414fb4c1d8f99d5307047be89)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:11.077304 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640d9966-66ca-4026-a314-a520cccdbbdb None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:11.084115 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 202/407] 10.222.0.26 () {56 vars in 1186 bytes} [Wed Aug 24 05:33:10 2022] GET /identity/v3/projects/354a816414fb4c1d8f99d5307047be89 => generated 302 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:33:11.084115 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640d9966-66ca-4026-a314-a520cccdbbdb None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:11.087576 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce1f7a7-91ff-4537-9a26-62060c189f55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:11.088433 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce1f7a7-91ff-4537-9a26-62060c189f55 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:11.088925 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce1f7a7-91ff-4537-9a26-62060c189f55 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:11.089719 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce1f7a7-91ff-4537-9a26-62060c189f55 None admin] PATH_INFO: `/v3/roles` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:11.090659 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce1f7a7-91ff-4537-9a26-62060c189f55 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:33:11.091165 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce1f7a7-91ff-4537-9a26-62060c189f55 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:11.092810 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce1f7a7-91ff-4537-9a26-62060c189f55 None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:11.102806 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 206/408] 10.222.0.26 () {56 vars in 1099 bytes} [Wed Aug 24 05:33:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:33:11.103817 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce1f7a7-91ff-4537-9a26-62060c189f55 None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:11.165097 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:11.204277 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640d9966-66ca-4026-a314-a520cccdbbdb None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:11.222810 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce1f7a7-91ff-4537-9a26-62060c189f55 None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:11.248242 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffe9f89-c1f6-4c2b-b2a5-e619460d255b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:11.248929 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffe9f89-c1f6-4c2b-b2a5-e619460d255b None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:11.249438 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffe9f89-c1f6-4c2b-b2a5-e619460d255b None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:11.249715 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffe9f89-c1f6-4c2b-b2a5-e619460d255b None admin] PATH_INFO: `/v3/groups/f7c18e21d27e4c80b57795d2a79500b6` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:11.251499 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffe9f89-c1f6-4c2b-b2a5-e619460d255b None admin] RBAC: Authorizing `identity:get_group(group_id=f7c18e21d27e4c80b57795d2a79500b6)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:11.254145 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffe9f89-c1f6-4c2b-b2a5-e619460d255b None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:11.256665 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 203/409] 10.222.0.26 () {56 vars in 1180 bytes} [Wed Aug 24 05:33:11 2022] GET /identity/v3/groups/f7c18e21d27e4c80b57795d2a79500b6 => generated 226 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:33:11.257529 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffe9f89-c1f6-4c2b-b2a5-e619460d255b None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:11.258389 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6919fda-ac2c-4a9c-87dd-ede165eeb854 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:11.259137 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6919fda-ac2c-4a9c-87dd-ede165eeb854 None admin] REQUEST_METHOD: `PUT` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:11.259531 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6919fda-ac2c-4a9c-87dd-ede165eeb854 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:11.259969 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6919fda-ac2c-4a9c-87dd-ede165eeb854 None admin] PATH_INFO: `/v3/projects/354a816414fb4c1d8f99d5307047be89/groups/f7c18e21d27e4c80b57795d2a79500b6/roles/f7aa4a2c74c94c1b9ca8ecdcccccda5c` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:11.262532 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6919fda-ac2c-4a9c-87dd-ede165eeb854 None admin] RBAC: Authorizing `identity:create_grant(project_id=354a816414fb4c1d8f99d5307047be89, group_id=f7c18e21d27e4c80b57795d2a79500b6, role_id=f7aa4a2c74c94c1b9ca8ecdcccccda5c)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:11.264103 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6919fda-ac2c-4a9c-87dd-ede165eeb854 None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:11.266420 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:11.288362 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 207/410] 10.222.0.26 () {58 vars in 1442 bytes} [Wed Aug 24 05:33:11 2022] PUT /identity/v3/projects/354a816414fb4c1d8f99d5307047be89/groups/f7c18e21d27e4c80b57795d2a79500b6/roles/f7aa4a2c74c94c1b9ca8ecdcccccda5c => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:33:11.291427 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6919fda-ac2c-4a9c-87dd-ede165eeb854 None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:11.460317 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffe9f89-c1f6-4c2b-b2a5-e619460d255b None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:11.466588 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6919fda-ac2c-4a9c-87dd-ede165eeb854 None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:11.488383 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:11.505531 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa04013-3c82-4564-8050-8e364e2ed6c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:11.506198 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa04013-3c82-4564-8050-8e364e2ed6c0 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:11.506477 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa04013-3c82-4564-8050-8e364e2ed6c0 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:11.506748 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa04013-3c82-4564-8050-8e364e2ed6c0 None admin] PATH_INFO: `/v3/projects/354a816414fb4c1d8f99d5307047be89` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:11.508008 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa04013-3c82-4564-8050-8e364e2ed6c0 None admin] RBAC: Authorizing `identity:get_project(project_id=354a816414fb4c1d8f99d5307047be89)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:11.509609 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa04013-3c82-4564-8050-8e364e2ed6c0 None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:11.511684 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 208/411] 10.222.0.26 () {56 vars in 1186 bytes} [Wed Aug 24 05:33:11 2022] GET /identity/v3/projects/354a816414fb4c1d8f99d5307047be89 => generated 302 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:33:11.516881 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa04013-3c82-4564-8050-8e364e2ed6c0 None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:11.523255 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380a09e3-b070-4662-9917-e978bddf2640 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:11.523906 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380a09e3-b070-4662-9917-e978bddf2640 None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:11.524180 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380a09e3-b070-4662-9917-e978bddf2640 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:11.524448 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380a09e3-b070-4662-9917-e978bddf2640 None admin] PATH_INFO: `/v3/groups/3a7b0e598b3343a7b6efede82264e89e` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:11.526180 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380a09e3-b070-4662-9917-e978bddf2640 None admin] RBAC: Authorizing `identity:get_group(group_id=3a7b0e598b3343a7b6efede82264e89e)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:11.527890 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380a09e3-b070-4662-9917-e978bddf2640 None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:11.530039 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 204/412] 10.222.0.26 () {56 vars in 1180 bytes} [Wed Aug 24 05:33:11 2022] GET /identity/v3/groups/3a7b0e598b3343a7b6efede82264e89e => generated 229 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:33:11.537185 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380a09e3-b070-4662-9917-e978bddf2640 None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:11.666343 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:11.693832 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380a09e3-b070-4662-9917-e978bddf2640 None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:11.704054 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa04013-3c82-4564-8050-8e364e2ed6c0 None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:11.744197 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b20d2e7-0484-4db0-a29f-9d269df5057e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:11.744756 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b20d2e7-0484-4db0-a29f-9d269df5057e None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:11.745032 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b20d2e7-0484-4db0-a29f-9d269df5057e None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:11.745299 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b20d2e7-0484-4db0-a29f-9d269df5057e None admin] PATH_INFO: `/v3/projects/9e0475c5e4ae4451b23bd74342fbe5f1` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:11.747631 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b20d2e7-0484-4db0-a29f-9d269df5057e None admin] RBAC: Authorizing `identity:get_project(project_id=9e0475c5e4ae4451b23bd74342fbe5f1)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:11.749195 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b20d2e7-0484-4db0-a29f-9d269df5057e None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:11.750846 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 205/413] 10.222.0.26 () {56 vars in 1186 bytes} [Wed Aug 24 05:33:11 2022] GET /identity/v3/projects/9e0475c5e4ae4451b23bd74342fbe5f1 => generated 344 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:33:11.757442 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b20d2e7-0484-4db0-a29f-9d269df5057e None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:11.772623 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d3baba-f057-429d-b7e7-a3b2145068a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:11.773290 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d3baba-f057-429d-b7e7-a3b2145068a0 None admin] REQUEST_METHOD: `PUT` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:11.773575 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d3baba-f057-429d-b7e7-a3b2145068a0 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:11.773848 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d3baba-f057-429d-b7e7-a3b2145068a0 None admin] PATH_INFO: `/v3/projects/354a816414fb4c1d8f99d5307047be89/groups/f7c18e21d27e4c80b57795d2a79500b6/roles/109c3556f4644bd291e81b0aa7fe2598` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:11.776056 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d3baba-f057-429d-b7e7-a3b2145068a0 None admin] RBAC: Authorizing `identity:create_grant(project_id=354a816414fb4c1d8f99d5307047be89, group_id=f7c18e21d27e4c80b57795d2a79500b6, role_id=109c3556f4644bd291e81b0aa7fe2598)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:11.777632 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d3baba-f057-429d-b7e7-a3b2145068a0 None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:11.793210 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 209/414] 10.222.0.26 () {58 vars in 1442 bytes} [Wed Aug 24 05:33:11 2022] PUT /identity/v3/projects/354a816414fb4c1d8f99d5307047be89/groups/f7c18e21d27e4c80b57795d2a79500b6/roles/109c3556f4644bd291e81b0aa7fe2598 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 05:33:11.915345 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b20d2e7-0484-4db0-a29f-9d269df5057e None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:11.962326 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014ef80d-cc28-4424-b60a-1eab0fbb2839 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:11.962990 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014ef80d-cc28-4424-b60a-1eab0fbb2839 None admin] REQUEST_METHOD: `PUT` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:11.963271 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014ef80d-cc28-4424-b60a-1eab0fbb2839 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:11.963542 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014ef80d-cc28-4424-b60a-1eab0fbb2839 None admin] PATH_INFO: `/v3/projects/9e0475c5e4ae4451b23bd74342fbe5f1/groups/3a7b0e598b3343a7b6efede82264e89e/roles/640bda0879494e60b72680ee505285f0` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:11.965428 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014ef80d-cc28-4424-b60a-1eab0fbb2839 None admin] RBAC: Authorizing `identity:create_grant(project_id=9e0475c5e4ae4451b23bd74342fbe5f1, group_id=3a7b0e598b3343a7b6efede82264e89e, role_id=640bda0879494e60b72680ee505285f0)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:11.966880 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014ef80d-cc28-4424-b60a-1eab0fbb2839 None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:11.990005 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 206/415] 10.222.0.26 () {58 vars in 1442 bytes} [Wed Aug 24 05:33:11 2022] PUT /identity/v3/projects/9e0475c5e4ae4451b23bd74342fbe5f1/groups/3a7b0e598b3343a7b6efede82264e89e/roles/640bda0879494e60b72680ee505285f0 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:33:12.324823 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6defdd0-b87e-45e8-bd0f-b08b456742cb None None] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:12.325217 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6defdd0-b87e-45e8-bd0f-b08b456742cb None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:12.325391 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6defdd0-b87e-45e8-bd0f-b08b456742cb None None] PATH_INFO: `/` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:12.326988 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 210/416] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 24 05:33:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:33:12.332983 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7738ade7-c2c7-4819-ad50-26ee093e7fc1 None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:12.333274 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7738ade7-c2c7-4819-ad50-26ee093e7fc1 None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:12.333551 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7738ade7-c2c7-4819-ad50-26ee093e7fc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:12.340028 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:12.363330 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-7738ade7-c2c7-4819-ad50-26ee093e7fc1 None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:33:12.364542 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-7738ade7-c2c7-4819-ad50-26ee093e7fc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:33:12.452501 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 207/417] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 24 05:33:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 05:33:12.585962 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8c70f9-53c5-44ef-8ebb-609cc26b028a None None] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:12.586468 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8c70f9-53c5-44ef-8ebb-609cc26b028a None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:12.586468 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8c70f9-53c5-44ef-8ebb-609cc26b028a None None] PATH_INFO: `/` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:12.588028 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 211/418] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 24 05:33:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:33:12.593056 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7edf08c-2045-444f-8181-7a5ae5c3a599 None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:12.593474 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7edf08c-2045-444f-8181-7a5ae5c3a599 None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:12.593674 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7edf08c-2045-444f-8181-7a5ae5c3a599 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:12.619756 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-e7edf08c-2045-444f-8181-7a5ae5c3a599 None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:33:12.620948 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-e7edf08c-2045-444f-8181-7a5ae5c3a599 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:33:12.691364 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 208/419] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 24 05:33:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 05:33:12.863803 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8c70f9-53c5-44ef-8ebb-609cc26b028a None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:12.925794 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:12.991601 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8c70f9-53c5-44ef-8ebb-609cc26b028a None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:13.032255 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8331bd-f531-4813-8fd2-db3ce841ec37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:13.033281 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8331bd-f531-4813-8fd2-db3ce841ec37 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:13.034329 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8331bd-f531-4813-8fd2-db3ce841ec37 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:13.034870 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8331bd-f531-4813-8fd2-db3ce841ec37 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:13.051464 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7edf08c-2045-444f-8181-7a5ae5c3a599 None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:13.053804 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8331bd-f531-4813-8fd2-db3ce841ec37 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:33:13.063206 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application [None req-9d8331bd-f531-4813-8fd2-db3ce841ec37 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 05:33:13.063206 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:33:13.063206 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:33:13.063206 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:33:13.063206 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:33:13.063206 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:33:13.063206 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:33:13.063206 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:33:13.063206 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:33:13.063206 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:33:13.063206 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:33:13.063206 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:33:13.063206 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:33:13.063206 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:33:13.063206 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:33:13.063206 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:33:13.064156 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:33:13.064156 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:33:13.064156 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:33:13.064156 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:33:13.064156 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:33:13.064156 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:33:13.064156 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:33:13.064156 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:33:13.064156 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:33:13.064156 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:33:13.064156 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:33:13.064156 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application with Lock( Aug 24 05:33:13.064156 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:33:13.064156 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:33:13.064156 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:33:13.064156 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:33:13.065012 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:33:13.065012 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:33:13.065012 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:33:13.065012 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:33:13.065012 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:33:13.065012 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:33:13.065012 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:33:13.065012 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:33:13.065012 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:33:13.065012 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:33:13.065012 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 05:33:13.065012 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Aug 24 05:33:13.065012 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 212/420] 10.222.0.26 () {56 vars in 1099 bytes} [Wed Aug 24 05:33:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:33:13.070491 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8331bd-f531-4813-8fd2-db3ce841ec37 None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:13.157723 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:13.196139 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7edf08c-2045-444f-8181-7a5ae5c3a599 None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:13.235983 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d617db-b8cc-485b-bdda-2db3f3068db2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:13.236620 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d617db-b8cc-485b-bdda-2db3f3068db2 None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:13.236924 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d617db-b8cc-485b-bdda-2db3f3068db2 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:13.237195 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d617db-b8cc-485b-bdda-2db3f3068db2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:13.251777 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8331bd-f531-4813-8fd2-db3ce841ec37 None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:13.256470 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d617db-b8cc-485b-bdda-2db3f3068db2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:33:13.261220 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application [None req-f2d617db-b8cc-485b-bdda-2db3f3068db2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 05:33:13.261220 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:33:13.261220 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:33:13.261220 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:33:13.261220 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:33:13.261220 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:33:13.261220 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:33:13.261220 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:33:13.261220 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:33:13.261220 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:33:13.261220 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:33:13.261220 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:33:13.261220 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:33:13.261220 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:33:13.261220 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:33:13.261220 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:33:13.262140 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:33:13.262140 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:33:13.262140 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:33:13.262140 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:33:13.262140 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:33:13.262140 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:33:13.262140 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:33:13.262140 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:33:13.262140 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:33:13.262140 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:33:13.262140 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:33:13.262140 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application with Lock( Aug 24 05:33:13.262140 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:33:13.262140 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:33:13.262140 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:33:13.262140 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:33:13.263123 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:33:13.263123 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:33:13.263123 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:33:13.263123 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:33:13.263123 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:33:13.263123 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:33:13.263123 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:33:13.263123 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:33:13.263123 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:33:13.263123 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:33:13.263123 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 05:33:13.263123 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Aug 24 05:33:13.263123 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 209/421] 10.222.0.26 () {56 vars in 1114 bytes} [Wed Aug 24 05:33:13 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 05:33:13.270412 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d617db-b8cc-485b-bdda-2db3f3068db2 None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:13.278289 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:13.342739 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40af276-ae83-4a11-9a48-102309367677 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:13.343750 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40af276-ae83-4a11-9a48-102309367677 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:13.344292 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40af276-ae83-4a11-9a48-102309367677 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:13.344766 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40af276-ae83-4a11-9a48-102309367677 None admin] PATH_INFO: `/v3/roles` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:13.345644 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40af276-ae83-4a11-9a48-102309367677 None admin] RBAC: Adding query filter params (name=member) {{(pid=88113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:33:13.346186 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40af276-ae83-4a11-9a48-102309367677 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:13.347742 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40af276-ae83-4a11-9a48-102309367677 None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:13.365600 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 213/422] 10.222.0.26 () {56 vars in 1101 bytes} [Wed Aug 24 05:33:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:33:13.371337 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40af276-ae83-4a11-9a48-102309367677 None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:13.391054 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d617db-b8cc-485b-bdda-2db3f3068db2 None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:13.415587 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:13.428998 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ff6736-71ea-40b0-8a54-ac804ef91895 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:13.429628 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ff6736-71ea-40b0-8a54-ac804ef91895 None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:13.429912 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ff6736-71ea-40b0-8a54-ac804ef91895 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:13.430214 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ff6736-71ea-40b0-8a54-ac804ef91895 None admin] PATH_INFO: `/v3/roles` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:13.430894 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ff6736-71ea-40b0-8a54-ac804ef91895 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:33:13.431198 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ff6736-71ea-40b0-8a54-ac804ef91895 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:13.432590 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ff6736-71ea-40b0-8a54-ac804ef91895 None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:13.441854 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 210/423] 10.222.0.26 () {56 vars in 1111 bytes} [Wed Aug 24 05:33:13 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:33:13.447782 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ff6736-71ea-40b0-8a54-ac804ef91895 None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:13.558978 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ff6736-71ea-40b0-8a54-ac804ef91895 None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:13.567244 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40af276-ae83-4a11-9a48-102309367677 None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:13.594737 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68705cc0-97b9-4efe-9005-7f58940ae29a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:13.595414 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68705cc0-97b9-4efe-9005-7f58940ae29a None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:13.595623 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68705cc0-97b9-4efe-9005-7f58940ae29a None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:13.595892 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68705cc0-97b9-4efe-9005-7f58940ae29a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:13.631627 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb0765c-5834-488b-a272-232711a78bd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:13.632289 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb0765c-5834-488b-a272-232711a78bd0 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:13.632513 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb0765c-5834-488b-a272-232711a78bd0 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:13.632799 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb0765c-5834-488b-a272-232711a78bd0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:13.654719 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:13.670702 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68705cc0-97b9-4efe-9005-7f58940ae29a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:13.672113 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68705cc0-97b9-4efe-9005-7f58940ae29a None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:13.703612 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:13.737559 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb0765c-5834-488b-a272-232711a78bd0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:13.739255 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb0765c-5834-488b-a272-232711a78bd0 None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:13.779393 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 211/424] 10.222.0.26 () {58 vars in 1282 bytes} [Wed Aug 24 05:33:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 24 05:33:13.780734 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a9df21-0b6e-4931-b750-c18396eae420 None None] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:13.781023 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a9df21-0b6e-4931-b750-c18396eae420 None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:13.781294 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a9df21-0b6e-4931-b750-c18396eae420 None None] PATH_INFO: `/` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:13.782829 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 212/425] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 24 05:33:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:33:13.784898 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a9df21-0b6e-4931-b750-c18396eae420 None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:13.860774 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 214/426] 10.222.0.26 () {58 vars in 1282 bytes} [Wed Aug 24 05:33:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 490 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 05:33:13.862663 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91256d13-e2be-41d0-bc57-a968093f760a None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:13.862952 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91256d13-e2be-41d0-bc57-a968093f760a None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:13.863220 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91256d13-e2be-41d0-bc57-a968093f760a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:13.881448 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-91256d13-e2be-41d0-bc57-a968093f760a None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:33:13.881936 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:13.882680 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-91256d13-e2be-41d0-bc57-a968093f760a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:33:13.902772 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a9df21-0b6e-4931-b750-c18396eae420 None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:13.943518 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237e12e3-c528-40a0-93cb-a3a9f5d8d0a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:13.944069 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237e12e3-c528-40a0-93cb-a3a9f5d8d0a4 None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:13.944524 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237e12e3-c528-40a0-93cb-a3a9f5d8d0a4 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:13.944800 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237e12e3-c528-40a0-93cb-a3a9f5d8d0a4 None admin] PATH_INFO: `/v3/projects/d4bde08b78fc4447a53a2928b2d22185` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:13.946061 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237e12e3-c528-40a0-93cb-a3a9f5d8d0a4 None admin] RBAC: Authorizing `identity:get_project(project_id=d4bde08b78fc4447a53a2928b2d22185)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:13.947720 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237e12e3-c528-40a0-93cb-a3a9f5d8d0a4 None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:13.949905 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 213/427] 10.222.0.26 () {56 vars in 1186 bytes} [Wed Aug 24 05:33:13 2022] GET /identity/v3/projects/d4bde08b78fc4447a53a2928b2d22185 => generated 298 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:33:13.950761 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237e12e3-c528-40a0-93cb-a3a9f5d8d0a4 None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:13.952425 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:13.958878 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 215/428] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 24 05:33:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 05:33:13.959814 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91256d13-e2be-41d0-bc57-a968093f760a None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:14.063014 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237e12e3-c528-40a0-93cb-a3a9f5d8d0a4 None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:14.073153 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91256d13-e2be-41d0-bc57-a968093f760a None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:14.101218 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9418fcb-1223-464b-99ee-e7dae8cd48ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:14.101858 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9418fcb-1223-464b-99ee-e7dae8cd48ed None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:14.102163 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9418fcb-1223-464b-99ee-e7dae8cd48ed None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:14.102554 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9418fcb-1223-464b-99ee-e7dae8cd48ed None admin] PATH_INFO: `/v3/projects/d4bde08b78fc4447a53a2928b2d22185` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:14.103838 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9418fcb-1223-464b-99ee-e7dae8cd48ed None admin] RBAC: Authorizing `identity:get_project(project_id=d4bde08b78fc4447a53a2928b2d22185)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:14.105522 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9418fcb-1223-464b-99ee-e7dae8cd48ed None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:14.110405 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 214/429] 10.222.0.26 () {56 vars in 1186 bytes} [Wed Aug 24 05:33:13 2022] GET /identity/v3/projects/d4bde08b78fc4447a53a2928b2d22185 => generated 298 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:33:14.110405 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ba3a4c-e34a-4d97-b381-7c0f988e70ad None None] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:14.110405 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ba3a4c-e34a-4d97-b381-7c0f988e70ad None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:14.110405 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ba3a4c-e34a-4d97-b381-7c0f988e70ad None None] PATH_INFO: `/` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:14.110766 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 215/430] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 24 05:33:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:33:14.115228 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2032743e-1ceb-4d14-a3a7-2254a883daf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:14.115643 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ba3a4c-e34a-4d97-b381-7c0f988e70ad None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:14.115873 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2032743e-1ceb-4d14-a3a7-2254a883daf8 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:14.116156 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2032743e-1ceb-4d14-a3a7-2254a883daf8 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:14.116432 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2032743e-1ceb-4d14-a3a7-2254a883daf8 None admin] PATH_INFO: `/v3/groups/f7c18e21d27e4c80b57795d2a79500b6` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:14.119596 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2032743e-1ceb-4d14-a3a7-2254a883daf8 None admin] RBAC: Authorizing `identity:get_group(group_id=f7c18e21d27e4c80b57795d2a79500b6)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:14.121045 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2032743e-1ceb-4d14-a3a7-2254a883daf8 None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:14.127980 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 216/431] 10.222.0.26 () {56 vars in 1180 bytes} [Wed Aug 24 05:33:13 2022] GET /identity/v3/groups/f7c18e21d27e4c80b57795d2a79500b6 => generated 226 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:33:14.129281 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2032743e-1ceb-4d14-a3a7-2254a883daf8 None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:14.139908 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:14.209409 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:14.238786 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ba3a4c-e34a-4d97-b381-7c0f988e70ad None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:14.253026 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2032743e-1ceb-4d14-a3a7-2254a883daf8 None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:14.285447 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e8aa55-31eb-44bc-94e8-b642af67f660 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:14.286138 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e8aa55-31eb-44bc-94e8-b642af67f660 None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:14.286556 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e8aa55-31eb-44bc-94e8-b642af67f660 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:14.286934 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e8aa55-31eb-44bc-94e8-b642af67f660 None admin] PATH_INFO: `/v3/groups/f7c18e21d27e4c80b57795d2a79500b6` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:14.288309 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e8aa55-31eb-44bc-94e8-b642af67f660 None admin] RBAC: Authorizing `identity:get_group(group_id=f7c18e21d27e4c80b57795d2a79500b6)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:14.290052 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e8aa55-31eb-44bc-94e8-b642af67f660 None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:14.291072 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7301ed0b-3434-440a-a315-2213a7f15b0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:14.291832 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7301ed0b-3434-440a-a315-2213a7f15b0c None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:14.296593 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 216/432] 10.222.0.26 () {56 vars in 1180 bytes} [Wed Aug 24 05:33:14 2022] GET /identity/v3/groups/f7c18e21d27e4c80b57795d2a79500b6 => generated 226 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:33:14.296593 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a69cb51-862e-42fd-b470-5c53c148067d None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:14.296593 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a69cb51-862e-42fd-b470-5c53c148067d None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:14.296593 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a69cb51-862e-42fd-b470-5c53c148067d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:14.297300 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7301ed0b-3434-440a-a315-2213a7f15b0c None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:14.297755 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7301ed0b-3434-440a-a315-2213a7f15b0c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:14.298688 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7301ed0b-3434-440a-a315-2213a7f15b0c None admin] RBAC: Adding query filter params (group.id=f7c18e21d27e4c80b57795d2a79500b6, role.id=109c3556f4644bd291e81b0aa7fe2598, scope.project.id=d4bde08b78fc4447a53a2928b2d22185) {{(pid=88113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:33:14.299169 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7301ed0b-3434-440a-a315-2213a7f15b0c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:14.300847 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7301ed0b-3434-440a-a315-2213a7f15b0c None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:14.307852 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 217/433] 10.222.0.26 () {56 vars in 1376 bytes} [Wed Aug 24 05:33:14 2022] GET /identity/v3/role_assignments?group.id=f7c18e21d27e4c80b57795d2a79500b6&scope.project.id=d4bde08b78fc4447a53a2928b2d22185&role.id=109c3556f4644bd291e81b0aa7fe2598 => generated 611 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:33:14.308944 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7301ed0b-3434-440a-a315-2213a7f15b0c None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:14.321548 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-9a69cb51-862e-42fd-b470-5c53c148067d None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:33:14.322820 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-9a69cb51-862e-42fd-b470-5c53c148067d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:33:14.418809 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 217/434] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 24 05:33:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 05:33:14.420425 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a69cb51-862e-42fd-b470-5c53c148067d None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:14.444229 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:14.444581 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7301ed0b-3434-440a-a315-2213a7f15b0c None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:14.509647 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:14.517194 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88469e9-112d-4484-925a-0001498eb954 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:14.517832 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88469e9-112d-4484-925a-0001498eb954 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:14.518822 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88469e9-112d-4484-925a-0001498eb954 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:14.519309 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88469e9-112d-4484-925a-0001498eb954 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:14.520525 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88469e9-112d-4484-925a-0001498eb954 None admin] RBAC: Adding query filter params (group.id=f7c18e21d27e4c80b57795d2a79500b6, role.id=f7aa4a2c74c94c1b9ca8ecdcccccda5c, scope.project.id=d4bde08b78fc4447a53a2928b2d22185) {{(pid=88113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:33:14.521117 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88469e9-112d-4484-925a-0001498eb954 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:14.522988 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88469e9-112d-4484-925a-0001498eb954 None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:14.530309 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 218/435] 10.222.0.26 () {56 vars in 1376 bytes} [Wed Aug 24 05:33:14 2022] GET /identity/v3/role_assignments?group.id=f7c18e21d27e4c80b57795d2a79500b6&scope.project.id=d4bde08b78fc4447a53a2928b2d22185&role.id=f7aa4a2c74c94c1b9ca8ecdcccccda5c => generated 611 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:33:14.545904 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a69cb51-862e-42fd-b470-5c53c148067d None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:14.586921 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fb6166-2955-437c-a736-a7a62ddaaf98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:14.587597 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fb6166-2955-437c-a736-a7a62ddaaf98 None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:14.587875 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fb6166-2955-437c-a736-a7a62ddaaf98 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:14.588144 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fb6166-2955-437c-a736-a7a62ddaaf98 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:14.600686 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fb6166-2955-437c-a736-a7a62ddaaf98 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:33:14.605555 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application [None req-40fb6166-2955-437c-a736-a7a62ddaaf98 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 05:33:14.605555 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:33:14.605555 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:33:14.605555 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:33:14.605555 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:33:14.605555 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:33:14.605555 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:33:14.605555 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:33:14.605555 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:33:14.605555 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:33:14.605555 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:33:14.605555 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:33:14.605555 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:33:14.605555 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:33:14.605555 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:33:14.605555 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:33:14.606530 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:33:14.606530 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:33:14.606530 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:33:14.606530 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:33:14.606530 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:33:14.606530 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:33:14.606530 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:33:14.606530 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:33:14.606530 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:33:14.606530 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:33:14.606530 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:33:14.606530 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application with Lock( Aug 24 05:33:14.606530 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:33:14.606530 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:33:14.606530 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:33:14.606530 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:33:14.607321 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:33:14.607321 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:33:14.607321 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:33:14.607321 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:33:14.607321 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:33:14.607321 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:33:14.607321 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:33:14.607321 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:33:14.607321 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:33:14.607321 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:33:14.607321 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 05:33:14.607321 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Aug 24 05:33:14.607321 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 218/436] 10.222.0.26 () {56 vars in 1099 bytes} [Wed Aug 24 05:33:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:33:14.613632 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88469e9-112d-4484-925a-0001498eb954 None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:14.671324 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec42dd7-dea3-48ba-8313-220f1d1a2326 None None] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:14.671664 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec42dd7-dea3-48ba-8313-220f1d1a2326 None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:14.671868 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec42dd7-dea3-48ba-8313-220f1d1a2326 None None] PATH_INFO: `/` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:14.673236 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 219/437] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 24 05:33:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:33:14.680210 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb0eeba-752b-417a-b72d-607b0ceb1566 None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:14.680585 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb0eeba-752b-417a-b72d-607b0ceb1566 None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:14.681097 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb0eeba-752b-417a-b72d-607b0ceb1566 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:14.713933 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-5fb0eeba-752b-417a-b72d-607b0ceb1566 None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:33:14.715233 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-5fb0eeba-752b-417a-b72d-607b0ceb1566 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:33:14.742274 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88469e9-112d-4484-925a-0001498eb954 None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:14.780292 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752278cc-c6ed-40b7-a979-6fb35763600b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:14.780292 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752278cc-c6ed-40b7-a979-6fb35763600b None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:14.780292 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752278cc-c6ed-40b7-a979-6fb35763600b None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:14.780621 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752278cc-c6ed-40b7-a979-6fb35763600b None admin] PATH_INFO: `/v3/roles` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:14.781143 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752278cc-c6ed-40b7-a979-6fb35763600b None admin] RBAC: Adding query filter params (name=member) {{(pid=88113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:33:14.781449 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752278cc-c6ed-40b7-a979-6fb35763600b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:14.782944 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752278cc-c6ed-40b7-a979-6fb35763600b None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:14.795282 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 219/438] 10.222.0.26 () {56 vars in 1101 bytes} [Wed Aug 24 05:33:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:33:14.795282 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752278cc-c6ed-40b7-a979-6fb35763600b None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:14.802684 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 220/439] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 24 05:33:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 05:33:14.803608 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb0eeba-752b-417a-b72d-607b0ceb1566 None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:14.815872 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:14.871473 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:14.923403 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752278cc-c6ed-40b7-a979-6fb35763600b None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:14.947919 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb0eeba-752b-417a-b72d-607b0ceb1566 None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:14.970579 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af2ba41-c348-4834-ba51-3502e61fa796 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:14.971753 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af2ba41-c348-4834-ba51-3502e61fa796 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:14.972048 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af2ba41-c348-4834-ba51-3502e61fa796 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:14.972302 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af2ba41-c348-4834-ba51-3502e61fa796 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:14.984793 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af2ba41-c348-4834-ba51-3502e61fa796 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:33:14.989728 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application [None req-7af2ba41-c348-4834-ba51-3502e61fa796 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 05:33:14.989728 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:33:14.989728 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:33:14.989728 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:33:14.989728 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:33:14.989728 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:33:14.989728 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:33:14.989728 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:33:14.989728 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:33:14.989728 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:33:14.989728 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:33:14.989728 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:33:14.989728 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:33:14.989728 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:33:14.989728 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:33:14.989728 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:33:14.990716 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:33:14.990716 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:33:14.990716 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:33:14.990716 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:33:14.990716 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:33:14.990716 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:33:14.990716 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:33:14.990716 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:33:14.990716 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:33:14.990716 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:33:14.990716 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:33:14.990716 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application with Lock( Aug 24 05:33:14.990716 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:33:14.990716 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:33:14.990716 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:33:14.990716 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:33:14.991502 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:33:14.991502 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:33:14.991502 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:33:14.991502 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:33:14.991502 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:33:14.991502 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:33:14.991502 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:33:14.991502 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:33:14.991502 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:33:14.991502 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:33:14.991502 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 05:33:14.991502 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Aug 24 05:33:14.991502 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 220/440] 10.222.0.26 () {56 vars in 1114 bytes} [Wed Aug 24 05:33:14 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:33:14.994113 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81780e0e-0141-42af-b950-3e2d4a693f04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:14.994913 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81780e0e-0141-42af-b950-3e2d4a693f04 None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:14.995380 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81780e0e-0141-42af-b950-3e2d4a693f04 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:14.995896 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81780e0e-0141-42af-b950-3e2d4a693f04 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:14.997022 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af2ba41-c348-4834-ba51-3502e61fa796 None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:15.075114 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81780e0e-0141-42af-b950-3e2d4a693f04 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:15.076495 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81780e0e-0141-42af-b950-3e2d4a693f04 None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:15.087614 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:15.118930 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af2ba41-c348-4834-ba51-3502e61fa796 None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:15.138333 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:15.161014 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d7f803-3f6b-48df-ad36-86c8d7aab6bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:15.161634 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d7f803-3f6b-48df-ad36-86c8d7aab6bd None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:15.161914 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d7f803-3f6b-48df-ad36-86c8d7aab6bd None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:15.162209 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d7f803-3f6b-48df-ad36-86c8d7aab6bd None admin] PATH_INFO: `/v3/roles` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:15.162875 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d7f803-3f6b-48df-ad36-86c8d7aab6bd None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:33:15.163178 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d7f803-3f6b-48df-ad36-86c8d7aab6bd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:15.164554 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d7f803-3f6b-48df-ad36-86c8d7aab6bd None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:15.174855 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 221/441] 10.222.0.26 () {56 vars in 1111 bytes} [Wed Aug 24 05:33:14 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:33:15.175960 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d7f803-3f6b-48df-ad36-86c8d7aab6bd None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:15.201523 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 221/442] 10.222.0.26 () {58 vars in 1282 bytes} [Wed Aug 24 05:33:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 05:33:15.202775 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81780e0e-0141-42af-b950-3e2d4a693f04 None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:15.277484 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d7f803-3f6b-48df-ad36-86c8d7aab6bd None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:15.298195 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81780e0e-0141-42af-b950-3e2d4a693f04 None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:15.308220 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:15.310736 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5caa2a49-3c8a-400f-a4d6-c9717bccba5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:15.311363 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caa2a49-3c8a-400f-a4d6-c9717bccba5c None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:15.311650 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caa2a49-3c8a-400f-a4d6-c9717bccba5c None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:15.311915 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caa2a49-3c8a-400f-a4d6-c9717bccba5c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:15.322059 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5caa2a49-3c8a-400f-a4d6-c9717bccba5c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:33:15.328098 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application [None req-5caa2a49-3c8a-400f-a4d6-c9717bccba5c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 05:33:15.328098 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:33:15.328098 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:33:15.328098 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:33:15.328098 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:33:15.328098 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:33:15.328098 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:33:15.328098 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:33:15.328098 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:33:15.328098 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:33:15.328098 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:33:15.328098 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:33:15.328098 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:33:15.328098 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:33:15.328098 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:33:15.328098 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:33:15.328997 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:33:15.328997 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:33:15.328997 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:33:15.328997 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:33:15.328997 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:33:15.328997 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:33:15.328997 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:33:15.328997 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:33:15.328997 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:33:15.328997 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:33:15.328997 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:33:15.328997 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application with Lock( Aug 24 05:33:15.328997 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:33:15.328997 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:33:15.328997 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:33:15.328997 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:33:15.329779 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:33:15.329779 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:33:15.329779 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:33:15.329779 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:33:15.329779 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:33:15.329779 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:33:15.329779 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:33:15.329779 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:33:15.329779 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:33:15.329779 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:33:15.329779 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 05:33:15.329779 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Aug 24 05:33:15.329779 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 222/443] 10.222.0.26 () {56 vars in 1096 bytes} [Wed Aug 24 05:33:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:33:15.330504 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5caa2a49-3c8a-400f-a4d6-c9717bccba5c None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:15.335662 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ba9af5-9c99-4375-8201-b793fc2b2835 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:15.336263 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ba9af5-9c99-4375-8201-b793fc2b2835 None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:15.336538 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ba9af5-9c99-4375-8201-b793fc2b2835 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:15.336802 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ba9af5-9c99-4375-8201-b793fc2b2835 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:15.371192 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:15.402616 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ba9af5-9c99-4375-8201-b793fc2b2835 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:15.404069 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ba9af5-9c99-4375-8201-b793fc2b2835 None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:15.428954 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5caa2a49-3c8a-400f-a4d6-c9717bccba5c None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:15.462303 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620bfd03-77f6-4162-96c1-f00497e46e9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:15.462916 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620bfd03-77f6-4162-96c1-f00497e46e9c None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:15.463195 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620bfd03-77f6-4162-96c1-f00497e46e9c None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:15.463469 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620bfd03-77f6-4162-96c1-f00497e46e9c None admin] PATH_INFO: `/v3/projects/354a816414fb4c1d8f99d5307047be89` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:15.464577 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620bfd03-77f6-4162-96c1-f00497e46e9c None admin] RBAC: Authorizing `identity:get_project(project_id=354a816414fb4c1d8f99d5307047be89)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:15.466044 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620bfd03-77f6-4162-96c1-f00497e46e9c None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:15.467654 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 223/444] 10.222.0.26 () {56 vars in 1186 bytes} [Wed Aug 24 05:33:15 2022] GET /identity/v3/projects/354a816414fb4c1d8f99d5307047be89 => generated 302 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:33:15.468409 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620bfd03-77f6-4162-96c1-f00497e46e9c None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:15.505452 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 222/445] 10.222.0.26 () {58 vars in 1282 bytes} [Wed Aug 24 05:33:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 05:33:15.505452 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ba9af5-9c99-4375-8201-b793fc2b2835 None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:15.511774 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:15.572560 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620bfd03-77f6-4162-96c1-f00497e46e9c None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:15.582117 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:15.599170 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ba9af5-9c99-4375-8201-b793fc2b2835 None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:15.606643 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fee4687-e2ef-45fe-965b-b5484a7af3e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:15.607239 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fee4687-e2ef-45fe-965b-b5484a7af3e9 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:15.607514 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fee4687-e2ef-45fe-965b-b5484a7af3e9 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:15.607787 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fee4687-e2ef-45fe-965b-b5484a7af3e9 None admin] PATH_INFO: `/v3/roles` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:15.608446 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fee4687-e2ef-45fe-965b-b5484a7af3e9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:33:15.608742 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fee4687-e2ef-45fe-965b-b5484a7af3e9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:15.610125 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fee4687-e2ef-45fe-965b-b5484a7af3e9 None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:15.618186 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 224/446] 10.222.0.26 () {56 vars in 1099 bytes} [Wed Aug 24 05:33:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:33:15.618953 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fee4687-e2ef-45fe-965b-b5484a7af3e9 None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:15.632346 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fb8ef6-beb6-4cfd-bbcb-65e0f1d4e128 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:15.632974 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fb8ef6-beb6-4cfd-bbcb-65e0f1d4e128 None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:15.633248 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fb8ef6-beb6-4cfd-bbcb-65e0f1d4e128 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:15.633519 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fb8ef6-beb6-4cfd-bbcb-65e0f1d4e128 None admin] PATH_INFO: `/v3/groups/f7c18e21d27e4c80b57795d2a79500b6` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:15.634642 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fb8ef6-beb6-4cfd-bbcb-65e0f1d4e128 None admin] RBAC: Authorizing `identity:get_group(group_id=f7c18e21d27e4c80b57795d2a79500b6)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:15.636064 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fb8ef6-beb6-4cfd-bbcb-65e0f1d4e128 None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:15.637606 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 223/447] 10.222.0.26 () {56 vars in 1180 bytes} [Wed Aug 24 05:33:15 2022] GET /identity/v3/groups/f7c18e21d27e4c80b57795d2a79500b6 => generated 226 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:33:15.638392 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fb8ef6-beb6-4cfd-bbcb-65e0f1d4e128 None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:15.715775 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:15.718091 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fee4687-e2ef-45fe-965b-b5484a7af3e9 None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:15.739715 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fb8ef6-beb6-4cfd-bbcb-65e0f1d4e128 None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:15.750797 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1876eab7-ebe7-4bf2-b816-888eab5704c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:15.751423 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1876eab7-ebe7-4bf2-b816-888eab5704c3 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:15.751702 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1876eab7-ebe7-4bf2-b816-888eab5704c3 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:15.752081 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1876eab7-ebe7-4bf2-b816-888eab5704c3 None admin] PATH_INFO: `/v3/projects/354a816414fb4c1d8f99d5307047be89` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:15.754009 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1876eab7-ebe7-4bf2-b816-888eab5704c3 None admin] RBAC: Authorizing `identity:get_project(project_id=354a816414fb4c1d8f99d5307047be89)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:15.755193 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1876eab7-ebe7-4bf2-b816-888eab5704c3 None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:15.756798 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 225/448] 10.222.0.26 () {56 vars in 1186 bytes} [Wed Aug 24 05:33:15 2022] GET /identity/v3/projects/354a816414fb4c1d8f99d5307047be89 => generated 302 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:33:15.757543 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1876eab7-ebe7-4bf2-b816-888eab5704c3 None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:15.774210 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8568624f-f08e-4ef2-a453-5642ec273649 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:15.774711 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8568624f-f08e-4ef2-a453-5642ec273649 None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:15.775086 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8568624f-f08e-4ef2-a453-5642ec273649 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:15.775457 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8568624f-f08e-4ef2-a453-5642ec273649 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:15.799891 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:15.841344 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8568624f-f08e-4ef2-a453-5642ec273649 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:15.842752 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8568624f-f08e-4ef2-a453-5642ec273649 None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:15.859829 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1876eab7-ebe7-4bf2-b816-888eab5704c3 None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:15.893900 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a4c938-87e6-41a3-b780-eeb8306cd6fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:15.894508 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a4c938-87e6-41a3-b780-eeb8306cd6fd None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:15.894789 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a4c938-87e6-41a3-b780-eeb8306cd6fd None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:15.895076 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a4c938-87e6-41a3-b780-eeb8306cd6fd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:15.895795 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a4c938-87e6-41a3-b780-eeb8306cd6fd None admin] RBAC: Adding query filter params (group.id=f7c18e21d27e4c80b57795d2a79500b6, role.id=f7aa4a2c74c94c1b9ca8ecdcccccda5c, scope.project.id=354a816414fb4c1d8f99d5307047be89) {{(pid=88113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:33:15.896100 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a4c938-87e6-41a3-b780-eeb8306cd6fd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:15.897494 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a4c938-87e6-41a3-b780-eeb8306cd6fd None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:15.903006 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 226/449] 10.222.0.26 () {56 vars in 1376 bytes} [Wed Aug 24 05:33:15 2022] GET /identity/v3/role_assignments?group.id=f7c18e21d27e4c80b57795d2a79500b6&scope.project.id=354a816414fb4c1d8f99d5307047be89&role.id=f7aa4a2c74c94c1b9ca8ecdcccccda5c => generated 611 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:33:15.903767 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a4c938-87e6-41a3-b780-eeb8306cd6fd None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:15.923612 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:15.952646 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 224/450] 10.222.0.26 () {58 vars in 1282 bytes} [Wed Aug 24 05:33:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 05:33:15.959365 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8568624f-f08e-4ef2-a453-5642ec273649 None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:16.029289 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a4c938-87e6-41a3-b780-eeb8306cd6fd None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:16.031541 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:16.069770 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021bad21-c698-4c01-9ef2-a8fa764f0a31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:16.070445 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021bad21-c698-4c01-9ef2-a8fa764f0a31 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:16.070720 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021bad21-c698-4c01-9ef2-a8fa764f0a31 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:16.071000 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021bad21-c698-4c01-9ef2-a8fa764f0a31 None admin] PATH_INFO: `/v3/groups/f7c18e21d27e4c80b57795d2a79500b6` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:16.072072 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021bad21-c698-4c01-9ef2-a8fa764f0a31 None admin] RBAC: Authorizing `identity:get_group(group_id=f7c18e21d27e4c80b57795d2a79500b6)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:16.073511 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021bad21-c698-4c01-9ef2-a8fa764f0a31 None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:16.075445 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 227/451] 10.222.0.26 () {56 vars in 1180 bytes} [Wed Aug 24 05:33:15 2022] GET /identity/v3/groups/f7c18e21d27e4c80b57795d2a79500b6 => generated 226 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:33:16.076709 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8568624f-f08e-4ef2-a453-5642ec273649 None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:16.080862 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021bad21-c698-4c01-9ef2-a8fa764f0a31 None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:16.118635 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ecbcb6-b553-48cd-83f7-b5f9558e8ad1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:16.119366 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ecbcb6-b553-48cd-83f7-b5f9558e8ad1 None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:16.119475 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ecbcb6-b553-48cd-83f7-b5f9558e8ad1 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:16.119722 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ecbcb6-b553-48cd-83f7-b5f9558e8ad1 None admin] PATH_INFO: `/v3/projects/9e0475c5e4ae4451b23bd74342fbe5f1` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:16.121993 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ecbcb6-b553-48cd-83f7-b5f9558e8ad1 None admin] RBAC: Authorizing `identity:get_project(project_id=9e0475c5e4ae4451b23bd74342fbe5f1)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:16.123266 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ecbcb6-b553-48cd-83f7-b5f9558e8ad1 None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:16.126834 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 225/452] 10.222.0.26 () {56 vars in 1186 bytes} [Wed Aug 24 05:33:15 2022] GET /identity/v3/projects/9e0475c5e4ae4451b23bd74342fbe5f1 => generated 344 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:33:16.130557 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ecbcb6-b553-48cd-83f7-b5f9558e8ad1 None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:16.186763 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:16.199958 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021bad21-c698-4c01-9ef2-a8fa764f0a31 None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:16.240009 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd26c313-6f39-454a-8786-26fcd29af4db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:16.240982 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd26c313-6f39-454a-8786-26fcd29af4db None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:16.241453 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd26c313-6f39-454a-8786-26fcd29af4db None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:16.241929 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd26c313-6f39-454a-8786-26fcd29af4db None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:16.242874 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd26c313-6f39-454a-8786-26fcd29af4db None admin] RBAC: Adding query filter params (group.id=f7c18e21d27e4c80b57795d2a79500b6, role.id=109c3556f4644bd291e81b0aa7fe2598, scope.project.id=354a816414fb4c1d8f99d5307047be89) {{(pid=88113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:33:16.243383 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd26c313-6f39-454a-8786-26fcd29af4db None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:16.244815 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd26c313-6f39-454a-8786-26fcd29af4db None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:16.257975 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 228/453] 10.222.0.26 () {56 vars in 1376 bytes} [Wed Aug 24 05:33:16 2022] GET /identity/v3/role_assignments?group.id=f7c18e21d27e4c80b57795d2a79500b6&scope.project.id=354a816414fb4c1d8f99d5307047be89&role.id=109c3556f4644bd291e81b0aa7fe2598 => generated 611 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:33:16.258338 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ecbcb6-b553-48cd-83f7-b5f9558e8ad1 None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:16.297020 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36413c88-85d7-43e1-8437-6e23cf1d59f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:16.297673 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36413c88-85d7-43e1-8437-6e23cf1d59f1 None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:16.297975 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36413c88-85d7-43e1-8437-6e23cf1d59f1 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:16.298262 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36413c88-85d7-43e1-8437-6e23cf1d59f1 None admin] PATH_INFO: `/v3/groups/3a7b0e598b3343a7b6efede82264e89e` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:16.299552 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36413c88-85d7-43e1-8437-6e23cf1d59f1 None admin] RBAC: Authorizing `identity:get_group(group_id=3a7b0e598b3343a7b6efede82264e89e)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:16.301032 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36413c88-85d7-43e1-8437-6e23cf1d59f1 None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:16.302796 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 226/454] 10.222.0.26 () {56 vars in 1180 bytes} [Wed Aug 24 05:33:16 2022] GET /identity/v3/groups/3a7b0e598b3343a7b6efede82264e89e => generated 229 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:33:16.308716 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd26c313-6f39-454a-8786-26fcd29af4db None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:16.344762 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:16.413468 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd26c313-6f39-454a-8786-26fcd29af4db None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:16.445801 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f0d7f3-4ca9-4c9b-865f-2d543c432061 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:16.446437 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f0d7f3-4ca9-4c9b-865f-2d543c432061 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:16.446712 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f0d7f3-4ca9-4c9b-865f-2d543c432061 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:16.446976 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f0d7f3-4ca9-4c9b-865f-2d543c432061 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:16.447701 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f0d7f3-4ca9-4c9b-865f-2d543c432061 None admin] RBAC: Adding query filter params (group.id=3a7b0e598b3343a7b6efede82264e89e, role.id=640bda0879494e60b72680ee505285f0, scope.project.id=9e0475c5e4ae4451b23bd74342fbe5f1) {{(pid=88113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:33:16.448007 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f0d7f3-4ca9-4c9b-865f-2d543c432061 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:16.449432 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f0d7f3-4ca9-4c9b-865f-2d543c432061 None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:16.455709 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 229/455] 10.222.0.26 () {56 vars in 1376 bytes} [Wed Aug 24 05:33:16 2022] GET /identity/v3/role_assignments?group.id=3a7b0e598b3343a7b6efede82264e89e&scope.project.id=9e0475c5e4ae4451b23bd74342fbe5f1&role.id=640bda0879494e60b72680ee505285f0 => generated 611 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:33:18.679755 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec862dba-dc55-41c2-bb35-86fc12e4c85a None None] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:18.680776 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec862dba-dc55-41c2-bb35-86fc12e4c85a None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:18.681282 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec862dba-dc55-41c2-bb35-86fc12e4c85a None None] PATH_INFO: `/` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:18.683126 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 227/456] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 24 05:33:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:33:18.688202 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850a211c-a27e-46d6-9e88-cb5efffee98d None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:18.688649 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850a211c-a27e-46d6-9e88-cb5efffee98d None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:18.688729 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850a211c-a27e-46d6-9e88-cb5efffee98d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:18.713149 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-850a211c-a27e-46d6-9e88-cb5efffee98d None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:33:18.714364 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-850a211c-a27e-46d6-9e88-cb5efffee98d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:33:18.800299 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 230/457] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 24 05:33:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 05:33:18.862668 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b587ee6a-a1cd-4b9c-9bd9-913cfe990a44 None None] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:18.863298 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b587ee6a-a1cd-4b9c-9bd9-913cfe990a44 None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:18.863790 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b587ee6a-a1cd-4b9c-9bd9-913cfe990a44 None None] PATH_INFO: `/` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:18.865557 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 228/458] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 24 05:33:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:33:18.871267 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9c7b25-c2f3-4e17-8f7b-492fb7c6c815 None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:18.871553 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9c7b25-c2f3-4e17-8f7b-492fb7c6c815 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:18.871818 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9c7b25-c2f3-4e17-8f7b-492fb7c6c815 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:18.893393 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-cf9c7b25-c2f3-4e17-8f7b-492fb7c6c815 None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:33:18.894621 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-cf9c7b25-c2f3-4e17-8f7b-492fb7c6c815 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:33:18.923614 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:18.976015 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 231/459] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 24 05:33:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 05:33:19.261296 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d7cf66-3b59-400b-9aaf-0e7ffd868350 None None] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:19.262048 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d7cf66-3b59-400b-9aaf-0e7ffd868350 None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:19.262533 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d7cf66-3b59-400b-9aaf-0e7ffd868350 None None] PATH_INFO: `/` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:19.264403 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 229/460] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 24 05:33:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:33:19.270567 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda45b8a-ea33-41ca-bd34-e0e3c2453468 None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:19.271099 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda45b8a-ea33-41ca-bd34-e0e3c2453468 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:19.271573 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda45b8a-ea33-41ca-bd34-e0e3c2453468 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:19.279583 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d7cf66-3b59-400b-9aaf-0e7ffd868350 None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:19.313935 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-dda45b8a-ea33-41ca-bd34-e0e3c2453468 None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:33:19.315576 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-dda45b8a-ea33-41ca-bd34-e0e3c2453468 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:33:19.403845 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 232/461] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 24 05:33:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 05:33:19.405169 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda45b8a-ea33-41ca-bd34-e0e3c2453468 None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:19.430505 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d7cf66-3b59-400b-9aaf-0e7ffd868350 None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:19.443951 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:19.466710 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51979746-ff86-4008-91d8-fa70377d7a36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:19.467611 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51979746-ff86-4008-91d8-fa70377d7a36 None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:19.468061 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51979746-ff86-4008-91d8-fa70377d7a36 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:19.468530 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51979746-ff86-4008-91d8-fa70377d7a36 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:19.480267 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51979746-ff86-4008-91d8-fa70377d7a36 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:19.481712 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51979746-ff86-4008-91d8-fa70377d7a36 None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:19.501403 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application [None req-51979746-ff86-4008-91d8-fa70377d7a36 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:33:19.501403 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:33:19.501403 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:33:19.501403 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:33:19.501403 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:33:19.501403 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:33:19.501403 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:33:19.501403 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:33:19.501403 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:33:19.501403 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:33:19.501403 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:33:19.501403 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:33:19.501403 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 05:33:19.501403 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 05:33:19.501403 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 05:33:19.501403 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 05:33:19.502914 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:33:19.502914 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:33:19.502914 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:33:19.502914 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:33:19.502914 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:33:19.502914 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:33:19.502914 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:33:19.502914 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application with Lock( Aug 24 05:33:19.502914 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:33:19.502914 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:33:19.502914 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:33:19.502914 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:33:19.502914 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:33:19.502914 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:33:19.502914 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:33:19.502914 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:33:19.502914 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 05:33:19.503745 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 05:33:19.503745 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:33:19.503745 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Aug 24 05:33:19.504811 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:19.506077 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 230/462] 10.222.0.26 () {56 vars in 1108 bytes} [Wed Aug 24 05:33:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 05:33:19.507485 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5704b7-7410-4511-bace-aa04ebe5827f None None] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:19.507937 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5704b7-7410-4511-bace-aa04ebe5827f None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:19.508397 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5704b7-7410-4511-bace-aa04ebe5827f None None] PATH_INFO: `/` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:19.514466 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 231/463] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 24 05:33:19 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:33:19.515470 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5704b7-7410-4511-bace-aa04ebe5827f None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:19.518705 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda45b8a-ea33-41ca-bd34-e0e3c2453468 None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:19.555845 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05944a74-c416-440d-8596-0105ee67cea4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:19.556483 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05944a74-c416-440d-8596-0105ee67cea4 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:19.556763 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05944a74-c416-440d-8596-0105ee67cea4 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:19.557034 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05944a74-c416-440d-8596-0105ee67cea4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:19.568707 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05944a74-c416-440d-8596-0105ee67cea4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:19.570208 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05944a74-c416-440d-8596-0105ee67cea4 None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:19.586324 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application [None req-05944a74-c416-440d-8596-0105ee67cea4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:33:19.586324 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:33:19.586324 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:33:19.586324 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:33:19.586324 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:33:19.586324 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:33:19.586324 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:33:19.586324 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:33:19.586324 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:33:19.586324 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:33:19.586324 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:33:19.586324 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:33:19.586324 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 05:33:19.586324 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 05:33:19.586324 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 05:33:19.586324 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 05:33:19.587233 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:33:19.587233 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:33:19.587233 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:33:19.587233 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:33:19.587233 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:33:19.587233 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:33:19.587233 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:33:19.587233 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application with Lock( Aug 24 05:33:19.587233 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:33:19.587233 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:33:19.587233 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:33:19.587233 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:33:19.587233 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:33:19.587233 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:33:19.587233 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:33:19.587233 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:33:19.587233 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 05:33:19.588069 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 05:33:19.588069 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:33:19.588069 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Aug 24 05:33:19.588069 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 233/464] 10.222.0.26 () {56 vars in 1108 bytes} [Wed Aug 24 05:33:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:33:19.588783 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f91c21a-b944-4ebf-915f-e6ac22461405 None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:19.589079 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f91c21a-b944-4ebf-915f-e6ac22461405 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:19.589352 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f91c21a-b944-4ebf-915f-e6ac22461405 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:19.611004 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-1f91c21a-b944-4ebf-915f-e6ac22461405 None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:33:19.612972 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-1f91c21a-b944-4ebf-915f-e6ac22461405 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:33:19.633856 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5704b7-7410-4511-bace-aa04ebe5827f None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:19.668914 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0f5aa4-87de-47f6-864d-4c071e892dc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:19.669853 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0f5aa4-87de-47f6-864d-4c071e892dc2 None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:19.670372 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0f5aa4-87de-47f6-864d-4c071e892dc2 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:19.671270 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0f5aa4-87de-47f6-864d-4c071e892dc2 None admin] PATH_INFO: `/v3/domains` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:19.672394 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0f5aa4-87de-47f6-864d-4c071e892dc2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:33:19.672891 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0f5aa4-87de-47f6-864d-4c071e892dc2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:19.675112 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0f5aa4-87de-47f6-864d-4c071e892dc2 None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:19.689981 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 234/465] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 24 05:33:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 05:33:19.689981 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f91c21a-b944-4ebf-915f-e6ac22461405 None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:19.696078 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 232/466] 10.222.0.26 () {56 vars in 1109 bytes} [Wed Aug 24 05:33:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:33:19.699324 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0f5aa4-87de-47f6-864d-4c071e892dc2 None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:19.731099 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:19.765902 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:19.800220 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f91c21a-b944-4ebf-915f-e6ac22461405 None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:19.824445 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0f5aa4-87de-47f6-864d-4c071e892dc2 None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:19.839954 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4ca386-fed9-48b6-8ea2-2e619d245272 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:19.840561 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4ca386-fed9-48b6-8ea2-2e619d245272 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:19.840840 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4ca386-fed9-48b6-8ea2-2e619d245272 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:19.841111 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4ca386-fed9-48b6-8ea2-2e619d245272 None admin] PATH_INFO: `/v3/domains` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:19.841753 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4ca386-fed9-48b6-8ea2-2e619d245272 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:33:19.842086 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4ca386-fed9-48b6-8ea2-2e619d245272 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:19.843468 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4ca386-fed9-48b6-8ea2-2e619d245272 None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:19.860437 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 235/467] 10.222.0.26 () {56 vars in 1109 bytes} [Wed Aug 24 05:33:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:33:19.860437 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4ca386-fed9-48b6-8ea2-2e619d245272 None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:19.880572 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999519f1-4735-4093-b4dd-9a29a79c4153 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:19.881379 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999519f1-4735-4093-b4dd-9a29a79c4153 None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:19.881769 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999519f1-4735-4093-b4dd-9a29a79c4153 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:19.882148 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999519f1-4735-4093-b4dd-9a29a79c4153 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:19.893290 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999519f1-4735-4093-b4dd-9a29a79c4153 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:19.894998 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999519f1-4735-4093-b4dd-9a29a79c4153 None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:19.911800 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application [None req-999519f1-4735-4093-b4dd-9a29a79c4153 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:33:19.911800 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:33:19.911800 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:33:19.911800 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:33:19.911800 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:33:19.911800 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:33:19.911800 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:33:19.911800 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:33:19.911800 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:33:19.911800 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:33:19.911800 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:33:19.911800 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:33:19.911800 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 05:33:19.911800 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 05:33:19.911800 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 05:33:19.911800 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 05:33:19.913021 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:33:19.913021 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:33:19.913021 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:33:19.913021 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:33:19.913021 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:33:19.913021 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:33:19.913021 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:33:19.913021 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application with Lock( Aug 24 05:33:19.913021 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:33:19.913021 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:33:19.913021 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:33:19.913021 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:33:19.913021 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:33:19.913021 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:33:19.913021 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:33:19.913021 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:33:19.913021 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 05:33:19.914109 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 05:33:19.914109 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:33:19.914109 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Aug 24 05:33:19.919980 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 233/468] 10.222.0.26 () {56 vars in 1108 bytes} [Wed Aug 24 05:33:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:33:19.919980 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999519f1-4735-4093-b4dd-9a29a79c4153 None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:20.001131 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4ca386-fed9-48b6-8ea2-2e619d245272 None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:20.011332 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:20.032443 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:20.038950 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999519f1-4735-4093-b4dd-9a29a79c4153 None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:20.040948 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5401faa-5c80-4dd0-ac27-f5fac088b1ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:20.042398 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5401faa-5c80-4dd0-ac27-f5fac088b1ef None admin] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:20.042683 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5401faa-5c80-4dd0-ac27-f5fac088b1ef None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:20.042953 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5401faa-5c80-4dd0-ac27-f5fac088b1ef None admin] PATH_INFO: `/v3/users` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:20.043585 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5401faa-5c80-4dd0-ac27-f5fac088b1ef None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:20.045015 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5401faa-5c80-4dd0-ac27-f5fac088b1ef None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:20.070938 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 236/469] 10.222.0.26 () {60 vars in 1132 bytes} [Wed Aug 24 05:33:19 2022] POST /identity/v3/users => generated 246 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:33:20.071769 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5401faa-5c80-4dd0-ac27-f5fac088b1ef None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:20.079935 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7c3568-1ca8-4822-b85a-3ab4400f1b85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:20.081392 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7c3568-1ca8-4822-b85a-3ab4400f1b85 None admin] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:20.081667 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7c3568-1ca8-4822-b85a-3ab4400f1b85 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:20.081934 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7c3568-1ca8-4822-b85a-3ab4400f1b85 None admin] PATH_INFO: `/v3/users` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:20.082627 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7c3568-1ca8-4822-b85a-3ab4400f1b85 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:20.084155 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7c3568-1ca8-4822-b85a-3ab4400f1b85 None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:20.111027 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 234/470] 10.222.0.26 () {60 vars in 1132 bytes} [Wed Aug 24 05:33:19 2022] POST /identity/v3/users => generated 248 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:33:20.111943 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7c3568-1ca8-4822-b85a-3ab4400f1b85 None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:20.224614 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5401faa-5c80-4dd0-ac27-f5fac088b1ef None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:20.277018 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97455d9-d8d5-49cc-af2b-72cefb0a9104 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:20.277648 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97455d9-d8d5-49cc-af2b-72cefb0a9104 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:20.277926 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97455d9-d8d5-49cc-af2b-72cefb0a9104 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:20.278400 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97455d9-d8d5-49cc-af2b-72cefb0a9104 None admin] PATH_INFO: `/v3/domains` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:20.279528 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97455d9-d8d5-49cc-af2b-72cefb0a9104 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:33:20.280041 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97455d9-d8d5-49cc-af2b-72cefb0a9104 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:20.290054 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97455d9-d8d5-49cc-af2b-72cefb0a9104 None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:20.298703 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 237/471] 10.222.0.26 () {56 vars in 1109 bytes} [Wed Aug 24 05:33:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:33:20.304147 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97455d9-d8d5-49cc-af2b-72cefb0a9104 None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:20.334972 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7c3568-1ca8-4822-b85a-3ab4400f1b85 None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:20.361638 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:20.377722 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:20.386533 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953f87fb-9e07-4646-bf27-753cfc700e41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:20.387381 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953f87fb-9e07-4646-bf27-753cfc700e41 None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:20.387820 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953f87fb-9e07-4646-bf27-753cfc700e41 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:20.388459 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953f87fb-9e07-4646-bf27-753cfc700e41 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:20.401064 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953f87fb-9e07-4646-bf27-753cfc700e41 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:20.402572 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953f87fb-9e07-4646-bf27-753cfc700e41 None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:20.423263 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application [None req-953f87fb-9e07-4646-bf27-753cfc700e41 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:33:20.423263 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:33:20.423263 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:33:20.423263 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:33:20.423263 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:33:20.423263 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:33:20.423263 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:33:20.423263 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:33:20.423263 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:33:20.423263 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:33:20.423263 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:33:20.423263 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:33:20.423263 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 05:33:20.423263 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 05:33:20.423263 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 05:33:20.423263 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 05:33:20.424259 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:33:20.424259 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:33:20.424259 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:33:20.424259 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:33:20.424259 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:33:20.424259 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:33:20.424259 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:33:20.424259 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application with Lock( Aug 24 05:33:20.424259 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:33:20.424259 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:33:20.424259 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:33:20.424259 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:33:20.424259 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:33:20.424259 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:33:20.424259 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:33:20.424259 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:33:20.424259 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 05:33:20.425103 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 05:33:20.425103 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:33:20.425103 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Aug 24 05:33:20.427289 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 235/472] 10.222.0.26 () {56 vars in 1108 bytes} [Wed Aug 24 05:33:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:33:20.433236 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953f87fb-9e07-4646-bf27-753cfc700e41 None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:20.434353 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97455d9-d8d5-49cc-af2b-72cefb0a9104 None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:20.487568 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8768786-12a2-4819-865e-42194e0d0c11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:20.489020 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8768786-12a2-4819-865e-42194e0d0c11 None admin] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:20.489576 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8768786-12a2-4819-865e-42194e0d0c11 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:20.490058 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8768786-12a2-4819-865e-42194e0d0c11 None admin] PATH_INFO: `/v3/users` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:20.491147 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8768786-12a2-4819-865e-42194e0d0c11 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:20.493548 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8768786-12a2-4819-865e-42194e0d0c11 None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:20.529559 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 238/473] 10.222.0.26 () {60 vars in 1132 bytes} [Wed Aug 24 05:33:20 2022] POST /identity/v3/users => generated 248 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:33:20.531337 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899882c9-f0e3-4bb5-a520-7bc057b6dd74 None None] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:20.532325 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899882c9-f0e3-4bb5-a520-7bc057b6dd74 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:20.532825 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899882c9-f0e3-4bb5-a520-7bc057b6dd74 None None] PATH_INFO: `/` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:20.539394 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 239/474] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 24 05:33:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:33:20.543502 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ddb095-1c2d-4b75-bc72-039d27a17f48 None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:20.544713 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ddb095-1c2d-4b75-bc72-039d27a17f48 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:20.545213 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ddb095-1c2d-4b75-bc72-039d27a17f48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:20.577381 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953f87fb-9e07-4646-bf27-753cfc700e41 None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:20.591969 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-d3ddb095-1c2d-4b75-bc72-039d27a17f48 None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:33:20.593211 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-d3ddb095-1c2d-4b75-bc72-039d27a17f48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:33:20.657488 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b637999-303a-4faf-b0df-9f922a354129 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:20.658245 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b637999-303a-4faf-b0df-9f922a354129 None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:20.659028 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b637999-303a-4faf-b0df-9f922a354129 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:20.660502 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b637999-303a-4faf-b0df-9f922a354129 None admin] PATH_INFO: `/v3/domains` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:20.661181 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b637999-303a-4faf-b0df-9f922a354129 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:33:20.661487 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b637999-303a-4faf-b0df-9f922a354129 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:20.664207 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b637999-303a-4faf-b0df-9f922a354129 None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:20.696171 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 236/475] 10.222.0.26 () {56 vars in 1109 bytes} [Wed Aug 24 05:33:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:33:20.703580 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b637999-303a-4faf-b0df-9f922a354129 None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:20.730221 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 240/476] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 24 05:33:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 05:33:20.766495 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:20.823050 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b637999-303a-4faf-b0df-9f922a354129 None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:20.857378 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4600881e-c992-4b4d-8a5c-f55b7b07728d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:20.858380 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4600881e-c992-4b4d-8a5c-f55b7b07728d None admin] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:20.858856 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4600881e-c992-4b4d-8a5c-f55b7b07728d None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:20.859361 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4600881e-c992-4b4d-8a5c-f55b7b07728d None admin] PATH_INFO: `/v3/users` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:20.860182 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4600881e-c992-4b4d-8a5c-f55b7b07728d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:20.862422 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4600881e-c992-4b4d-8a5c-f55b7b07728d None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:20.885759 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 237/477] 10.222.0.26 () {60 vars in 1132 bytes} [Wed Aug 24 05:33:20 2022] POST /identity/v3/users => generated 249 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 05:33:21.025580 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ddb095-1c2d-4b75-bc72-039d27a17f48 None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:21.060685 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:21.137154 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ddb095-1c2d-4b75-bc72-039d27a17f48 None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:21.171696 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e7518b-9f99-4eee-98ee-123dee0a8868 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:21.172303 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e7518b-9f99-4eee-98ee-123dee0a8868 None admin] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:21.172573 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e7518b-9f99-4eee-98ee-123dee0a8868 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:21.172840 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e7518b-9f99-4eee-98ee-123dee0a8868 None admin] PATH_INFO: `/v3/roles` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:21.173491 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e7518b-9f99-4eee-98ee-123dee0a8868 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:21.174913 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e7518b-9f99-4eee-98ee-123dee0a8868 None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:21.183866 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.sql.core [None req-86e7518b-9f99-4eee-98ee-123dee0a8868 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 24 05:33:21.183866 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 24 05:33:21.183866 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [parameters: {'id': 'e2bde1bfd1894f89890ee11b0676e097', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 24 05:33:21.183866 dv-cinder-854268-1-smb devstack@keystone.service[88113]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=88113) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 24 05:33:21.200970 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application [None req-86e7518b-9f99-4eee-98ee-123dee0a8868 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 24 05:33:21.200970 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:33:21.200970 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 24 05:33:21.200970 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 24 05:33:21.200970 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 24 05:33:21.200970 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 24 05:33:21.200970 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 24 05:33:21.200970 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application result = self._query(query) Aug 24 05:33:21.200970 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 24 05:33:21.200970 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application conn.query(q) Aug 24 05:33:21.200970 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 24 05:33:21.200970 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 24 05:33:21.200970 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 24 05:33:21.200970 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application result.read() Aug 24 05:33:21.200970 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 24 05:33:21.201869 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 24 05:33:21.201869 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 24 05:33:21.201869 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 24 05:33:21.201869 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 24 05:33:21.201869 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 24 05:33:21.201869 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 24 05:33:21.201869 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 24 05:33:21.201869 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 24 05:33:21.201869 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Aug 24 05:33:21.201869 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 24 05:33:21.201869 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Aug 24 05:33:21.201869 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:33:21.201869 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 24 05:33:21.201869 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 24 05:33:21.201869 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Aug 24 05:33:21.201869 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return ref.to_dict() Aug 24 05:33:21.201869 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 24 05:33:21.201869 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application next(self.gen) Aug 24 05:33:21.203092 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 24 05:33:21.203092 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application yield resource Aug 24 05:33:21.203092 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 24 05:33:21.203092 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application next(self.gen) Aug 24 05:33:21.203092 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 24 05:33:21.203092 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application self.session.rollback() Aug 24 05:33:21.203092 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 24 05:33:21.203092 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application self.force_reraise() Aug 24 05:33:21.203092 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 24 05:33:21.203092 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application raise self.value Aug 24 05:33:21.203092 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 24 05:33:21.203092 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 24 05:33:21.203092 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 24 05:33:21.203092 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application session.commit() Aug 24 05:33:21.203092 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 24 05:33:21.203092 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 24 05:33:21.203092 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 24 05:33:21.203936 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application self._prepare_impl() Aug 24 05:33:21.203936 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 24 05:33:21.203936 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application self.session.flush() Aug 24 05:33:21.203936 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 24 05:33:21.203936 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application self._flush(objects) Aug 24 05:33:21.203936 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 24 05:33:21.203936 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 24 05:33:21.203936 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 24 05:33:21.203936 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application compat.raise_( Aug 24 05:33:21.203936 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 24 05:33:21.203936 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application raise exception Aug 24 05:33:21.203936 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 24 05:33:21.203936 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application flush_context.execute() Aug 24 05:33:21.203936 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 24 05:33:21.203936 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application rec.execute(self) Aug 24 05:33:21.203936 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 24 05:33:21.203936 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 24 05:33:21.205913 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 24 05:33:21.205913 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 24 05:33:21.205913 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 24 05:33:21.205913 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 24 05:33:21.205913 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 24 05:33:21.205913 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 24 05:33:21.205913 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 24 05:33:21.205913 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 24 05:33:21.205913 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 24 05:33:21.205913 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 24 05:33:21.205913 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 24 05:33:21.205913 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 24 05:33:21.205913 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 24 05:33:21.205913 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 24 05:33:21.205913 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 24 05:33:21.205913 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application raise exception Aug 24 05:33:21.206757 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 24 05:33:21.206757 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 24 05:33:21.206757 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 24 05:33:21.206757 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 24 05:33:21.206757 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 24 05:33:21.206757 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application result = self._query(query) Aug 24 05:33:21.206757 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 24 05:33:21.206757 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application conn.query(q) Aug 24 05:33:21.206757 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 24 05:33:21.206757 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 24 05:33:21.206757 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 24 05:33:21.206757 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application result.read() Aug 24 05:33:21.206757 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 24 05:33:21.206757 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 24 05:33:21.206757 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 24 05:33:21.206757 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 24 05:33:21.209060 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 24 05:33:21.209060 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 24 05:33:21.209060 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 24 05:33:21.209060 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 24 05:33:21.209060 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 24 05:33:21.209060 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 24 05:33:21.209060 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application [parameters: {'id': 'e2bde1bfd1894f89890ee11b0676e097', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 24 05:33:21.209060 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 24 05:33:21.209060 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Aug 24 05:33:21.209060 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 05:33:21.209060 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Aug 24 05:33:21.209060 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:33:21.209060 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:33:21.209060 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:33:21.209060 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:33:21.209060 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:33:21.212245 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:33:21.212245 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:33:21.212245 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:33:21.212245 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:33:21.212245 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:33:21.212245 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:33:21.212245 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Aug 24 05:33:21.212245 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Aug 24 05:33:21.212245 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:33:21.212245 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:33:21.212245 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Aug 24 05:33:21.212245 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Aug 24 05:33:21.212245 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 24 05:33:21.212245 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 24 05:33:21.212245 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 24 05:33:21.212245 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Aug 24 05:33:21.214232 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 241/478] 10.222.0.26 () {60 vars in 1131 bytes} [Wed Aug 24 05:33:21 2022] POST /identity/v3/roles => generated 144 bytes in 177 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:33:21.215971 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4600881e-c992-4b4d-8a5c-f55b7b07728d None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:21.323616 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4600881e-c992-4b4d-8a5c-f55b7b07728d None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:21.331145 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:21.359909 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f182d5-5982-44d8-9362-c09cdd8ac02a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:21.360542 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f182d5-5982-44d8-9362-c09cdd8ac02a None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:21.360816 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f182d5-5982-44d8-9362-c09cdd8ac02a None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:21.361084 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f182d5-5982-44d8-9362-c09cdd8ac02a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:21.372878 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f182d5-5982-44d8-9362-c09cdd8ac02a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:33:21.378914 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application [None req-55f182d5-5982-44d8-9362-c09cdd8ac02a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 05:33:21.378914 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:33:21.378914 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:33:21.378914 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:33:21.378914 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:33:21.378914 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:33:21.378914 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:33:21.378914 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:33:21.378914 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:33:21.378914 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:33:21.378914 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:33:21.378914 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:33:21.378914 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:33:21.378914 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:33:21.378914 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:33:21.378914 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:33:21.379807 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:33:21.379807 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:33:21.379807 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:33:21.379807 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:33:21.379807 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:33:21.379807 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:33:21.379807 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:33:21.379807 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:33:21.379807 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:33:21.379807 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:33:21.379807 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:33:21.379807 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application with Lock( Aug 24 05:33:21.379807 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:33:21.379807 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:33:21.379807 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:33:21.379807 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:33:21.380983 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:33:21.380983 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:33:21.380983 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:33:21.380983 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:33:21.380983 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:33:21.380983 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:33:21.380983 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:33:21.380983 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:33:21.380983 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:33:21.380983 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:33:21.380983 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 05:33:21.380983 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Aug 24 05:33:21.380983 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 238/479] 10.222.0.26 () {56 vars in 1114 bytes} [Wed Aug 24 05:33:21 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:33:21.385854 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e7518b-9f99-4eee-98ee-123dee0a8868 None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:21.488186 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:21.494229 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e7518b-9f99-4eee-98ee-123dee0a8868 None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:21.530582 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739b7748-c6b3-42cc-9b92-7026d6e2d743 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:21.531267 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739b7748-c6b3-42cc-9b92-7026d6e2d743 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:21.531544 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739b7748-c6b3-42cc-9b92-7026d6e2d743 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:21.531810 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739b7748-c6b3-42cc-9b92-7026d6e2d743 None admin] PATH_INFO: `/v3/roles` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:21.532529 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739b7748-c6b3-42cc-9b92-7026d6e2d743 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:33:21.532830 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739b7748-c6b3-42cc-9b92-7026d6e2d743 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:21.536892 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739b7748-c6b3-42cc-9b92-7026d6e2d743 None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:21.544644 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 242/480] 10.222.0.26 () {56 vars in 1111 bytes} [Wed Aug 24 05:33:21 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:33:22.353923 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c473fe8d-382e-476d-8020-883bc0d516a6 None None] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:22.354954 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c473fe8d-382e-476d-8020-883bc0d516a6 None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:22.355474 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c473fe8d-382e-476d-8020-883bc0d516a6 None None] PATH_INFO: `/` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:22.357329 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 239/481] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 24 05:33:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:33:22.362378 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6201bd0e-1148-41a9-8631-7255afcb4219 None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:22.363196 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6201bd0e-1148-41a9-8631-7255afcb4219 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:22.363672 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6201bd0e-1148-41a9-8631-7255afcb4219 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:22.386460 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-6201bd0e-1148-41a9-8631-7255afcb4219 None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:33:22.387993 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-6201bd0e-1148-41a9-8631-7255afcb4219 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:33:22.417663 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3216dd5-9db9-4886-8aab-f924fc3cc695 None None] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:22.417987 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3216dd5-9db9-4886-8aab-f924fc3cc695 None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:22.418246 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3216dd5-9db9-4886-8aab-f924fc3cc695 None None] PATH_INFO: `/` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:22.419797 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 240/482] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 24 05:33:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:33:22.425212 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3372e19-72b2-4ee2-94c0-093601fcb5d6 None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:22.425507 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3372e19-72b2-4ee2-94c0-093601fcb5d6 None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:22.425765 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3372e19-72b2-4ee2-94c0-093601fcb5d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:22.457652 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-f3372e19-72b2-4ee2-94c0-093601fcb5d6 None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:33:22.459977 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-f3372e19-72b2-4ee2-94c0-093601fcb5d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:33:22.489877 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 243/483] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 24 05:33:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 05:33:22.587701 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 241/484] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 24 05:33:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 05:33:22.776681 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6201bd0e-1148-41a9-8631-7255afcb4219 None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:22.885756 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:22.899960 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6201bd0e-1148-41a9-8631-7255afcb4219 None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:22.945698 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608017e2-7cef-4fbe-bf59-ca252462c709 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:22.946683 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608017e2-7cef-4fbe-bf59-ca252462c709 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:22.947160 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608017e2-7cef-4fbe-bf59-ca252462c709 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:22.947627 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608017e2-7cef-4fbe-bf59-ca252462c709 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:22.953809 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3372e19-72b2-4ee2-94c0-093601fcb5d6 None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:22.959166 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608017e2-7cef-4fbe-bf59-ca252462c709 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:33:22.964304 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application [None req-608017e2-7cef-4fbe-bf59-ca252462c709 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 05:33:22.964304 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:33:22.964304 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:33:22.964304 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:33:22.964304 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:33:22.964304 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:33:22.964304 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:33:22.964304 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:33:22.964304 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:33:22.964304 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:33:22.964304 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:33:22.964304 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:33:22.964304 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:33:22.964304 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:33:22.964304 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:33:22.964304 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:33:22.965162 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:33:22.965162 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:33:22.965162 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:33:22.965162 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:33:22.965162 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:33:22.965162 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:33:22.965162 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:33:22.965162 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:33:22.965162 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:33:22.965162 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:33:22.965162 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:33:22.965162 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application with Lock( Aug 24 05:33:22.965162 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:33:22.965162 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:33:22.965162 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:33:22.965162 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:33:22.965993 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:33:22.965993 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:33:22.965993 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:33:22.965993 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:33:22.965993 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:33:22.965993 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:33:22.965993 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:33:22.965993 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:33:22.965993 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:33:22.965993 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:33:22.965993 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 05:33:22.965993 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Aug 24 05:33:22.968675 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 244/485] 10.222.0.26 () {56 vars in 1102 bytes} [Wed Aug 24 05:33:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:33:22.975095 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608017e2-7cef-4fbe-bf59-ca252462c709 None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:23.132074 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:23.145251 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3372e19-72b2-4ee2-94c0-093601fcb5d6 None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:23.164578 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608017e2-7cef-4fbe-bf59-ca252462c709 None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:23.186692 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390e6986-2050-4f6e-86f4-df96d71da8ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:23.187328 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390e6986-2050-4f6e-86f4-df96d71da8ea None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:23.187609 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390e6986-2050-4f6e-86f4-df96d71da8ea None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:23.187881 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390e6986-2050-4f6e-86f4-df96d71da8ea None admin] PATH_INFO: `/v3/roles/service` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:23.200279 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390e6986-2050-4f6e-86f4-df96d71da8ea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:33:23.205558 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application [None req-390e6986-2050-4f6e-86f4-df96d71da8ea None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 05:33:23.205558 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:33:23.205558 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:33:23.205558 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:33:23.205558 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:33:23.205558 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:33:23.205558 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:33:23.205558 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:33:23.205558 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:33:23.205558 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:33:23.205558 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:33:23.205558 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:33:23.205558 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:33:23.205558 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:33:23.205558 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:33:23.205558 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:33:23.206514 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:33:23.206514 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:33:23.206514 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:33:23.206514 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:33:23.206514 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:33:23.206514 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:33:23.206514 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:33:23.206514 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:33:23.206514 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:33:23.206514 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:33:23.206514 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:33:23.206514 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application with Lock( Aug 24 05:33:23.206514 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:33:23.206514 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:33:23.206514 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:33:23.206514 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:33:23.207891 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:33:23.207891 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:33:23.207891 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:33:23.207891 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:33:23.207891 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:33:23.207891 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:33:23.207891 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:33:23.207891 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:33:23.207891 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:33:23.207891 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:33:23.207891 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 05:33:23.207891 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Aug 24 05:33:23.207891 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 242/486] 10.222.0.26 () {56 vars in 1102 bytes} [Wed Aug 24 05:33:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:33:23.208552 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb3c99a-0283-49bd-9a57-2d249c231ae1 None None] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:23.208552 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb3c99a-0283-49bd-9a57-2d249c231ae1 None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:23.209478 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb3c99a-0283-49bd-9a57-2d249c231ae1 None None] PATH_INFO: `/` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:23.212416 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1ebd41-ea37-4d28-9f03-e18a3ba8e6e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:23.213272 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1ebd41-ea37-4d28-9f03-e18a3ba8e6e3 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:23.213743 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1ebd41-ea37-4d28-9f03-e18a3ba8e6e3 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:23.214241 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1ebd41-ea37-4d28-9f03-e18a3ba8e6e3 None admin] PATH_INFO: `/v3/roles` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:23.214981 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 243/487] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 24 05:33:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:33:23.215427 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1ebd41-ea37-4d28-9f03-e18a3ba8e6e3 None admin] RBAC: Adding query filter params (name=service) {{(pid=88113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:33:23.215784 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb3c99a-0283-49bd-9a57-2d249c231ae1 None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:23.216257 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1ebd41-ea37-4d28-9f03-e18a3ba8e6e3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:23.217922 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1ebd41-ea37-4d28-9f03-e18a3ba8e6e3 None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:23.230942 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 245/488] 10.222.0.26 () {56 vars in 1103 bytes} [Wed Aug 24 05:33:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:33:23.232886 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b02eca-20c6-4908-a9b0-515301d29a42 None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:23.233382 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b02eca-20c6-4908-a9b0-515301d29a42 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:23.233872 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b02eca-20c6-4908-a9b0-515301d29a42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:23.257598 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-87b02eca-20c6-4908-a9b0-515301d29a42 None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:33:23.260269 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-87b02eca-20c6-4908-a9b0-515301d29a42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:33:23.263443 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:23.338437 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 246/489] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 24 05:33:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 05:33:23.339719 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b02eca-20c6-4908-a9b0-515301d29a42 None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:23.346395 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb3c99a-0283-49bd-9a57-2d249c231ae1 None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:23.394072 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ad1966-7c17-41f2-9341-cc0e7489c819 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:23.394699 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ad1966-7c17-41f2-9341-cc0e7489c819 None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:23.394932 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ad1966-7c17-41f2-9341-cc0e7489c819 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:23.395133 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ad1966-7c17-41f2-9341-cc0e7489c819 None admin] PATH_INFO: `/v3/roles` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:23.395808 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ad1966-7c17-41f2-9341-cc0e7489c819 None admin] RBAC: Adding query filter params (name=service) {{(pid=88112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:33:23.396168 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ad1966-7c17-41f2-9341-cc0e7489c819 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:23.398125 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ad1966-7c17-41f2-9341-cc0e7489c819 None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:23.409731 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 244/490] 10.222.0.26 () {56 vars in 1103 bytes} [Wed Aug 24 05:33:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:33:23.413900 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ad1966-7c17-41f2-9341-cc0e7489c819 None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:23.432494 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:23.462224 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b02eca-20c6-4908-a9b0-515301d29a42 None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:23.505089 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fa3431-572d-4bcf-990e-ac1e3a35d7f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:23.505978 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fa3431-572d-4bcf-990e-ac1e3a35d7f9 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:23.506476 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fa3431-572d-4bcf-990e-ac1e3a35d7f9 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:23.506888 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fa3431-572d-4bcf-990e-ac1e3a35d7f9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:23.515963 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:23.520382 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fa3431-572d-4bcf-990e-ac1e3a35d7f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:23.522109 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fa3431-572d-4bcf-990e-ac1e3a35d7f9 None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:23.540008 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ad1966-7c17-41f2-9341-cc0e7489c819 None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:23.543222 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application [None req-01fa3431-572d-4bcf-990e-ac1e3a35d7f9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:33:23.543222 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:33:23.543222 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:33:23.543222 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:33:23.543222 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:33:23.543222 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:33:23.543222 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:33:23.543222 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:33:23.543222 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:33:23.543222 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:33:23.543222 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:33:23.543222 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:33:23.543222 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 05:33:23.543222 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 05:33:23.543222 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 05:33:23.543222 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 05:33:23.544087 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:33:23.544087 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:33:23.544087 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:33:23.544087 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:33:23.544087 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:33:23.544087 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:33:23.544087 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:33:23.544087 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application with Lock( Aug 24 05:33:23.544087 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:33:23.544087 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:33:23.544087 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:33:23.544087 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:33:23.544087 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:33:23.544087 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:33:23.544087 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:33:23.544087 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:33:23.544087 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 05:33:23.544937 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 05:33:23.544937 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:33:23.544937 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Aug 24 05:33:23.547188 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 247/491] 10.222.0.26 () {56 vars in 1108 bytes} [Wed Aug 24 05:33:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:33:23.559433 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fa3431-572d-4bcf-990e-ac1e3a35d7f9 None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:23.586581 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916cf352-b1eb-49ee-bfb0-a91f7b4ef078 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:23.587560 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916cf352-b1eb-49ee-bfb0-a91f7b4ef078 None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:23.588042 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916cf352-b1eb-49ee-bfb0-a91f7b4ef078 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:23.588514 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916cf352-b1eb-49ee-bfb0-a91f7b4ef078 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:23.613251 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916cf352-b1eb-49ee-bfb0-a91f7b4ef078 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:23.615714 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916cf352-b1eb-49ee-bfb0-a91f7b4ef078 None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:23.646296 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application [None req-916cf352-b1eb-49ee-bfb0-a91f7b4ef078 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:33:23.646296 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:33:23.646296 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:33:23.646296 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:33:23.646296 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:33:23.646296 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:33:23.646296 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:33:23.646296 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:33:23.646296 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:33:23.646296 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:33:23.646296 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:33:23.646296 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:33:23.646296 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 05:33:23.646296 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 05:33:23.646296 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 05:33:23.646296 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 05:33:23.647210 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:33:23.647210 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:33:23.647210 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:33:23.647210 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:33:23.647210 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:33:23.647210 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:33:23.647210 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:33:23.647210 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application with Lock( Aug 24 05:33:23.647210 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:33:23.647210 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:33:23.647210 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:33:23.647210 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:33:23.647210 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:33:23.647210 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:33:23.647210 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:33:23.647210 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:33:23.647210 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 05:33:23.648052 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 05:33:23.648052 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:33:23.648052 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Aug 24 05:33:23.654265 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 245/492] 10.222.0.26 () {56 vars in 1108 bytes} [Wed Aug 24 05:33:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:33:23.658888 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fd8de3-d330-4ea4-a666-b7c9784154c4 None None] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:23.661007 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fd8de3-d330-4ea4-a666-b7c9784154c4 None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:23.661283 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fd8de3-d330-4ea4-a666-b7c9784154c4 None None] PATH_INFO: `/` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:23.665710 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 246/493] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 24 05:33:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:33:23.665710 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fd8de3-d330-4ea4-a666-b7c9784154c4 None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:23.721233 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fa3431-572d-4bcf-990e-ac1e3a35d7f9 None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:23.739251 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:23.759422 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97b6b90-6d68-41cc-882b-1a416081ede9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:23.760361 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97b6b90-6d68-41cc-882b-1a416081ede9 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:23.760786 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97b6b90-6d68-41cc-882b-1a416081ede9 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:23.761223 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97b6b90-6d68-41cc-882b-1a416081ede9 None admin] PATH_INFO: `/v3/domains` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:23.762037 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97b6b90-6d68-41cc-882b-1a416081ede9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:33:23.762476 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97b6b90-6d68-41cc-882b-1a416081ede9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:23.764004 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97b6b90-6d68-41cc-882b-1a416081ede9 None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:23.777011 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 248/494] 10.222.0.26 () {56 vars in 1109 bytes} [Wed Aug 24 05:33:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:33:23.778232 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c78697-5995-48ad-87c4-2a5b71aa46c6 None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:23.778522 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c78697-5995-48ad-87c4-2a5b71aa46c6 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:23.778789 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c78697-5995-48ad-87c4-2a5b71aa46c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:23.789166 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fd8de3-d330-4ea4-a666-b7c9784154c4 None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:23.798135 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-48c78697-5995-48ad-87c4-2a5b71aa46c6 None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:33:23.800029 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-48c78697-5995-48ad-87c4-2a5b71aa46c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:33:23.823568 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd4b108-ec98-4ba8-affa-3d8539f38d03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:23.824224 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd4b108-ec98-4ba8-affa-3d8539f38d03 None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:23.824476 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd4b108-ec98-4ba8-affa-3d8539f38d03 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:23.824741 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd4b108-ec98-4ba8-affa-3d8539f38d03 None admin] PATH_INFO: `/v3/domains` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:23.825380 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd4b108-ec98-4ba8-affa-3d8539f38d03 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:33:23.825676 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd4b108-ec98-4ba8-affa-3d8539f38d03 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:23.827077 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd4b108-ec98-4ba8-affa-3d8539f38d03 None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:23.839000 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 247/495] 10.222.0.26 () {56 vars in 1109 bytes} [Wed Aug 24 05:33:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:33:23.839799 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd4b108-ec98-4ba8-affa-3d8539f38d03 None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:23.858888 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:23.881442 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 249/496] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 24 05:33:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 05:33:23.882259 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c78697-5995-48ad-87c4-2a5b71aa46c6 None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:23.951573 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd4b108-ec98-4ba8-affa-3d8539f38d03 None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:23.978693 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:23.991356 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80632b3-7745-470e-86c5-e80d8085ce0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:23.992330 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80632b3-7745-470e-86c5-e80d8085ce0b None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:23.992832 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80632b3-7745-470e-86c5-e80d8085ce0b None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:23.993310 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80632b3-7745-470e-86c5-e80d8085ce0b None admin] PATH_INFO: `/v3/roles/service` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:24.004458 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80632b3-7745-470e-86c5-e80d8085ce0b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:33:24.009446 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application [None req-a80632b3-7745-470e-86c5-e80d8085ce0b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 05:33:24.009446 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:33:24.009446 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:33:24.009446 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:33:24.009446 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:33:24.009446 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:33:24.009446 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:33:24.009446 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:33:24.009446 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:33:24.009446 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:33:24.009446 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:33:24.009446 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:33:24.009446 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:33:24.009446 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:33:24.009446 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:33:24.009446 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:33:24.010335 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:33:24.010335 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:33:24.010335 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:33:24.010335 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:33:24.010335 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:33:24.010335 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:33:24.010335 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:33:24.010335 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:33:24.010335 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:33:24.010335 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:33:24.010335 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:33:24.010335 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application with Lock( Aug 24 05:33:24.010335 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:33:24.010335 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:33:24.010335 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:33:24.010335 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:33:24.011124 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:33:24.011124 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:33:24.011124 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:33:24.011124 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:33:24.011124 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:33:24.011124 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:33:24.011124 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:33:24.011124 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:33:24.011124 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:33:24.011124 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:33:24.011124 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 05:33:24.011124 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Aug 24 05:33:24.013661 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 248/497] 10.222.0.26 () {56 vars in 1102 bytes} [Wed Aug 24 05:33:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:33:24.014853 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80632b3-7745-470e-86c5-e80d8085ce0b None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:24.021358 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c78697-5995-48ad-87c4-2a5b71aa46c6 None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:24.071740 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f9c3ae-2d68-4ea3-9816-b8ff05082a83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:24.075223 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f9c3ae-2d68-4ea3-9816-b8ff05082a83 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:24.075512 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f9c3ae-2d68-4ea3-9816-b8ff05082a83 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:24.075834 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f9c3ae-2d68-4ea3-9816-b8ff05082a83 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:24.086914 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f9c3ae-2d68-4ea3-9816-b8ff05082a83 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:24.088492 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f9c3ae-2d68-4ea3-9816-b8ff05082a83 None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:24.105794 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application [None req-39f9c3ae-2d68-4ea3-9816-b8ff05082a83 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 05:33:24.105794 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:33:24.105794 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:33:24.105794 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:33:24.105794 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:33:24.105794 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:33:24.105794 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:33:24.105794 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:33:24.105794 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:33:24.105794 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:33:24.105794 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:33:24.105794 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:33:24.105794 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 05:33:24.105794 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 05:33:24.105794 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 05:33:24.105794 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 05:33:24.106738 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:33:24.106738 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:33:24.106738 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 05:33:24.106738 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 05:33:24.106738 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 05:33:24.106738 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 05:33:24.106738 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:33:24.106738 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:33:24.106738 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:33:24.106738 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:33:24.106738 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:33:24.106738 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application with Lock( Aug 24 05:33:24.106738 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:33:24.106738 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:33:24.106738 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:33:24.106738 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:33:24.106738 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:33:24.106738 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:33:24.107607 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:33:24.107607 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:33:24.107607 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 05:33:24.107607 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 05:33:24.107607 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 05:33:24.107607 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 05:33:24.107607 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 05:33:24.107607 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 05:33:24.107607 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 05:33:24.107607 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Aug 24 05:33:24.107607 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 250/498] 10.222.0.26 () {56 vars in 1093 bytes} [Wed Aug 24 05:33:23 2022] GET /identity/v3/users/nova => generated 82 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:33:24.108147 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f9c3ae-2d68-4ea3-9816-b8ff05082a83 None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:24.132179 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80632b3-7745-470e-86c5-e80d8085ce0b None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:24.159862 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:24.177450 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c56e45a-1e4c-499e-a8ee-5785ac85c7c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:24.178110 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c56e45a-1e4c-499e-a8ee-5785ac85c7c6 None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:24.178389 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c56e45a-1e4c-499e-a8ee-5785ac85c7c6 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:24.178654 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c56e45a-1e4c-499e-a8ee-5785ac85c7c6 None admin] PATH_INFO: `/v3/users/glance` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:24.185679 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c56e45a-1e4c-499e-a8ee-5785ac85c7c6 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:24.187138 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c56e45a-1e4c-499e-a8ee-5785ac85c7c6 None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:24.199960 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application [None req-4c56e45a-1e4c-499e-a8ee-5785ac85c7c6 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 24 05:33:24.199960 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:33:24.199960 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:33:24.199960 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:33:24.199960 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:33:24.199960 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:33:24.199960 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:33:24.199960 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:33:24.199960 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:33:24.199960 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:33:24.199960 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:33:24.199960 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:33:24.199960 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 05:33:24.199960 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 05:33:24.199960 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 05:33:24.199960 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 05:33:24.201029 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:33:24.201029 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:33:24.201029 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 05:33:24.201029 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 05:33:24.201029 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 05:33:24.201029 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 05:33:24.201029 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:33:24.201029 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:33:24.201029 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:33:24.201029 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:33:24.201029 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:33:24.201029 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application with Lock( Aug 24 05:33:24.201029 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:33:24.201029 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:33:24.201029 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:33:24.201029 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:33:24.201029 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:33:24.201029 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:33:24.201993 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:33:24.201993 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:33:24.201993 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 05:33:24.201993 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 05:33:24.201993 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 05:33:24.201993 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 05:33:24.201993 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 05:33:24.201993 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 05:33:24.201993 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 24 05:33:24.201993 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Aug 24 05:33:24.201993 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 249/499] 10.222.0.26 () {56 vars in 1099 bytes} [Wed Aug 24 05:33:24 2022] GET /identity/v3/users/glance => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:33:24.201993 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c56e45a-1e4c-499e-a8ee-5785ac85c7c6 None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:24.217687 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f9c3ae-2d68-4ea3-9816-b8ff05082a83 None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:24.249523 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:24.251791 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4eb89c-5fe2-4940-82fc-465c7d93933b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:24.252532 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4eb89c-5fe2-4940-82fc-465c7d93933b None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:24.252810 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4eb89c-5fe2-4940-82fc-465c7d93933b None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:24.253079 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4eb89c-5fe2-4940-82fc-465c7d93933b None admin] PATH_INFO: `/v3/roles` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:24.253760 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4eb89c-5fe2-4940-82fc-465c7d93933b None admin] RBAC: Adding query filter params (name=service) {{(pid=88113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:33:24.254105 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4eb89c-5fe2-4940-82fc-465c7d93933b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:24.255480 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4eb89c-5fe2-4940-82fc-465c7d93933b None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:24.263256 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 251/500] 10.222.0.26 () {56 vars in 1103 bytes} [Wed Aug 24 05:33:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:33:24.264032 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4eb89c-5fe2-4940-82fc-465c7d93933b None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:24.304619 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c56e45a-1e4c-499e-a8ee-5785ac85c7c6 None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:24.337622 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f05c878-acf0-4a8e-b565-1fb164f3c54a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:24.338250 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f05c878-acf0-4a8e-b565-1fb164f3c54a None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:24.338524 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f05c878-acf0-4a8e-b565-1fb164f3c54a None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:24.338792 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f05c878-acf0-4a8e-b565-1fb164f3c54a None admin] PATH_INFO: `/v3/users` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:24.339508 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f05c878-acf0-4a8e-b565-1fb164f3c54a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:33:24.339812 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f05c878-acf0-4a8e-b565-1fb164f3c54a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:24.341244 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f05c878-acf0-4a8e-b565-1fb164f3c54a None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:24.362224 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4eb89c-5fe2-4940-82fc-465c7d93933b None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:24.364448 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:24.378753 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 250/501] 10.222.0.26 () {56 vars in 1133 bytes} [Wed Aug 24 05:33:24 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:33:24.380057 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a5076b-f19d-4c4a-9795-694cab277ed1 None None] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:24.380251 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a5076b-f19d-4c4a-9795-694cab277ed1 None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:24.380522 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a5076b-f19d-4c4a-9795-694cab277ed1 None None] PATH_INFO: `/` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:24.383541 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 251/502] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 24 05:33:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:33:24.383541 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a5076b-f19d-4c4a-9795-694cab277ed1 None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:24.400528 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a789f660-40a6-4533-a487-8db252269d8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:24.401155 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a789f660-40a6-4533-a487-8db252269d8e None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:24.401430 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a789f660-40a6-4533-a487-8db252269d8e None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:24.401702 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a789f660-40a6-4533-a487-8db252269d8e None admin] PATH_INFO: `/v3/roles/service` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:24.412027 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a789f660-40a6-4533-a487-8db252269d8e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:33:24.417083 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application [None req-a789f660-40a6-4533-a487-8db252269d8e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 05:33:24.417083 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:33:24.417083 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:33:24.417083 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:33:24.417083 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:33:24.417083 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:33:24.417083 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:33:24.417083 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:33:24.417083 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:33:24.417083 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:33:24.417083 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:33:24.417083 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:33:24.417083 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:33:24.417083 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:33:24.417083 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:33:24.417083 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:33:24.418128 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:33:24.418128 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:33:24.418128 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:33:24.418128 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:33:24.418128 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:33:24.418128 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:33:24.418128 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:33:24.418128 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:33:24.418128 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:33:24.418128 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:33:24.418128 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:33:24.418128 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application with Lock( Aug 24 05:33:24.418128 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:33:24.418128 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:33:24.418128 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:33:24.418128 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:33:24.418937 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:33:24.418937 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:33:24.418937 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:33:24.418937 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:33:24.418937 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:33:24.418937 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:33:24.418937 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:33:24.418937 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:33:24.418937 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:33:24.418937 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:33:24.418937 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 05:33:24.418937 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Aug 24 05:33:24.418937 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 252/503] 10.222.0.26 () {56 vars in 1102 bytes} [Wed Aug 24 05:33:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:33:24.419657 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a789f660-40a6-4533-a487-8db252269d8e None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:24.491234 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a5076b-f19d-4c4a-9795-694cab277ed1 None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:24.492646 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:24.518295 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a789f660-40a6-4533-a487-8db252269d8e None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:24.527637 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8762d7f-3cab-4376-bb2a-88dc6f1c4d5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:24.528243 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8762d7f-3cab-4376-bb2a-88dc6f1c4d5f None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:24.528519 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8762d7f-3cab-4376-bb2a-88dc6f1c4d5f None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:24.528788 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8762d7f-3cab-4376-bb2a-88dc6f1c4d5f None admin] PATH_INFO: `/v3/users` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:24.529515 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8762d7f-3cab-4376-bb2a-88dc6f1c4d5f None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=88112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:33:24.529821 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8762d7f-3cab-4376-bb2a-88dc6f1c4d5f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:24.531303 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8762d7f-3cab-4376-bb2a-88dc6f1c4d5f None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:24.551067 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 252/504] 10.222.0.26 () {56 vars in 1137 bytes} [Wed Aug 24 05:33:24 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:33:24.551902 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8762d7f-3cab-4376-bb2a-88dc6f1c4d5f None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:24.558350 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825ed403-a020-4e55-910d-1244462e43c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:24.558980 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825ed403-a020-4e55-910d-1244462e43c6 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:24.559256 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825ed403-a020-4e55-910d-1244462e43c6 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:24.559523 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825ed403-a020-4e55-910d-1244462e43c6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:24.570186 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825ed403-a020-4e55-910d-1244462e43c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:24.571629 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825ed403-a020-4e55-910d-1244462e43c6 None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:24.585961 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application [None req-825ed403-a020-4e55-910d-1244462e43c6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:33:24.585961 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:33:24.585961 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:33:24.585961 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:33:24.585961 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:33:24.585961 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:33:24.585961 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:33:24.585961 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:33:24.585961 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:33:24.585961 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:33:24.585961 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:33:24.585961 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:33:24.585961 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 05:33:24.585961 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 05:33:24.585961 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 05:33:24.585961 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 05:33:24.586830 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:33:24.586830 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:33:24.586830 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:33:24.586830 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:33:24.586830 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:33:24.586830 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:33:24.586830 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:33:24.586830 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application with Lock( Aug 24 05:33:24.586830 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:33:24.586830 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:33:24.586830 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:33:24.586830 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:33:24.586830 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:33:24.586830 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:33:24.586830 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:33:24.586830 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:33:24.586830 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 05:33:24.587668 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 05:33:24.587668 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:33:24.587668 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Aug 24 05:33:24.587668 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 253/505] 10.222.0.26 () {56 vars in 1108 bytes} [Wed Aug 24 05:33:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:33:24.588230 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f169ff1-a216-465d-97ab-900311104f17 None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:24.588516 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f169ff1-a216-465d-97ab-900311104f17 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:24.588763 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f169ff1-a216-465d-97ab-900311104f17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:24.606631 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-7f169ff1-a216-465d-97ab-900311104f17 None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:33:24.607807 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-7f169ff1-a216-465d-97ab-900311104f17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:33:24.618234 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:24.654890 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8762d7f-3cab-4376-bb2a-88dc6f1c4d5f None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:24.675593 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 254/506] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 24 05:33:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 05:33:24.676435 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f169ff1-a216-465d-97ab-900311104f17 None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:24.700193 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b4f7ec-6f83-491d-a6af-ffe06c392337 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:24.700912 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b4f7ec-6f83-491d-a6af-ffe06c392337 None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:24.701438 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b4f7ec-6f83-491d-a6af-ffe06c392337 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:24.701438 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b4f7ec-6f83-491d-a6af-ffe06c392337 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:24.730943 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:24.774882 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b4f7ec-6f83-491d-a6af-ffe06c392337 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:24.776260 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b4f7ec-6f83-491d-a6af-ffe06c392337 None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:24.782895 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f169ff1-a216-465d-97ab-900311104f17 None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:24.818668 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15be2509-8655-4c77-9196-fc494589bb76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:24.819274 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15be2509-8655-4c77-9196-fc494589bb76 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:24.819553 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15be2509-8655-4c77-9196-fc494589bb76 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:24.819823 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15be2509-8655-4c77-9196-fc494589bb76 None admin] PATH_INFO: `/v3/roles` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:24.820483 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15be2509-8655-4c77-9196-fc494589bb76 None admin] RBAC: Adding query filter params (name=service) {{(pid=88113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:33:24.820784 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15be2509-8655-4c77-9196-fc494589bb76 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:24.822182 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15be2509-8655-4c77-9196-fc494589bb76 None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:24.833996 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 255/507] 10.222.0.26 () {56 vars in 1103 bytes} [Wed Aug 24 05:33:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:33:24.833996 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15be2509-8655-4c77-9196-fc494589bb76 None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:24.843572 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:24.882912 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 253/508] 10.222.0.26 () {58 vars in 1282 bytes} [Wed Aug 24 05:33:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 05:33:24.883822 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b4f7ec-6f83-491d-a6af-ffe06c392337 None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:24.938285 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15be2509-8655-4c77-9196-fc494589bb76 None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:24.947292 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:24.972799 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6116b95f-da5f-464e-8732-9b202fa45258 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:24.973397 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6116b95f-da5f-464e-8732-9b202fa45258 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:24.973676 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6116b95f-da5f-464e-8732-9b202fa45258 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:24.973965 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6116b95f-da5f-464e-8732-9b202fa45258 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:24.988569 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b4f7ec-6f83-491d-a6af-ffe06c392337 None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:25.022184 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6501c75-0551-43d5-b25d-8cc8bcddff15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:25.022773 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6501c75-0551-43d5-b25d-8cc8bcddff15 None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:25.023048 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6501c75-0551-43d5-b25d-8cc8bcddff15 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:25.023312 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6501c75-0551-43d5-b25d-8cc8bcddff15 None admin] PATH_INFO: `/v3/domains` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:25.023937 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6501c75-0551-43d5-b25d-8cc8bcddff15 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:33:25.024232 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6501c75-0551-43d5-b25d-8cc8bcddff15 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:25.025644 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6501c75-0551-43d5-b25d-8cc8bcddff15 None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:25.036341 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 254/509] 10.222.0.26 () {56 vars in 1109 bytes} [Wed Aug 24 05:33:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:33:25.037112 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6501c75-0551-43d5-b25d-8cc8bcddff15 None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:25.041131 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6116b95f-da5f-464e-8732-9b202fa45258 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:25.042629 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6116b95f-da5f-464e-8732-9b202fa45258 None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:25.052681 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:25.136778 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6501c75-0551-43d5-b25d-8cc8bcddff15 None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:25.141968 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 256/510] 10.222.0.26 () {58 vars in 1282 bytes} [Wed Aug 24 05:33:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 05:33:25.146550 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6116b95f-da5f-464e-8732-9b202fa45258 None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:25.155755 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:25.170405 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743b7e82-4a72-4c5b-906e-8d6931969279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:25.171026 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743b7e82-4a72-4c5b-906e-8d6931969279 None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:25.171302 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743b7e82-4a72-4c5b-906e-8d6931969279 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:25.171571 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743b7e82-4a72-4c5b-906e-8d6931969279 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:25.183069 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743b7e82-4a72-4c5b-906e-8d6931969279 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:25.184535 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743b7e82-4a72-4c5b-906e-8d6931969279 None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:25.198893 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application [None req-743b7e82-4a72-4c5b-906e-8d6931969279 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:33:25.198893 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:33:25.198893 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:33:25.198893 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:33:25.198893 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:33:25.198893 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:33:25.198893 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:33:25.198893 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:33:25.198893 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:33:25.198893 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:33:25.198893 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:33:25.198893 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:33:25.198893 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 05:33:25.198893 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 05:33:25.198893 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 05:33:25.198893 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 05:33:25.199912 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:33:25.199912 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:33:25.199912 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:33:25.199912 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:33:25.199912 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:33:25.199912 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:33:25.199912 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:33:25.199912 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application with Lock( Aug 24 05:33:25.199912 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:33:25.199912 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:33:25.199912 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:33:25.199912 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:33:25.199912 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:33:25.199912 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:33:25.199912 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:33:25.199912 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:33:25.199912 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 05:33:25.200769 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 05:33:25.200769 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:33:25.200769 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Aug 24 05:33:25.200769 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 255/511] 10.222.0.26 () {56 vars in 1108 bytes} [Wed Aug 24 05:33:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:33:25.200769 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743b7e82-4a72-4c5b-906e-8d6931969279 None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:25.246668 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6116b95f-da5f-464e-8732-9b202fa45258 None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:25.256366 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:25.280937 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42680ea-d0d1-482b-874a-877d7ab93c64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:25.281483 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42680ea-d0d1-482b-874a-877d7ab93c64 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:25.281765 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42680ea-d0d1-482b-874a-877d7ab93c64 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:25.282054 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42680ea-d0d1-482b-874a-877d7ab93c64 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:25.291599 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42680ea-d0d1-482b-874a-877d7ab93c64 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:25.293082 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42680ea-d0d1-482b-874a-877d7ab93c64 None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:25.297198 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743b7e82-4a72-4c5b-906e-8d6931969279 None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:25.307393 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application [None req-b42680ea-d0d1-482b-874a-877d7ab93c64 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:33:25.307393 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:33:25.307393 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:33:25.307393 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:33:25.307393 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:33:25.307393 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:33:25.307393 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:33:25.307393 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:33:25.307393 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:33:25.307393 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:33:25.307393 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:33:25.307393 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:33:25.307393 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 05:33:25.307393 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 05:33:25.307393 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 05:33:25.307393 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 05:33:25.308449 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:33:25.308449 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:33:25.308449 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:33:25.308449 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:33:25.308449 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:33:25.308449 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:33:25.308449 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:33:25.308449 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application with Lock( Aug 24 05:33:25.308449 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:33:25.308449 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:33:25.308449 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:33:25.308449 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:33:25.308449 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:33:25.308449 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:33:25.308449 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:33:25.308449 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:33:25.308449 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 05:33:25.309284 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 05:33:25.309284 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:33:25.309284 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Aug 24 05:33:25.309284 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 257/512] 10.222.0.26 () {56 vars in 1108 bytes} [Wed Aug 24 05:33:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:33:25.309827 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42680ea-d0d1-482b-874a-877d7ab93c64 None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:25.333469 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9bf279-38f8-4c30-a68f-3ae25898a973 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:25.334117 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9bf279-38f8-4c30-a68f-3ae25898a973 None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:25.334391 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9bf279-38f8-4c30-a68f-3ae25898a973 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:25.334655 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9bf279-38f8-4c30-a68f-3ae25898a973 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:25.344980 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9bf279-38f8-4c30-a68f-3ae25898a973 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:25.346491 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9bf279-38f8-4c30-a68f-3ae25898a973 None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:25.359944 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application [None req-1e9bf279-38f8-4c30-a68f-3ae25898a973 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:33:25.359944 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:33:25.359944 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:33:25.359944 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:33:25.359944 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:33:25.359944 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:33:25.359944 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:33:25.359944 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:33:25.359944 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:33:25.359944 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:33:25.359944 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:33:25.359944 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:33:25.359944 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 05:33:25.359944 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 05:33:25.359944 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 05:33:25.359944 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 05:33:25.361502 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:33:25.361502 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:33:25.361502 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:33:25.361502 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:33:25.361502 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:33:25.361502 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:33:25.361502 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:33:25.361502 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application with Lock( Aug 24 05:33:25.361502 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:33:25.361502 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:33:25.361502 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:33:25.361502 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:33:25.361502 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:33:25.361502 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:33:25.361502 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:33:25.361502 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:33:25.361502 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 05:33:25.362507 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 05:33:25.362507 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:33:25.362507 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Aug 24 05:33:25.362507 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 256/513] 10.222.0.26 () {56 vars in 1108 bytes} [Wed Aug 24 05:33:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:33:25.363942 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9bf279-38f8-4c30-a68f-3ae25898a973 None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:25.388249 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:25.412462 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42680ea-d0d1-482b-874a-877d7ab93c64 None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:25.446344 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff01df00-51ec-406e-8730-077a992701ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:25.446958 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff01df00-51ec-406e-8730-077a992701ac None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:25.447231 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff01df00-51ec-406e-8730-077a992701ac None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:25.447499 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff01df00-51ec-406e-8730-077a992701ac None admin] PATH_INFO: `/v3/users/cinder` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:25.457697 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff01df00-51ec-406e-8730-077a992701ac None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:25.459176 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff01df00-51ec-406e-8730-077a992701ac None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:25.460743 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9bf279-38f8-4c30-a68f-3ae25898a973 None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:25.469961 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application [None req-ff01df00-51ec-406e-8730-077a992701ac None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 05:33:25.469961 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:33:25.469961 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:33:25.469961 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:33:25.469961 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:33:25.469961 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:33:25.469961 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:33:25.469961 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:33:25.469961 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:33:25.469961 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:33:25.469961 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:33:25.469961 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:33:25.469961 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 05:33:25.469961 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 05:33:25.469961 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 05:33:25.469961 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 05:33:25.471635 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:33:25.471635 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:33:25.471635 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 05:33:25.471635 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 05:33:25.471635 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 05:33:25.471635 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 05:33:25.471635 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:33:25.471635 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:33:25.471635 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:33:25.471635 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:33:25.471635 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:33:25.471635 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application with Lock( Aug 24 05:33:25.471635 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:33:25.471635 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:33:25.471635 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:33:25.471635 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:33:25.471635 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:33:25.471635 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:33:25.472545 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:33:25.472545 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:33:25.472545 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 05:33:25.472545 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 05:33:25.472545 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 05:33:25.472545 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 05:33:25.472545 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 05:33:25.472545 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 05:33:25.472545 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 05:33:25.472545 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Aug 24 05:33:25.472545 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 258/514] 10.222.0.26 () {56 vars in 1099 bytes} [Wed Aug 24 05:33:25 2022] GET /identity/v3/users/cinder => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:33:25.472545 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff01df00-51ec-406e-8730-077a992701ac None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:25.497352 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dadd65e-e588-4af6-af89-80979a0b13d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:25.497847 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:25.498665 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dadd65e-e588-4af6-af89-80979a0b13d2 None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:25.498918 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dadd65e-e588-4af6-af89-80979a0b13d2 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:25.499184 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dadd65e-e588-4af6-af89-80979a0b13d2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:25.510431 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dadd65e-e588-4af6-af89-80979a0b13d2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:25.511871 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dadd65e-e588-4af6-af89-80979a0b13d2 None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:25.525677 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application [None req-7dadd65e-e588-4af6-af89-80979a0b13d2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:33:25.525677 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:33:25.525677 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:33:25.525677 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:33:25.525677 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:33:25.525677 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:33:25.525677 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:33:25.525677 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:33:25.525677 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:33:25.525677 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:33:25.525677 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:33:25.525677 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:33:25.525677 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 05:33:25.525677 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 05:33:25.525677 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 05:33:25.525677 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 05:33:25.526750 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:33:25.526750 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:33:25.526750 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:33:25.526750 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:33:25.526750 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:33:25.526750 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:33:25.526750 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:33:25.526750 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application with Lock( Aug 24 05:33:25.526750 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:33:25.526750 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:33:25.526750 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:33:25.526750 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:33:25.526750 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:33:25.526750 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:33:25.526750 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:33:25.526750 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:33:25.526750 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 05:33:25.527582 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 05:33:25.527582 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:33:25.527582 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Aug 24 05:33:25.527582 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 257/515] 10.222.0.26 () {56 vars in 1108 bytes} [Wed Aug 24 05:33:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:33:25.527582 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dadd65e-e588-4af6-af89-80979a0b13d2 None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:25.576623 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff01df00-51ec-406e-8730-077a992701ac None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:25.603886 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:25.609789 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340f4414-0194-4c5d-a6bb-ee97df029332 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:25.610422 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340f4414-0194-4c5d-a6bb-ee97df029332 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:25.610700 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340f4414-0194-4c5d-a6bb-ee97df029332 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:25.611552 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340f4414-0194-4c5d-a6bb-ee97df029332 None admin] PATH_INFO: `/v3/domains` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:25.612192 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340f4414-0194-4c5d-a6bb-ee97df029332 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:33:25.612669 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340f4414-0194-4c5d-a6bb-ee97df029332 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:25.613842 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340f4414-0194-4c5d-a6bb-ee97df029332 None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:25.625427 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 259/516] 10.222.0.26 () {56 vars in 1109 bytes} [Wed Aug 24 05:33:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:33:25.626447 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340f4414-0194-4c5d-a6bb-ee97df029332 None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:25.626713 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dadd65e-e588-4af6-af89-80979a0b13d2 None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:25.660021 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546f7fbc-77d9-41f2-a716-f5a248cc1e0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:25.660623 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546f7fbc-77d9-41f2-a716-f5a248cc1e0c None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:25.660902 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546f7fbc-77d9-41f2-a716-f5a248cc1e0c None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:25.661190 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546f7fbc-77d9-41f2-a716-f5a248cc1e0c None admin] PATH_INFO: `/v3/domains` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:25.661815 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546f7fbc-77d9-41f2-a716-f5a248cc1e0c None admin] RBAC: Adding query filter params (name=Default) {{(pid=88112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:33:25.662152 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546f7fbc-77d9-41f2-a716-f5a248cc1e0c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:25.663516 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546f7fbc-77d9-41f2-a716-f5a248cc1e0c None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:25.675344 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 258/517] 10.222.0.26 () {56 vars in 1109 bytes} [Wed Aug 24 05:33:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:33:25.676127 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546f7fbc-77d9-41f2-a716-f5a248cc1e0c None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:25.710153 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:25.730049 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340f4414-0194-4c5d-a6bb-ee97df029332 None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:25.762905 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ef2f1d-0ef1-410f-bdef-792c270ced80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:25.763493 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ef2f1d-0ef1-410f-bdef-792c270ced80 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:25.763767 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ef2f1d-0ef1-410f-bdef-792c270ced80 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:25.764041 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ef2f1d-0ef1-410f-bdef-792c270ced80 None admin] PATH_INFO: `/v3/domains` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:25.764667 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ef2f1d-0ef1-410f-bdef-792c270ced80 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:33:25.764967 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ef2f1d-0ef1-410f-bdef-792c270ced80 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:25.766373 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ef2f1d-0ef1-410f-bdef-792c270ced80 None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:25.773225 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546f7fbc-77d9-41f2-a716-f5a248cc1e0c None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:25.777367 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 260/518] 10.222.0.26 () {56 vars in 1109 bytes} [Wed Aug 24 05:33:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:33:25.778188 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ef2f1d-0ef1-410f-bdef-792c270ced80 None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:25.809493 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be5dbbd-c55f-400c-9219-31a168811ff7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:25.810056 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be5dbbd-c55f-400c-9219-31a168811ff7 None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:25.810336 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be5dbbd-c55f-400c-9219-31a168811ff7 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:25.810606 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be5dbbd-c55f-400c-9219-31a168811ff7 None admin] PATH_INFO: `/v3/users` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:25.811328 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be5dbbd-c55f-400c-9219-31a168811ff7 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=88112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:33:25.811738 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be5dbbd-c55f-400c-9219-31a168811ff7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:25.813325 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be5dbbd-c55f-400c-9219-31a168811ff7 None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:25.815844 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:25.832440 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 259/519] 10.222.0.26 () {56 vars in 1137 bytes} [Wed Aug 24 05:33:25 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:33:25.833243 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be5dbbd-c55f-400c-9219-31a168811ff7 None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:25.880765 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ef2f1d-0ef1-410f-bdef-792c270ced80 None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:25.914584 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d8f6e0-6f65-44d5-b473-b11c74c029a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:25.915183 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d8f6e0-6f65-44d5-b473-b11c74c029a4 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:25.915464 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d8f6e0-6f65-44d5-b473-b11c74c029a4 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:25.915729 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d8f6e0-6f65-44d5-b473-b11c74c029a4 None admin] PATH_INFO: `/v3/domains` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:25.916363 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d8f6e0-6f65-44d5-b473-b11c74c029a4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:33:25.916660 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d8f6e0-6f65-44d5-b473-b11c74c029a4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:25.918039 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d8f6e0-6f65-44d5-b473-b11c74c029a4 None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:25.926765 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:25.929919 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be5dbbd-c55f-400c-9219-31a168811ff7 None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:25.930501 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 261/520] 10.222.0.26 () {56 vars in 1109 bytes} [Wed Aug 24 05:33:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:33:25.931330 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d8f6e0-6f65-44d5-b473-b11c74c029a4 None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:25.968896 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44abf78-7c73-40c1-aba2-0fc1adc8fdde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:25.969523 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44abf78-7c73-40c1-aba2-0fc1adc8fdde None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:25.969802 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44abf78-7c73-40c1-aba2-0fc1adc8fdde None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:25.970107 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44abf78-7c73-40c1-aba2-0fc1adc8fdde None admin] PATH_INFO: `/v3/users/neutron` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:25.977921 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44abf78-7c73-40c1-aba2-0fc1adc8fdde None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:25.979387 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44abf78-7c73-40c1-aba2-0fc1adc8fdde None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:25.990950 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application [None req-b44abf78-7c73-40c1-aba2-0fc1adc8fdde None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 24 05:33:25.990950 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:33:25.990950 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:33:25.990950 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:33:25.990950 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:33:25.990950 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:33:25.990950 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:33:25.990950 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:33:25.990950 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:33:25.990950 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:33:25.990950 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:33:25.990950 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:33:25.990950 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 05:33:25.990950 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 05:33:25.990950 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 05:33:25.990950 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 05:33:25.991906 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:33:25.991906 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:33:25.991906 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 05:33:25.991906 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 05:33:25.991906 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 05:33:25.991906 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 05:33:25.991906 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:33:25.991906 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:33:25.991906 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:33:25.991906 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:33:25.991906 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:33:25.991906 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application with Lock( Aug 24 05:33:25.991906 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:33:25.991906 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:33:25.991906 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:33:25.991906 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:33:25.991906 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:33:25.991906 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:33:25.997564 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:33:25.997564 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:33:25.997564 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 05:33:25.997564 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 05:33:25.997564 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 05:33:25.997564 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 05:33:25.997564 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 05:33:25.997564 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 05:33:25.997564 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 24 05:33:25.997564 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Aug 24 05:33:25.997564 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 260/521] 10.222.0.26 () {56 vars in 1102 bytes} [Wed Aug 24 05:33:25 2022] GET /identity/v3/users/neutron => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:33:25.997564 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44abf78-7c73-40c1-aba2-0fc1adc8fdde None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:26.035617 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d8f6e0-6f65-44d5-b473-b11c74c029a4 None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:26.046632 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:26.070012 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0502b47-8811-4ba9-a32b-d150328effbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:26.070582 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0502b47-8811-4ba9-a32b-d150328effbc None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:26.070860 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0502b47-8811-4ba9-a32b-d150328effbc None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:26.071130 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0502b47-8811-4ba9-a32b-d150328effbc None admin] PATH_INFO: `/v3/projects/service` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:26.077635 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0502b47-8811-4ba9-a32b-d150328effbc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:26.079137 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0502b47-8811-4ba9-a32b-d150328effbc None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:26.090920 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application [None req-c0502b47-8811-4ba9-a32b-d150328effbc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 05:33:26.090920 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:33:26.090920 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:33:26.090920 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:33:26.090920 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:33:26.090920 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:33:26.090920 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:33:26.090920 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:33:26.090920 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:33:26.090920 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:33:26.090920 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:33:26.090920 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:33:26.090920 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 05:33:26.090920 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 05:33:26.090920 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 05:33:26.091935 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 05:33:26.091935 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:33:26.091935 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:33:26.091935 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:33:26.091935 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:33:26.091935 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:33:26.091935 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:33:26.091935 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:33:26.091935 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application with Lock( Aug 24 05:33:26.091935 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:33:26.091935 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:33:26.091935 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:33:26.091935 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:33:26.091935 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:33:26.091935 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:33:26.091935 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:33:26.091935 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:33:26.092801 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 05:33:26.092801 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 05:33:26.092801 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 05:33:26.092801 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 05:33:26.092801 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 05:33:26.092801 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 05:33:26.092801 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 05:33:26.092801 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Aug 24 05:33:26.093232 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44abf78-7c73-40c1-aba2-0fc1adc8fdde None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:26.093312 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 262/522] 10.222.0.26 () {56 vars in 1111 bytes} [Wed Aug 24 05:33:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:33:26.093312 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0502b47-8811-4ba9-a32b-d150328effbc None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:26.125937 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6944eb81-8d75-4786-8417-d75c14b0ec70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:26.126569 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6944eb81-8d75-4786-8417-d75c14b0ec70 None admin] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:26.126850 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6944eb81-8d75-4786-8417-d75c14b0ec70 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:26.127120 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6944eb81-8d75-4786-8417-d75c14b0ec70 None admin] PATH_INFO: `/v3/users` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:26.127754 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6944eb81-8d75-4786-8417-d75c14b0ec70 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:26.129213 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6944eb81-8d75-4786-8417-d75c14b0ec70 None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:26.150606 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 261/523] 10.222.0.26 () {60 vars in 1132 bytes} [Wed Aug 24 05:33:25 2022] POST /identity/v3/users => generated 247 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:33:26.151400 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6944eb81-8d75-4786-8417-d75c14b0ec70 None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:26.161663 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:26.211447 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0502b47-8811-4ba9-a32b-d150328effbc None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:26.251950 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efab7f6-4342-4c07-9dc9-2f39b116df81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:26.252571 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efab7f6-4342-4c07-9dc9-2f39b116df81 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:26.252852 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efab7f6-4342-4c07-9dc9-2f39b116df81 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:26.253125 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efab7f6-4342-4c07-9dc9-2f39b116df81 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:26.276950 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6944eb81-8d75-4786-8417-d75c14b0ec70 None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:26.290077 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:26.328866 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7221191-1509-4a24-a5c3-47f9b7aeba64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:26.329766 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7221191-1509-4a24-a5c3-47f9b7aeba64 None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:26.330339 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7221191-1509-4a24-a5c3-47f9b7aeba64 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:26.330339 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7221191-1509-4a24-a5c3-47f9b7aeba64 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:26.337382 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7221191-1509-4a24-a5c3-47f9b7aeba64 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:26.338941 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7221191-1509-4a24-a5c3-47f9b7aeba64 None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:26.344307 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efab7f6-4342-4c07-9dc9-2f39b116df81 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:26.346332 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efab7f6-4342-4c07-9dc9-2f39b116df81 None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:26.351831 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application [None req-c7221191-1509-4a24-a5c3-47f9b7aeba64 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 05:33:26.351831 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:33:26.351831 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:33:26.351831 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:33:26.351831 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:33:26.351831 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:33:26.351831 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:33:26.351831 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:33:26.351831 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:33:26.351831 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:33:26.351831 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:33:26.351831 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:33:26.351831 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 05:33:26.351831 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 05:33:26.351831 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 05:33:26.352686 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 05:33:26.352686 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:33:26.352686 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:33:26.352686 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:33:26.352686 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:33:26.352686 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:33:26.352686 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:33:26.352686 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:33:26.352686 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application with Lock( Aug 24 05:33:26.352686 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:33:26.352686 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:33:26.352686 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:33:26.352686 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:33:26.352686 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:33:26.352686 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:33:26.352686 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:33:26.352686 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:33:26.353940 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 05:33:26.353940 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 05:33:26.353940 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 05:33:26.353940 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 05:33:26.353940 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 05:33:26.353940 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 05:33:26.353940 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 05:33:26.353940 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Aug 24 05:33:26.353940 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 262/524] 10.222.0.26 () {56 vars in 1111 bytes} [Wed Aug 24 05:33:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:33:26.358200 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7221191-1509-4a24-a5c3-47f9b7aeba64 None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:26.414814 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:26.459496 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 263/525] 10.222.0.26 () {58 vars in 1282 bytes} [Wed Aug 24 05:33:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 05:33:26.460462 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efab7f6-4342-4c07-9dc9-2f39b116df81 None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:26.469592 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7221191-1509-4a24-a5c3-47f9b7aeba64 None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:26.506356 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e56ed6-78d1-431b-beef-2c65a518f860 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:26.507072 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e56ed6-78d1-431b-beef-2c65a518f860 None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:26.507358 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e56ed6-78d1-431b-beef-2c65a518f860 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:26.507633 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e56ed6-78d1-431b-beef-2c65a518f860 None admin] PATH_INFO: `/v3/users` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:26.508376 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e56ed6-78d1-431b-beef-2c65a518f860 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=88112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:33:26.508744 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e56ed6-78d1-431b-beef-2c65a518f860 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:26.510204 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e56ed6-78d1-431b-beef-2c65a518f860 None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:26.528703 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 263/526] 10.222.0.26 () {56 vars in 1139 bytes} [Wed Aug 24 05:33:26 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:33:26.529530 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e56ed6-78d1-431b-beef-2c65a518f860 None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:26.563308 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:26.577632 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efab7f6-4342-4c07-9dc9-2f39b116df81 None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:26.616206 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2160a7-571a-4acc-aea4-a79b905284fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:26.616736 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2160a7-571a-4acc-aea4-a79b905284fe None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:26.617006 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2160a7-571a-4acc-aea4-a79b905284fe None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:26.617275 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2160a7-571a-4acc-aea4-a79b905284fe None admin] PATH_INFO: `/v3/projects` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:26.617985 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2160a7-571a-4acc-aea4-a79b905284fe None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:33:26.618299 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2160a7-571a-4acc-aea4-a79b905284fe None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:26.619842 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2160a7-571a-4acc-aea4-a79b905284fe None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:26.637586 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 264/527] 10.222.0.26 () {56 vars in 1148 bytes} [Wed Aug 24 05:33:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:33:26.638512 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2160a7-571a-4acc-aea4-a79b905284fe None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:26.645450 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e56ed6-78d1-431b-beef-2c65a518f860 None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:26.660317 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:26.684261 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d03b38-0dfd-4256-835c-2dc92946d25f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:26.685203 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d03b38-0dfd-4256-835c-2dc92946d25f None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:26.685580 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d03b38-0dfd-4256-835c-2dc92946d25f None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:26.685849 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d03b38-0dfd-4256-835c-2dc92946d25f None admin] PATH_INFO: `/v3/projects` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:26.686567 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d03b38-0dfd-4256-835c-2dc92946d25f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:33:26.686870 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d03b38-0dfd-4256-835c-2dc92946d25f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:26.688281 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d03b38-0dfd-4256-835c-2dc92946d25f None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:26.712208 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 264/528] 10.222.0.26 () {56 vars in 1148 bytes} [Wed Aug 24 05:33:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:33:26.712208 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d03b38-0dfd-4256-835c-2dc92946d25f None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:26.745131 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2160a7-571a-4acc-aea4-a79b905284fe None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:26.779356 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4c69f3-b2d2-44ef-a583-32b61a4ceb9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:26.779977 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4c69f3-b2d2-44ef-a583-32b61a4ceb9d None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:26.780256 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4c69f3-b2d2-44ef-a583-32b61a4ceb9d None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:26.780526 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4c69f3-b2d2-44ef-a583-32b61a4ceb9d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:26.790609 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4c69f3-b2d2-44ef-a583-32b61a4ceb9d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:26.792064 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4c69f3-b2d2-44ef-a583-32b61a4ceb9d None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:26.801136 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:26.807933 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application [None req-ea4c69f3-b2d2-44ef-a583-32b61a4ceb9d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:33:26.807933 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:33:26.807933 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:33:26.807933 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:33:26.807933 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:33:26.807933 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:33:26.807933 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:33:26.807933 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:33:26.807933 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:33:26.807933 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:33:26.807933 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:33:26.807933 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:33:26.807933 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 05:33:26.807933 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 05:33:26.807933 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 05:33:26.807933 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 05:33:26.808852 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:33:26.808852 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:33:26.808852 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:33:26.808852 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:33:26.808852 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:33:26.808852 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:33:26.808852 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:33:26.808852 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application with Lock( Aug 24 05:33:26.808852 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:33:26.808852 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:33:26.808852 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:33:26.808852 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:33:26.808852 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:33:26.808852 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:33:26.808852 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:33:26.808852 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:33:26.808852 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 05:33:26.809692 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 05:33:26.809692 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:33:26.809692 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Aug 24 05:33:26.809692 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 265/529] 10.222.0.26 () {56 vars in 1108 bytes} [Wed Aug 24 05:33:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:33:26.809919 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4c69f3-b2d2-44ef-a583-32b61a4ceb9d None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:26.819163 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d03b38-0dfd-4256-835c-2dc92946d25f None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:26.853033 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db667dbc-5c3d-40f6-a7c7-6b1e6cb22549 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:26.853935 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db667dbc-5c3d-40f6-a7c7-6b1e6cb22549 None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:26.854263 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db667dbc-5c3d-40f6-a7c7-6b1e6cb22549 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:26.854543 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db667dbc-5c3d-40f6-a7c7-6b1e6cb22549 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:26.883871 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:26.917200 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4c69f3-b2d2-44ef-a583-32b61a4ceb9d None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:26.924970 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db667dbc-5c3d-40f6-a7c7-6b1e6cb22549 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:26.926451 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db667dbc-5c3d-40f6-a7c7-6b1e6cb22549 None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:26.953134 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c903f559-8a72-4046-ae99-4cee8b402878 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:26.953734 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c903f559-8a72-4046-ae99-4cee8b402878 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:26.954049 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c903f559-8a72-4046-ae99-4cee8b402878 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:26.954321 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c903f559-8a72-4046-ae99-4cee8b402878 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:26.955072 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c903f559-8a72-4046-ae99-4cee8b402878 None admin] RBAC: Adding query filter params (role.id=59fa3749ca7f47e2ba1127945e13336c, scope.project.id=ded4fe81d4dc43188dd84e53025ee783, user.id=7b633e1aec6c4269bce13aa9c89e911a) {{(pid=88113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:33:26.955377 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c903f559-8a72-4046-ae99-4cee8b402878 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:26.956803 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c903f559-8a72-4046-ae99-4cee8b402878 None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:26.962222 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 266/530] 10.222.0.26 () {56 vars in 1374 bytes} [Wed Aug 24 05:33:26 2022] GET /identity/v3/role_assignments?user.id=7b633e1aec6c4269bce13aa9c89e911a&scope.project.id=ded4fe81d4dc43188dd84e53025ee783&role.id=59fa3749ca7f47e2ba1127945e13336c => generated 259 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:33:26.970872 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c903f559-8a72-4046-ae99-4cee8b402878 None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:27.034110 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:27.054613 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 265/531] 10.222.0.26 () {58 vars in 1282 bytes} [Wed Aug 24 05:33:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 05:33:27.055510 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db667dbc-5c3d-40f6-a7c7-6b1e6cb22549 None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:27.090289 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c903f559-8a72-4046-ae99-4cee8b402878 None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:27.137334 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0de65eb-2853-4280-93c9-ce0cd048b068 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:27.138253 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0de65eb-2853-4280-93c9-ce0cd048b068 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:27.138730 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0de65eb-2853-4280-93c9-ce0cd048b068 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:27.139185 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0de65eb-2853-4280-93c9-ce0cd048b068 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:27.140084 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0de65eb-2853-4280-93c9-ce0cd048b068 None admin] RBAC: Adding query filter params (role.id=59fa3749ca7f47e2ba1127945e13336c, scope.project.id=ded4fe81d4dc43188dd84e53025ee783, user.id=7f856958add7474a989325cea7b1b224) {{(pid=88113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:33:27.140562 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0de65eb-2853-4280-93c9-ce0cd048b068 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:27.142863 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0de65eb-2853-4280-93c9-ce0cd048b068 None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:27.146091 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:27.156276 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 267/532] 10.222.0.26 () {56 vars in 1374 bytes} [Wed Aug 24 05:33:26 2022] GET /identity/v3/role_assignments?user.id=7f856958add7474a989325cea7b1b224&scope.project.id=ded4fe81d4dc43188dd84e53025ee783&role.id=59fa3749ca7f47e2ba1127945e13336c => generated 259 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:33:27.157347 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0de65eb-2853-4280-93c9-ce0cd048b068 None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:27.187004 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db667dbc-5c3d-40f6-a7c7-6b1e6cb22549 None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:27.231368 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633bd1ab-b005-4958-b591-f270969bee14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:27.231997 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633bd1ab-b005-4958-b591-f270969bee14 None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:27.232276 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633bd1ab-b005-4958-b591-f270969bee14 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:27.232546 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633bd1ab-b005-4958-b591-f270969bee14 None admin] PATH_INFO: `/v3/domains` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:27.233222 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633bd1ab-b005-4958-b591-f270969bee14 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:33:27.233526 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633bd1ab-b005-4958-b591-f270969bee14 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:27.235004 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633bd1ab-b005-4958-b591-f270969bee14 None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:27.248868 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 266/533] 10.222.0.26 () {56 vars in 1109 bytes} [Wed Aug 24 05:33:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:33:27.255516 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633bd1ab-b005-4958-b591-f270969bee14 None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:27.324260 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:27.377128 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633bd1ab-b005-4958-b591-f270969bee14 None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:27.418794 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0de65eb-2853-4280-93c9-ce0cd048b068 None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:27.420351 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad64d62-e279-4cd1-861b-3d9f6b3e13eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:27.421879 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad64d62-e279-4cd1-861b-3d9f6b3e13eb None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:27.422292 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad64d62-e279-4cd1-861b-3d9f6b3e13eb None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:27.422668 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad64d62-e279-4cd1-861b-3d9f6b3e13eb None admin] PATH_INFO: `/v3/projects/service` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:27.434198 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad64d62-e279-4cd1-861b-3d9f6b3e13eb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:27.437444 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad64d62-e279-4cd1-861b-3d9f6b3e13eb None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:27.464133 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application [None req-cad64d62-e279-4cd1-861b-3d9f6b3e13eb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 05:33:27.464133 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:33:27.464133 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:33:27.464133 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:33:27.464133 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:33:27.464133 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:33:27.464133 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:33:27.464133 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:33:27.464133 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:33:27.464133 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:33:27.464133 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:33:27.464133 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:33:27.464133 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 05:33:27.464133 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 05:33:27.464133 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 05:33:27.465214 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 05:33:27.465214 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:33:27.465214 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:33:27.465214 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:33:27.465214 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:33:27.465214 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:33:27.465214 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:33:27.465214 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:33:27.465214 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application with Lock( Aug 24 05:33:27.465214 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:33:27.465214 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:33:27.465214 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:33:27.465214 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:33:27.465214 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:33:27.465214 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:33:27.465214 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:33:27.465214 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:33:27.466276 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 05:33:27.466276 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 05:33:27.466276 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 05:33:27.466276 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 05:33:27.466276 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 05:33:27.466276 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 05:33:27.466276 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 05:33:27.466276 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Aug 24 05:33:27.466276 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 267/534] 10.222.0.26 () {56 vars in 1111 bytes} [Wed Aug 24 05:33:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:33:27.471894 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad64d62-e279-4cd1-861b-3d9f6b3e13eb None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:27.485750 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ef1674-1282-480d-81cf-64e4a71c39c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:27.487154 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ef1674-1282-480d-81cf-64e4a71c39c6 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:27.487529 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ef1674-1282-480d-81cf-64e4a71c39c6 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:27.487933 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ef1674-1282-480d-81cf-64e4a71c39c6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:27.509171 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ef1674-1282-480d-81cf-64e4a71c39c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:27.510686 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ef1674-1282-480d-81cf-64e4a71c39c6 None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:27.539776 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application [None req-16ef1674-1282-480d-81cf-64e4a71c39c6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:33:27.539776 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:33:27.539776 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:33:27.539776 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:33:27.539776 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:33:27.539776 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:33:27.539776 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:33:27.539776 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:33:27.539776 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:33:27.539776 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:33:27.539776 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:33:27.539776 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:33:27.539776 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 05:33:27.539776 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 05:33:27.539776 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 05:33:27.539776 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 05:33:27.540956 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:33:27.540956 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:33:27.540956 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:33:27.540956 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:33:27.540956 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:33:27.540956 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:33:27.540956 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:33:27.540956 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application with Lock( Aug 24 05:33:27.540956 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:33:27.540956 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:33:27.540956 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:33:27.540956 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:33:27.540956 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:33:27.540956 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:33:27.540956 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:33:27.540956 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:33:27.540956 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 05:33:27.542056 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 05:33:27.542056 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:33:27.542056 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Aug 24 05:33:27.545624 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 268/535] 10.222.0.26 () {56 vars in 1108 bytes} [Wed Aug 24 05:33:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 387 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:33:27.549843 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ef1674-1282-480d-81cf-64e4a71c39c6 None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:27.647867 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:27.650601 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad64d62-e279-4cd1-861b-3d9f6b3e13eb None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:27.666288 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:27.717881 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ea2f68-214f-494d-8ee8-e551ec2daf32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:27.718521 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ea2f68-214f-494d-8ee8-e551ec2daf32 None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:27.718796 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ea2f68-214f-494d-8ee8-e551ec2daf32 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:27.719064 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ea2f68-214f-494d-8ee8-e551ec2daf32 None admin] PATH_INFO: `/v3/projects` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:27.719760 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ea2f68-214f-494d-8ee8-e551ec2daf32 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:33:27.720062 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ea2f68-214f-494d-8ee8-e551ec2daf32 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:27.722076 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ea2f68-214f-494d-8ee8-e551ec2daf32 None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:27.734887 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 268/536] 10.222.0.26 () {56 vars in 1148 bytes} [Wed Aug 24 05:33:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:33:27.741643 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ea2f68-214f-494d-8ee8-e551ec2daf32 None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:27.749976 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ef1674-1282-480d-81cf-64e4a71c39c6 None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:27.790593 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670b1aaf-dc11-47af-8592-b264d7aa213c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:27.791201 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670b1aaf-dc11-47af-8592-b264d7aa213c None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:27.791477 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670b1aaf-dc11-47af-8592-b264d7aa213c None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:27.791744 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670b1aaf-dc11-47af-8592-b264d7aa213c None admin] PATH_INFO: `/v3/domains` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:27.792386 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670b1aaf-dc11-47af-8592-b264d7aa213c None admin] RBAC: Adding query filter params (name=Default) {{(pid=88113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:33:27.792684 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670b1aaf-dc11-47af-8592-b264d7aa213c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:27.794072 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670b1aaf-dc11-47af-8592-b264d7aa213c None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:27.824915 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 269/537] 10.222.0.26 () {56 vars in 1109 bytes} [Wed Aug 24 05:33:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:33:27.830496 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670b1aaf-dc11-47af-8592-b264d7aa213c None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:27.917636 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ea2f68-214f-494d-8ee8-e551ec2daf32 None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:27.957427 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f3d1e7-6b72-4c3f-bf0e-faacab26feba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:27.958061 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f3d1e7-6b72-4c3f-bf0e-faacab26feba None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:27.958344 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f3d1e7-6b72-4c3f-bf0e-faacab26feba None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:27.960863 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f3d1e7-6b72-4c3f-bf0e-faacab26feba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:27.961605 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f3d1e7-6b72-4c3f-bf0e-faacab26feba None admin] RBAC: Adding query filter params (role.id=59fa3749ca7f47e2ba1127945e13336c, scope.project.id=ded4fe81d4dc43188dd84e53025ee783, user.id=17b450afe795495680fc70f522c83750) {{(pid=88112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:33:27.961916 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f3d1e7-6b72-4c3f-bf0e-faacab26feba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:27.964784 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f3d1e7-6b72-4c3f-bf0e-faacab26feba None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:27.979194 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 269/538] 10.222.0.26 () {56 vars in 1374 bytes} [Wed Aug 24 05:33:27 2022] GET /identity/v3/role_assignments?user.id=17b450afe795495680fc70f522c83750&scope.project.id=ded4fe81d4dc43188dd84e53025ee783&role.id=59fa3749ca7f47e2ba1127945e13336c => generated 259 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:33:28.014453 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670b1aaf-dc11-47af-8592-b264d7aa213c None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:28.038347 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:28.074405 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5815ba-86e4-41c1-ab1b-059d383a2575 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:28.075051 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5815ba-86e4-41c1-ab1b-059d383a2575 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:28.075333 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5815ba-86e4-41c1-ab1b-059d383a2575 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:28.075606 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5815ba-86e4-41c1-ab1b-059d383a2575 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:28.091339 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5815ba-86e4-41c1-ab1b-059d383a2575 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:28.092902 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5815ba-86e4-41c1-ab1b-059d383a2575 None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:28.107496 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application [None req-2c5815ba-86e4-41c1-ab1b-059d383a2575 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 05:33:28.107496 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:33:28.107496 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:33:28.107496 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:33:28.107496 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:33:28.107496 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:33:28.107496 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:33:28.107496 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:33:28.107496 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:33:28.107496 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:33:28.107496 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:33:28.107496 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:33:28.107496 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 05:33:28.107496 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 05:33:28.107496 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 05:33:28.108463 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 05:33:28.108463 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:33:28.108463 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:33:28.108463 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:33:28.108463 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:33:28.108463 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:33:28.108463 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:33:28.108463 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:33:28.108463 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application with Lock( Aug 24 05:33:28.108463 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:33:28.108463 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:33:28.108463 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:33:28.108463 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:33:28.108463 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:33:28.108463 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:33:28.108463 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:33:28.108463 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:33:28.109307 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 05:33:28.109307 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 05:33:28.109307 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 05:33:28.109307 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 05:33:28.109307 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 05:33:28.109307 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 05:33:28.109307 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 05:33:28.109307 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Aug 24 05:33:28.109307 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 270/539] 10.222.0.26 () {56 vars in 1111 bytes} [Wed Aug 24 05:33:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 05:33:28.115126 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f3d1e7-6b72-4c3f-bf0e-faacab26feba None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:28.155509 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:28.229882 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3294891-2916-4263-85b9-44b33743b548 None None] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:28.230191 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3294891-2916-4263-85b9-44b33743b548 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:28.230376 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3294891-2916-4263-85b9-44b33743b548 None None] PATH_INFO: `/` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:28.231716 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 271/540] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 24 05:33:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:33:28.239270 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f3d1e7-6b72-4c3f-bf0e-faacab26feba None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:28.239786 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566c5662-c6d4-4a87-a85f-47159b3964b5 None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:28.240274 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566c5662-c6d4-4a87-a85f-47159b3964b5 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:28.240823 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566c5662-c6d4-4a87-a85f-47159b3964b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:28.271619 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-566c5662-c6d4-4a87-a85f-47159b3964b5 None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:33:28.273194 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-566c5662-c6d4-4a87-a85f-47159b3964b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:33:28.286139 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d70d60-9d9f-49e8-8ef4-27f64843c8c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:28.287181 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d70d60-9d9f-49e8-8ef4-27f64843c8c4 None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:28.287473 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d70d60-9d9f-49e8-8ef4-27f64843c8c4 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:28.287749 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d70d60-9d9f-49e8-8ef4-27f64843c8c4 None admin] PATH_INFO: `/v3/projects` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:28.288607 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d70d60-9d9f-49e8-8ef4-27f64843c8c4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:33:28.289058 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d70d60-9d9f-49e8-8ef4-27f64843c8c4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:28.290808 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d70d60-9d9f-49e8-8ef4-27f64843c8c4 None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:28.310054 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 270/541] 10.222.0.26 () {56 vars in 1148 bytes} [Wed Aug 24 05:33:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:33:28.319455 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d70d60-9d9f-49e8-8ef4-27f64843c8c4 None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:28.398842 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 272/542] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 24 05:33:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 05:33:28.447079 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:28.457764 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d70d60-9d9f-49e8-8ef4-27f64843c8c4 None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:28.506754 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f22fce-e5d9-4405-bb8b-44e59ce7dbc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:28.507743 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f22fce-e5d9-4405-bb8b-44e59ce7dbc4 None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:28.508239 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f22fce-e5d9-4405-bb8b-44e59ce7dbc4 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:28.508704 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f22fce-e5d9-4405-bb8b-44e59ce7dbc4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:28.509632 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f22fce-e5d9-4405-bb8b-44e59ce7dbc4 None admin] RBAC: Adding query filter params (role.id=59fa3749ca7f47e2ba1127945e13336c, scope.project.id=ded4fe81d4dc43188dd84e53025ee783, user.id=874348b647194ac2b5ecbf12c33bf59e) {{(pid=88112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:33:28.510189 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f22fce-e5d9-4405-bb8b-44e59ce7dbc4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:28.511833 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f22fce-e5d9-4405-bb8b-44e59ce7dbc4 None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:28.522069 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 271/543] 10.222.0.26 () {56 vars in 1374 bytes} [Wed Aug 24 05:33:28 2022] GET /identity/v3/role_assignments?user.id=874348b647194ac2b5ecbf12c33bf59e&scope.project.id=ded4fe81d4dc43188dd84e53025ee783&role.id=59fa3749ca7f47e2ba1127945e13336c => generated 259 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:33:28.771372 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566c5662-c6d4-4a87-a85f-47159b3964b5 None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:28.894456 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566c5662-c6d4-4a87-a85f-47159b3964b5 None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:28.896296 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:28.944659 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05df7e3f-cbe6-4dde-bdfd-c785dbfcf611 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:28.945312 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05df7e3f-cbe6-4dde-bdfd-c785dbfcf611 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:28.945592 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05df7e3f-cbe6-4dde-bdfd-c785dbfcf611 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:28.945862 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05df7e3f-cbe6-4dde-bdfd-c785dbfcf611 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:28.960523 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05df7e3f-cbe6-4dde-bdfd-c785dbfcf611 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:33:28.965327 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application [None req-05df7e3f-cbe6-4dde-bdfd-c785dbfcf611 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 05:33:28.965327 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:33:28.965327 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:33:28.965327 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:33:28.965327 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:33:28.965327 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:33:28.965327 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:33:28.965327 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:33:28.965327 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:33:28.965327 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:33:28.965327 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:33:28.965327 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:33:28.965327 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:33:28.965327 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:33:28.965327 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:33:28.965327 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:33:28.966225 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:33:28.966225 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:33:28.966225 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:33:28.966225 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:33:28.966225 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:33:28.966225 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:33:28.966225 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:33:28.966225 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:33:28.966225 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:33:28.966225 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:33:28.966225 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:33:28.966225 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application with Lock( Aug 24 05:33:28.966225 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:33:28.966225 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:33:28.966225 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:33:28.966225 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:33:28.967047 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:33:28.967047 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:33:28.967047 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:33:28.967047 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:33:28.967047 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:33:28.967047 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:33:28.967047 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:33:28.967047 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:33:28.967047 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:33:28.967047 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:33:28.967047 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 05:33:28.967047 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Aug 24 05:33:28.969095 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 273/544] 10.222.0.26 () {56 vars in 1102 bytes} [Wed Aug 24 05:33:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:33:28.974678 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f22fce-e5d9-4405-bb8b-44e59ce7dbc4 None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:29.115630 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f22fce-e5d9-4405-bb8b-44e59ce7dbc4 None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:29.163450 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa0dee7-325c-4034-afe6-29ed8b5fb7b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:29.164436 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa0dee7-325c-4034-afe6-29ed8b5fb7b0 None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:29.164916 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa0dee7-325c-4034-afe6-29ed8b5fb7b0 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:29.165399 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa0dee7-325c-4034-afe6-29ed8b5fb7b0 None admin] PATH_INFO: `/v3/roles` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:29.166306 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa0dee7-325c-4034-afe6-29ed8b5fb7b0 None admin] RBAC: Adding query filter params (name=service) {{(pid=88112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:33:29.166847 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa0dee7-325c-4034-afe6-29ed8b5fb7b0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:29.168430 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa0dee7-325c-4034-afe6-29ed8b5fb7b0 None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:29.177289 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 272/545] 10.222.0.26 () {56 vars in 1103 bytes} [Wed Aug 24 05:33:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:33:29.182977 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05df7e3f-cbe6-4dde-bdfd-c785dbfcf611 None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:29.314741 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05df7e3f-cbe6-4dde-bdfd-c785dbfcf611 None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:29.340299 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba5a3c8-4409-406b-96ef-dc444760d05c None None] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:29.340644 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba5a3c8-4409-406b-96ef-dc444760d05c None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:29.340850 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba5a3c8-4409-406b-96ef-dc444760d05c None None] PATH_INFO: `/` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:29.342346 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 273/546] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 24 05:33:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 05:33:29.353067 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bba4b6-5dbb-4d8d-8f76-2393b9fe44fe None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:29.353356 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bba4b6-5dbb-4d8d-8f76-2393b9fe44fe None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:29.353637 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bba4b6-5dbb-4d8d-8f76-2393b9fe44fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:29.362143 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea355baf-67a3-442b-b36a-b67f287a00eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:29.362777 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea355baf-67a3-442b-b36a-b67f287a00eb None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:29.363056 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea355baf-67a3-442b-b36a-b67f287a00eb None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:29.363323 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea355baf-67a3-442b-b36a-b67f287a00eb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:29.374253 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea355baf-67a3-442b-b36a-b67f287a00eb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:29.375640 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea355baf-67a3-442b-b36a-b67f287a00eb None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:29.391617 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application [None req-ea355baf-67a3-442b-b36a-b67f287a00eb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:33:29.391617 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:33:29.391617 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:33:29.391617 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:33:29.391617 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:33:29.391617 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:33:29.391617 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:33:29.391617 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:33:29.391617 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:33:29.391617 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:33:29.391617 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:33:29.391617 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:33:29.391617 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 05:33:29.391617 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 05:33:29.391617 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 05:33:29.391617 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 05:33:29.393164 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:33:29.393164 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:33:29.393164 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:33:29.393164 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:33:29.393164 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:33:29.393164 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:33:29.393164 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:33:29.393164 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application with Lock( Aug 24 05:33:29.393164 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:33:29.393164 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:33:29.393164 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:33:29.393164 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:33:29.393164 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:33:29.393164 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:33:29.393164 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:33:29.393164 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:33:29.393164 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 05:33:29.394014 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 05:33:29.394014 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:33:29.394014 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Aug 24 05:33:29.394014 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 274/547] 10.222.0.26 () {56 vars in 1108 bytes} [Wed Aug 24 05:33:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:33:29.395635 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-c3bba4b6-5dbb-4d8d-8f76-2393b9fe44fe None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:33:29.397084 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-c3bba4b6-5dbb-4d8d-8f76-2393b9fe44fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:33:29.401970 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea355baf-67a3-442b-b36a-b67f287a00eb None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:29.415919 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:29.420319 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:29.525972 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 274/548] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 24 05:33:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 05:33:29.527587 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99065db-f01c-450d-9327-3c5e3ff231e9 None None] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:29.528020 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99065db-f01c-450d-9327-3c5e3ff231e9 None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:29.528476 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99065db-f01c-450d-9327-3c5e3ff231e9 None None] PATH_INFO: `/` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:29.529884 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 275/549] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 24 05:33:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:33:29.535347 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547150b7-001a-43c5-a578-683d5994ebdf None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:29.535834 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547150b7-001a-43c5-a578-683d5994ebdf None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:29.536340 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547150b7-001a-43c5-a578-683d5994ebdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:29.540610 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea355baf-67a3-442b-b36a-b67f287a00eb None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:29.571500 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-547150b7-001a-43c5-a578-683d5994ebdf None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:33:29.573072 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-547150b7-001a-43c5-a578-683d5994ebdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:33:29.585102 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f89e48-6350-4572-95d3-dd3b6ea7b9cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:29.585743 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f89e48-6350-4572-95d3-dd3b6ea7b9cf None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:29.586045 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f89e48-6350-4572-95d3-dd3b6ea7b9cf None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:29.586314 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f89e48-6350-4572-95d3-dd3b6ea7b9cf None admin] PATH_INFO: `/v3/domains` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:29.587053 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f89e48-6350-4572-95d3-dd3b6ea7b9cf None admin] RBAC: Adding query filter params (name=Default) {{(pid=88113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:33:29.587352 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f89e48-6350-4572-95d3-dd3b6ea7b9cf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:29.588704 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f89e48-6350-4572-95d3-dd3b6ea7b9cf None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:29.613801 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 275/550] 10.222.0.26 () {56 vars in 1109 bytes} [Wed Aug 24 05:33:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:33:29.617415 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f89e48-6350-4572-95d3-dd3b6ea7b9cf None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:29.697396 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:29.721146 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 276/551] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 24 05:33:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Aug 24 05:33:29.738801 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f89e48-6350-4572-95d3-dd3b6ea7b9cf None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:29.789059 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a10a24-e8b3-4108-a265-33b635956ba7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:29.789664 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a10a24-e8b3-4108-a265-33b635956ba7 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:29.789964 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a10a24-e8b3-4108-a265-33b635956ba7 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:29.790239 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a10a24-e8b3-4108-a265-33b635956ba7 None admin] PATH_INFO: `/v3/users/swift` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:29.801372 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a10a24-e8b3-4108-a265-33b635956ba7 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:29.802865 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a10a24-e8b3-4108-a265-33b635956ba7 None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:29.819777 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application [None req-f0a10a24-e8b3-4108-a265-33b635956ba7 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 24 05:33:29.819777 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:33:29.819777 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:33:29.819777 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:33:29.819777 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:33:29.819777 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:33:29.819777 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:33:29.819777 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:33:29.819777 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:33:29.819777 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:33:29.819777 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:33:29.819777 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:33:29.819777 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 05:33:29.819777 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 05:33:29.819777 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 05:33:29.819777 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 05:33:29.821237 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:33:29.821237 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:33:29.821237 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 05:33:29.821237 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 05:33:29.821237 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 05:33:29.821237 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 05:33:29.821237 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:33:29.821237 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:33:29.821237 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:33:29.821237 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:33:29.821237 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:33:29.821237 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application with Lock( Aug 24 05:33:29.821237 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:33:29.821237 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:33:29.821237 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:33:29.821237 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:33:29.821237 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:33:29.821237 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:33:29.822320 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:33:29.822320 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:33:29.822320 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 05:33:29.822320 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 05:33:29.822320 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 05:33:29.822320 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 05:33:29.822320 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 05:33:29.822320 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 05:33:29.822320 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 24 05:33:29.822320 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Aug 24 05:33:29.822320 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 276/552] 10.222.0.26 () {56 vars in 1096 bytes} [Wed Aug 24 05:33:29 2022] GET /identity/v3/users/swift => generated 83 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:33:29.829061 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547150b7-001a-43c5-a578-683d5994ebdf None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:29.835134 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a10a24-e8b3-4108-a265-33b635956ba7 None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:29.941212 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a10a24-e8b3-4108-a265-33b635956ba7 None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:29.988405 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae8f2f9-a219-44f2-9c9d-f88a89da8c9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:29.989142 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae8f2f9-a219-44f2-9c9d-f88a89da8c9d None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:29.989421 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae8f2f9-a219-44f2-9c9d-f88a89da8c9d None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:29.990516 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae8f2f9-a219-44f2-9c9d-f88a89da8c9d None admin] PATH_INFO: `/v3/roles/service` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:30.002249 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:30.006300 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:30.012068 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae8f2f9-a219-44f2-9c9d-f88a89da8c9d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:33:30.019813 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application [None req-6ae8f2f9-a219-44f2-9c9d-f88a89da8c9d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 05:33:30.019813 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:33:30.019813 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:33:30.019813 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:33:30.019813 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:33:30.019813 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:33:30.019813 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:33:30.019813 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:33:30.019813 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:33:30.019813 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:33:30.019813 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:33:30.019813 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:33:30.019813 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:33:30.019813 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:33:30.019813 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:33:30.019813 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:33:30.020706 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:33:30.020706 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:33:30.020706 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:33:30.020706 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:33:30.020706 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:33:30.020706 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:33:30.020706 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:33:30.020706 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:33:30.020706 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:33:30.020706 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:33:30.020706 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:33:30.020706 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application with Lock( Aug 24 05:33:30.020706 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:33:30.020706 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:33:30.020706 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:33:30.020706 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:33:30.021671 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:33:30.021671 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:33:30.021671 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:33:30.021671 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:33:30.021671 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:33:30.021671 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:33:30.021671 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:33:30.021671 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:33:30.021671 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:33:30.021671 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:33:30.021671 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 05:33:30.021671 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Aug 24 05:33:30.021671 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 277/553] 10.222.0.26 () {56 vars in 1102 bytes} [Wed Aug 24 05:33:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 05:33:30.030178 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae8f2f9-a219-44f2-9c9d-f88a89da8c9d None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:30.051936 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547150b7-001a-43c5-a578-683d5994ebdf None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:30.099551 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ff8898-2e53-4dbc-ac31-72e19e74128a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:30.100158 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ff8898-2e53-4dbc-ac31-72e19e74128a None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:30.100761 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ff8898-2e53-4dbc-ac31-72e19e74128a None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:30.101050 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ff8898-2e53-4dbc-ac31-72e19e74128a None admin] PATH_INFO: `/v3/users` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:30.101777 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ff8898-2e53-4dbc-ac31-72e19e74128a None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=88112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:33:30.102431 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ff8898-2e53-4dbc-ac31-72e19e74128a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:30.104144 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ff8898-2e53-4dbc-ac31-72e19e74128a None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:30.126748 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 277/554] 10.222.0.26 () {56 vars in 1135 bytes} [Wed Aug 24 05:33:29 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:33:30.127681 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ff8898-2e53-4dbc-ac31-72e19e74128a None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:30.177279 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae8f2f9-a219-44f2-9c9d-f88a89da8c9d None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:30.222428 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8e9313-1889-4fe5-a329-514cd6c1fdf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:30.223589 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8e9313-1889-4fe5-a329-514cd6c1fdf3 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:30.223869 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8e9313-1889-4fe5-a329-514cd6c1fdf3 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:30.224141 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8e9313-1889-4fe5-a329-514cd6c1fdf3 None admin] PATH_INFO: `/v3/roles` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:30.225274 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8e9313-1889-4fe5-a329-514cd6c1fdf3 None admin] RBAC: Adding query filter params (name=service) {{(pid=88113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:33:30.225587 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8e9313-1889-4fe5-a329-514cd6c1fdf3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:30.227710 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8e9313-1889-4fe5-a329-514cd6c1fdf3 None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:30.238886 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 278/555] 10.222.0.26 () {56 vars in 1103 bytes} [Wed Aug 24 05:33:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:33:30.240630 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8e9313-1889-4fe5-a329-514cd6c1fdf3 None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:30.256761 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ff8898-2e53-4dbc-ac31-72e19e74128a None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:30.300671 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfe01b0-8199-4f87-a889-d81155e10931 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:30.301539 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfe01b0-8199-4f87-a889-d81155e10931 None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:30.301819 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfe01b0-8199-4f87-a889-d81155e10931 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:30.302172 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfe01b0-8199-4f87-a889-d81155e10931 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:30.306768 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:30.318916 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfe01b0-8199-4f87-a889-d81155e10931 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:33:30.319620 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:30.326009 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application [None req-4dfe01b0-8199-4f87-a889-d81155e10931 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 05:33:30.326009 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:33:30.326009 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:33:30.326009 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:33:30.326009 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:33:30.326009 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:33:30.326009 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:33:30.326009 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:33:30.326009 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:33:30.326009 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:33:30.326009 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:33:30.326009 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:33:30.326009 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:33:30.326009 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:33:30.326009 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:33:30.326009 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:33:30.327205 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:33:30.327205 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:33:30.327205 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:33:30.327205 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:33:30.327205 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:33:30.327205 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:33:30.327205 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:33:30.327205 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:33:30.327205 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:33:30.327205 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:33:30.327205 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:33:30.327205 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application with Lock( Aug 24 05:33:30.327205 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:33:30.327205 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:33:30.327205 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:33:30.327205 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:33:30.328186 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:33:30.328186 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:33:30.328186 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:33:30.328186 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:33:30.328186 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:33:30.328186 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:33:30.328186 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:33:30.328186 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:33:30.328186 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:33:30.328186 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:33:30.328186 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 05:33:30.328186 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Aug 24 05:33:30.335384 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 278/556] 10.222.0.26 () {56 vars in 1102 bytes} [Wed Aug 24 05:33:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:33:30.336666 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfe01b0-8199-4f87-a889-d81155e10931 None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:30.371842 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8e9313-1889-4fe5-a329-514cd6c1fdf3 None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:30.406951 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0728c4-2c7b-4824-b0a2-864753ba8401 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:30.407601 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0728c4-2c7b-4824-b0a2-864753ba8401 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:30.408386 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0728c4-2c7b-4824-b0a2-864753ba8401 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:30.408650 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0728c4-2c7b-4824-b0a2-864753ba8401 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:30.445863 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfe01b0-8199-4f87-a889-d81155e10931 None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:30.486136 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0728c4-2c7b-4824-b0a2-864753ba8401 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:30.487588 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0728c4-2c7b-4824-b0a2-864753ba8401 None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:30.488271 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266e0a00-dfe2-4c13-af8e-d7559c5f8edb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:30.488955 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266e0a00-dfe2-4c13-af8e-d7559c5f8edb None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:30.489175 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266e0a00-dfe2-4c13-af8e-d7559c5f8edb None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:30.489441 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266e0a00-dfe2-4c13-af8e-d7559c5f8edb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:30.506498 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266e0a00-dfe2-4c13-af8e-d7559c5f8edb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:30.506498 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266e0a00-dfe2-4c13-af8e-d7559c5f8edb None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:30.521146 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application [None req-266e0a00-dfe2-4c13-af8e-d7559c5f8edb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:33:30.521146 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:33:30.521146 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:33:30.521146 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:33:30.521146 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:33:30.521146 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:33:30.521146 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:33:30.521146 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:33:30.521146 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:33:30.521146 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:33:30.521146 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:33:30.521146 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:33:30.521146 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 05:33:30.521146 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 05:33:30.521146 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 05:33:30.521146 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 05:33:30.522925 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:33:30.522925 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:33:30.522925 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:33:30.522925 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:33:30.522925 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:33:30.522925 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:33:30.522925 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:33:30.522925 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application with Lock( Aug 24 05:33:30.522925 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:33:30.522925 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:33:30.522925 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:33:30.522925 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:33:30.522925 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:33:30.522925 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:33:30.522925 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:33:30.522925 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:33:30.522925 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 05:33:30.523793 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 05:33:30.523793 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:33:30.523793 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Aug 24 05:33:30.523793 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 279/557] 10.222.0.26 () {56 vars in 1108 bytes} [Wed Aug 24 05:33:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:33:30.524013 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266e0a00-dfe2-4c13-af8e-d7559c5f8edb None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:30.571132 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:30.587179 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:30.620678 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 279/558] 10.222.0.26 () {58 vars in 1282 bytes} [Wed Aug 24 05:33:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 05:33:30.622317 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e65d2b9-5f66-4f45-bfe5-ac3b0c6483c4 None None] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:30.622816 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e65d2b9-5f66-4f45-bfe5-ac3b0c6483c4 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:30.623284 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e65d2b9-5f66-4f45-bfe5-ac3b0c6483c4 None None] PATH_INFO: `/` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:30.625057 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 280/559] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 24 05:33:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:33:30.625982 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e65d2b9-5f66-4f45-bfe5-ac3b0c6483c4 None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:30.661708 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266e0a00-dfe2-4c13-af8e-d7559c5f8edb None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:30.696422 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5894164-dd66-4770-a41d-879b9fead549 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:30.697371 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5894164-dd66-4770-a41d-879b9fead549 None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:30.697740 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5894164-dd66-4770-a41d-879b9fead549 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:30.698103 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5894164-dd66-4770-a41d-879b9fead549 None admin] PATH_INFO: `/v3/roles` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:30.699009 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5894164-dd66-4770-a41d-879b9fead549 None admin] RBAC: Adding query filter params (name=service) {{(pid=88112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:33:30.699423 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5894164-dd66-4770-a41d-879b9fead549 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:30.700805 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5894164-dd66-4770-a41d-879b9fead549 None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:30.711101 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 280/560] 10.222.0.26 () {56 vars in 1103 bytes} [Wed Aug 24 05:33:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:33:30.711839 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5894164-dd66-4770-a41d-879b9fead549 None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:30.749209 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e65d2b9-5f66-4f45-bfe5-ac3b0c6483c4 None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:30.785538 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5a4017-3c8b-48a6-bd63-2da61c21bd9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:30.786238 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5a4017-3c8b-48a6-bd63-2da61c21bd9e None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:30.786515 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5a4017-3c8b-48a6-bd63-2da61c21bd9e None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:30.786783 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5a4017-3c8b-48a6-bd63-2da61c21bd9e None admin] PATH_INFO: `/v3/domains` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:30.787419 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5a4017-3c8b-48a6-bd63-2da61c21bd9e None admin] RBAC: Adding query filter params (name=Default) {{(pid=88113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:33:30.787719 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5a4017-3c8b-48a6-bd63-2da61c21bd9e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:30.789478 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5a4017-3c8b-48a6-bd63-2da61c21bd9e None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:30.800736 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 281/561] 10.222.0.26 () {56 vars in 1109 bytes} [Wed Aug 24 05:33:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:33:30.801938 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b181f1-de13-4060-99dc-c9e2d9568291 None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:30.802250 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b181f1-de13-4060-99dc-c9e2d9568291 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:30.802522 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b181f1-de13-4060-99dc-c9e2d9568291 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:30.820575 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5894164-dd66-4770-a41d-879b9fead549 None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:30.820752 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-38b181f1-de13-4060-99dc-c9e2d9568291 None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:33:30.821745 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-38b181f1-de13-4060-99dc-c9e2d9568291 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:33:30.831982 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:30.833185 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:30.859271 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02349ff3-cba0-4783-8ae4-33cd3862e53f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:30.859901 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02349ff3-cba0-4783-8ae4-33cd3862e53f None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:30.860185 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02349ff3-cba0-4783-8ae4-33cd3862e53f None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:30.860443 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02349ff3-cba0-4783-8ae4-33cd3862e53f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:30.875071 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02349ff3-cba0-4783-8ae4-33cd3862e53f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:30.877024 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02349ff3-cba0-4783-8ae4-33cd3862e53f None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:30.893809 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 282/562] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 24 05:33:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 05:33:30.894005 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application [None req-02349ff3-cba0-4783-8ae4-33cd3862e53f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:33:30.894005 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:33:30.894005 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:33:30.894005 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:33:30.894005 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:33:30.894005 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:33:30.894005 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:33:30.894005 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:33:30.894005 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:33:30.894005 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:33:30.894005 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:33:30.894005 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:33:30.894005 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 05:33:30.894005 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 05:33:30.894005 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 05:33:30.894005 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 05:33:30.894891 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:33:30.894891 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:33:30.894891 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:33:30.894891 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:33:30.894891 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:33:30.894891 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:33:30.894891 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:33:30.894891 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application with Lock( Aug 24 05:33:30.894891 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:33:30.894891 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:33:30.894891 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:33:30.894891 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:33:30.894891 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:33:30.894891 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:33:30.894891 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:33:30.894891 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:33:30.894891 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 05:33:30.895763 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 05:33:30.895763 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:33:30.895763 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Aug 24 05:33:30.896082 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b181f1-de13-4060-99dc-c9e2d9568291 None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:30.896154 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 281/563] 10.222.0.26 () {56 vars in 1108 bytes} [Wed Aug 24 05:33:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:33:30.896154 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba6a1fb-b998-4493-ace3-871d65c9e8ba None None] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:30.896154 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba6a1fb-b998-4493-ace3-871d65c9e8ba None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:30.896154 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba6a1fb-b998-4493-ace3-871d65c9e8ba None None] PATH_INFO: `/` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:30.896154 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 282/564] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 24 05:33:30 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:33:30.896587 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba6a1fb-b998-4493-ace3-871d65c9e8ba None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:31.019953 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b181f1-de13-4060-99dc-c9e2d9568291 None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:31.029766 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba6a1fb-b998-4493-ace3-871d65c9e8ba None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:31.059101 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d255743-484d-47fd-bf69-bd34925744c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:31.059744 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d255743-484d-47fd-bf69-bd34925744c1 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:31.060003 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d255743-484d-47fd-bf69-bd34925744c1 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:31.060271 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d255743-484d-47fd-bf69-bd34925744c1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:31.072978 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08390c4-6f40-4748-ba3b-905dc76624ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:31.073613 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08390c4-6f40-4748-ba3b-905dc76624ed None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:31.073898 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08390c4-6f40-4748-ba3b-905dc76624ed None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:31.074198 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08390c4-6f40-4748-ba3b-905dc76624ed None admin] PATH_INFO: `/v3/users/nova` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:31.075482 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d255743-484d-47fd-bf69-bd34925744c1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:31.076937 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d255743-484d-47fd-bf69-bd34925744c1 None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:31.082731 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08390c4-6f40-4748-ba3b-905dc76624ed None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:31.084346 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08390c4-6f40-4748-ba3b-905dc76624ed None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:31.085040 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:31.094566 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application [None req-9d255743-484d-47fd-bf69-bd34925744c1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:33:31.094566 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:33:31.094566 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:33:31.094566 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:33:31.094566 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:33:31.094566 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:33:31.094566 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:33:31.094566 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:33:31.094566 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:33:31.094566 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:33:31.094566 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:33:31.094566 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:33:31.094566 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 05:33:31.094566 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 05:33:31.094566 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 05:33:31.094566 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 05:33:31.095598 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:33:31.095598 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:33:31.095598 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:33:31.095598 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:33:31.095598 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:33:31.095598 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:33:31.095598 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:33:31.095598 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application with Lock( Aug 24 05:33:31.095598 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:33:31.095598 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:33:31.095598 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:33:31.095598 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:33:31.095598 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:33:31.095598 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:33:31.095598 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:33:31.095598 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:33:31.095598 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 05:33:31.096502 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 05:33:31.096502 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:33:31.096502 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Aug 24 05:33:31.096502 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 283/565] 10.222.0.26 () {56 vars in 1108 bytes} [Wed Aug 24 05:33:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:33:31.097156 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d255743-484d-47fd-bf69-bd34925744c1 None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:31.102683 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application [None req-f08390c4-6f40-4748-ba3b-905dc76624ed None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 05:33:31.102683 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:33:31.102683 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:33:31.102683 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:33:31.102683 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:33:31.102683 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:33:31.102683 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:33:31.102683 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:33:31.102683 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:33:31.102683 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:33:31.102683 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:33:31.102683 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:33:31.102683 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 05:33:31.102683 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 05:33:31.102683 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 05:33:31.102683 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 05:33:31.103804 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:33:31.103804 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:33:31.103804 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 05:33:31.103804 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 05:33:31.103804 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 05:33:31.103804 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 05:33:31.103804 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:33:31.103804 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:33:31.103804 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:33:31.103804 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:33:31.103804 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:33:31.103804 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application with Lock( Aug 24 05:33:31.103804 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:33:31.103804 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:33:31.103804 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:33:31.103804 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:33:31.103804 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:33:31.103804 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:33:31.104954 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:33:31.104954 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:33:31.104954 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 05:33:31.104954 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 05:33:31.104954 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 05:33:31.104954 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 05:33:31.104954 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 05:33:31.104954 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 05:33:31.104954 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 05:33:31.104954 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Aug 24 05:33:31.108879 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 283/566] 10.222.0.26 () {56 vars in 1093 bytes} [Wed Aug 24 05:33:30 2022] GET /identity/v3/users/nova => generated 82 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:33:31.110141 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851463e0-441d-4c5c-9d80-aef6ea8c3f2f None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:31.110430 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851463e0-441d-4c5c-9d80-aef6ea8c3f2f None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:31.111223 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851463e0-441d-4c5c-9d80-aef6ea8c3f2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:31.129039 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-851463e0-441d-4c5c-9d80-aef6ea8c3f2f None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:33:31.130333 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-851463e0-441d-4c5c-9d80-aef6ea8c3f2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:33:31.146486 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:31.199977 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 284/567] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 24 05:33:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 05:33:31.200811 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851463e0-441d-4c5c-9d80-aef6ea8c3f2f None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:31.216420 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d255743-484d-47fd-bf69-bd34925744c1 None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:31.250461 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74647f04-c2c1-415a-8fc3-3dee9efad285 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:31.251245 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74647f04-c2c1-415a-8fc3-3dee9efad285 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:31.252024 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74647f04-c2c1-415a-8fc3-3dee9efad285 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:31.252297 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74647f04-c2c1-415a-8fc3-3dee9efad285 None admin] PATH_INFO: `/v3/domains` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:31.252935 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74647f04-c2c1-415a-8fc3-3dee9efad285 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:33:31.253236 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74647f04-c2c1-415a-8fc3-3dee9efad285 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:31.254632 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74647f04-c2c1-415a-8fc3-3dee9efad285 None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:31.270399 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 284/568] 10.222.0.26 () {56 vars in 1109 bytes} [Wed Aug 24 05:33:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:33:31.270399 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74647f04-c2c1-415a-8fc3-3dee9efad285 None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:31.306958 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851463e0-441d-4c5c-9d80-aef6ea8c3f2f None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:31.327011 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:31.344320 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e31cb6-8237-45fe-acf6-10ba6b6d3fe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:31.345279 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e31cb6-8237-45fe-acf6-10ba6b6d3fe0 None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:31.345755 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e31cb6-8237-45fe-acf6-10ba6b6d3fe0 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:31.346276 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e31cb6-8237-45fe-acf6-10ba6b6d3fe0 None admin] PATH_INFO: `/v3/domains` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:31.347111 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e31cb6-8237-45fe-acf6-10ba6b6d3fe0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:33:31.347628 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e31cb6-8237-45fe-acf6-10ba6b6d3fe0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:31.349219 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e31cb6-8237-45fe-acf6-10ba6b6d3fe0 None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:31.361129 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 285/569] 10.222.0.26 () {56 vars in 1109 bytes} [Wed Aug 24 05:33:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:33:31.362247 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e31cb6-8237-45fe-acf6-10ba6b6d3fe0 None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:31.378323 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74647f04-c2c1-415a-8fc3-3dee9efad285 None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:31.381569 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:31.412667 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24332e5d-eb8c-4c0b-b0ca-607840aa0300 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:31.413266 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24332e5d-eb8c-4c0b-b0ca-607840aa0300 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:31.413542 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24332e5d-eb8c-4c0b-b0ca-607840aa0300 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:31.413810 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24332e5d-eb8c-4c0b-b0ca-607840aa0300 None admin] PATH_INFO: `/v3/users` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:31.414607 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24332e5d-eb8c-4c0b-b0ca-607840aa0300 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:33:31.414908 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24332e5d-eb8c-4c0b-b0ca-607840aa0300 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:31.416395 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24332e5d-eb8c-4c0b-b0ca-607840aa0300 None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:31.454001 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 285/570] 10.222.0.26 () {56 vars in 1133 bytes} [Wed Aug 24 05:33:31 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:33:31.454859 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24332e5d-eb8c-4c0b-b0ca-607840aa0300 None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:31.474677 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e31cb6-8237-45fe-acf6-10ba6b6d3fe0 None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:31.509116 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d90ffb6-6dfa-4754-971c-30c2db781522 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:31.509742 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d90ffb6-6dfa-4754-971c-30c2db781522 None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:31.510042 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d90ffb6-6dfa-4754-971c-30c2db781522 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:31.510313 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d90ffb6-6dfa-4754-971c-30c2db781522 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:31.520317 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d90ffb6-6dfa-4754-971c-30c2db781522 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:33:31.525454 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application [None req-2d90ffb6-6dfa-4754-971c-30c2db781522 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 05:33:31.525454 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:33:31.525454 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:33:31.525454 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:33:31.525454 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:33:31.525454 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:33:31.525454 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:33:31.525454 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:33:31.525454 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:33:31.525454 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:33:31.525454 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:33:31.525454 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:33:31.525454 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:33:31.525454 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:33:31.525454 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:33:31.525454 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:33:31.526463 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:33:31.526463 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:33:31.526463 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:33:31.526463 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:33:31.526463 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:33:31.526463 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:33:31.526463 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:33:31.526463 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:33:31.526463 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:33:31.526463 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:33:31.526463 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:33:31.526463 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application with Lock( Aug 24 05:33:31.526463 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:33:31.526463 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:33:31.526463 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:33:31.526463 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:33:31.527291 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:33:31.527291 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:33:31.527291 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:33:31.527291 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:33:31.527291 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:33:31.527291 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:33:31.527291 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:33:31.527291 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:33:31.527291 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:33:31.527291 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:33:31.527291 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 05:33:31.527291 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Aug 24 05:33:31.527291 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 286/571] 10.222.0.26 () {56 vars in 1102 bytes} [Wed Aug 24 05:33:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:33:31.527291 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d90ffb6-6dfa-4754-971c-30c2db781522 None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:31.555509 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24332e5d-eb8c-4c0b-b0ca-607840aa0300 None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:31.571758 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:31.590531 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bdeb32-2644-4823-b67c-42f7662827b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:31.591154 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bdeb32-2644-4823-b67c-42f7662827b7 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:31.591428 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bdeb32-2644-4823-b67c-42f7662827b7 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:31.591694 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bdeb32-2644-4823-b67c-42f7662827b7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:31.598053 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:31.599135 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bdeb32-2644-4823-b67c-42f7662827b7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:31.600581 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bdeb32-2644-4823-b67c-42f7662827b7 None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:31.611917 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application [None req-87bdeb32-2644-4823-b67c-42f7662827b7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 05:33:31.611917 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:33:31.611917 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:33:31.611917 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:33:31.611917 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:33:31.611917 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:33:31.611917 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:33:31.611917 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:33:31.611917 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:33:31.611917 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:33:31.611917 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:33:31.611917 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:33:31.611917 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 05:33:31.611917 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 05:33:31.611917 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 05:33:31.612849 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 05:33:31.612849 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:33:31.612849 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:33:31.612849 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:33:31.612849 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:33:31.612849 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:33:31.612849 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:33:31.612849 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:33:31.612849 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application with Lock( Aug 24 05:33:31.612849 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:33:31.612849 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:33:31.612849 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:33:31.612849 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:33:31.612849 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:33:31.612849 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:33:31.612849 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:33:31.612849 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:33:31.614102 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 05:33:31.614102 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 05:33:31.614102 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 05:33:31.614102 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 05:33:31.614102 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 05:33:31.614102 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 05:33:31.614102 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 05:33:31.614102 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Aug 24 05:33:31.614102 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 286/572] 10.222.0.26 () {56 vars in 1111 bytes} [Wed Aug 24 05:33:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:33:31.614102 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bdeb32-2644-4823-b67c-42f7662827b7 None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:31.630515 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d90ffb6-6dfa-4754-971c-30c2db781522 None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:31.663231 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ceabd5f-04bd-4809-84ea-e5c50d0f00d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:31.663851 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceabd5f-04bd-4809-84ea-e5c50d0f00d8 None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:31.664132 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceabd5f-04bd-4809-84ea-e5c50d0f00d8 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:31.664406 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceabd5f-04bd-4809-84ea-e5c50d0f00d8 None admin] PATH_INFO: `/v3/users/glance` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:31.671549 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ceabd5f-04bd-4809-84ea-e5c50d0f00d8 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:31.672983 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ceabd5f-04bd-4809-84ea-e5c50d0f00d8 None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:31.684333 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application [None req-4ceabd5f-04bd-4809-84ea-e5c50d0f00d8 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 24 05:33:31.684333 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:33:31.684333 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:33:31.684333 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:33:31.684333 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:33:31.684333 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:33:31.684333 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:33:31.684333 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:33:31.684333 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:33:31.684333 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:33:31.684333 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:33:31.684333 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:33:31.684333 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 05:33:31.684333 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 05:33:31.684333 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 05:33:31.684333 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 05:33:31.685454 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:33:31.685454 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:33:31.685454 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 05:33:31.685454 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 05:33:31.685454 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 05:33:31.685454 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 05:33:31.685454 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:33:31.685454 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:33:31.685454 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:33:31.685454 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:33:31.685454 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:33:31.685454 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application with Lock( Aug 24 05:33:31.685454 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:33:31.685454 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:33:31.685454 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:33:31.685454 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:33:31.685454 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:33:31.685454 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:33:31.686455 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:33:31.686455 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:33:31.686455 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 05:33:31.686455 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 05:33:31.686455 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 05:33:31.686455 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 05:33:31.686455 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 05:33:31.686455 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 05:33:31.686455 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 24 05:33:31.686455 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Aug 24 05:33:31.686455 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 287/573] 10.222.0.26 () {56 vars in 1099 bytes} [Wed Aug 24 05:33:31 2022] GET /identity/v3/users/glance => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:33:31.687031 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ceabd5f-04bd-4809-84ea-e5c50d0f00d8 None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:31.712840 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bdeb32-2644-4823-b67c-42f7662827b7 None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:31.745349 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb726b4-bfc4-499d-a8f4-dd4abf9a7be5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:31.745972 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb726b4-bfc4-499d-a8f4-dd4abf9a7be5 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:31.746329 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb726b4-bfc4-499d-a8f4-dd4abf9a7be5 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:31.746603 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb726b4-bfc4-499d-a8f4-dd4abf9a7be5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:31.756649 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb726b4-bfc4-499d-a8f4-dd4abf9a7be5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:31.758145 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb726b4-bfc4-499d-a8f4-dd4abf9a7be5 None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:31.771750 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application [None req-aeb726b4-bfc4-499d-a8f4-dd4abf9a7be5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:33:31.771750 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:33:31.771750 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:33:31.771750 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:33:31.771750 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:33:31.771750 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:33:31.771750 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:33:31.771750 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:33:31.771750 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:33:31.771750 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:33:31.771750 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:33:31.771750 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:33:31.771750 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 05:33:31.771750 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 05:33:31.771750 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 05:33:31.771750 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 05:33:31.772680 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:33:31.772680 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:33:31.772680 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:33:31.772680 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:33:31.772680 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:33:31.772680 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:33:31.772680 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:33:31.772680 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application with Lock( Aug 24 05:33:31.772680 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:33:31.772680 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:33:31.772680 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:33:31.772680 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:33:31.772680 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:33:31.772680 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:33:31.772680 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:33:31.772680 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:33:31.772680 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 05:33:31.773583 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 05:33:31.773583 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:33:31.773583 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Aug 24 05:33:31.773583 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 287/574] 10.222.0.26 () {56 vars in 1108 bytes} [Wed Aug 24 05:33:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:33:31.773902 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb726b4-bfc4-499d-a8f4-dd4abf9a7be5 None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:31.787664 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ceabd5f-04bd-4809-84ea-e5c50d0f00d8 None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:31.801354 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:31.817590 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:31.822738 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fe44e6-f7b1-4161-a258-c346bfeec8e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:31.823364 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fe44e6-f7b1-4161-a258-c346bfeec8e3 None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:31.823644 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fe44e6-f7b1-4161-a258-c346bfeec8e3 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:31.823916 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fe44e6-f7b1-4161-a258-c346bfeec8e3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:31.833624 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fe44e6-f7b1-4161-a258-c346bfeec8e3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:33:31.838695 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application [None req-a5fe44e6-f7b1-4161-a258-c346bfeec8e3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 05:33:31.838695 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:33:31.838695 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:33:31.838695 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:33:31.838695 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:33:31.838695 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:33:31.838695 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:33:31.838695 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:33:31.838695 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:33:31.838695 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:33:31.838695 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:33:31.838695 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:33:31.838695 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:33:31.838695 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:33:31.838695 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:33:31.838695 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:33:31.839662 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:33:31.839662 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:33:31.839662 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:33:31.839662 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:33:31.839662 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:33:31.839662 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:33:31.839662 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:33:31.839662 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:33:31.839662 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:33:31.839662 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:33:31.839662 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:33:31.839662 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application with Lock( Aug 24 05:33:31.839662 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:33:31.839662 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:33:31.839662 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:33:31.839662 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:33:31.840503 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:33:31.840503 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:33:31.840503 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:33:31.840503 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:33:31.840503 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:33:31.840503 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:33:31.840503 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:33:31.840503 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:33:31.840503 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:33:31.840503 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:33:31.840503 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 05:33:31.840503 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Aug 24 05:33:31.840503 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 288/575] 10.222.0.26 () {56 vars in 1102 bytes} [Wed Aug 24 05:33:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:33:31.840503 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fe44e6-f7b1-4161-a258-c346bfeec8e3 None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:31.874074 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb726b4-bfc4-499d-a8f4-dd4abf9a7be5 None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:31.906885 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5032ee4a-376d-41c6-9d58-721eb140f022 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:31.908338 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5032ee4a-376d-41c6-9d58-721eb140f022 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:31.908728 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5032ee4a-376d-41c6-9d58-721eb140f022 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:31.909064 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5032ee4a-376d-41c6-9d58-721eb140f022 None admin] PATH_INFO: `/v3/roles` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:31.909809 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5032ee4a-376d-41c6-9d58-721eb140f022 None admin] RBAC: Adding query filter params (name=service) {{(pid=88113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:33:31.910106 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5032ee4a-376d-41c6-9d58-721eb140f022 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:31.911517 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5032ee4a-376d-41c6-9d58-721eb140f022 None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:31.919519 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 288/576] 10.222.0.26 () {56 vars in 1103 bytes} [Wed Aug 24 05:33:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:33:31.920298 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5032ee4a-376d-41c6-9d58-721eb140f022 None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:31.941670 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fe44e6-f7b1-4161-a258-c346bfeec8e3 None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:31.974007 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51afae9d-ff77-4c3a-a424-980c2c54fc87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:31.974603 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51afae9d-ff77-4c3a-a424-980c2c54fc87 None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:31.974885 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51afae9d-ff77-4c3a-a424-980c2c54fc87 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:31.975178 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51afae9d-ff77-4c3a-a424-980c2c54fc87 None admin] PATH_INFO: `/v3/projects` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:31.975860 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51afae9d-ff77-4c3a-a424-980c2c54fc87 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:33:31.976160 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51afae9d-ff77-4c3a-a424-980c2c54fc87 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:31.977567 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51afae9d-ff77-4c3a-a424-980c2c54fc87 None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:31.989694 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 289/577] 10.222.0.26 () {56 vars in 1148 bytes} [Wed Aug 24 05:33:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:33:31.990568 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51afae9d-ff77-4c3a-a424-980c2c54fc87 None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:32.010216 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:32.020399 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5032ee4a-376d-41c6-9d58-721eb140f022 None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:32.046608 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:32.053387 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff87aac-78e7-4037-ad49-38c800a27510 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:32.054018 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff87aac-78e7-4037-ad49-38c800a27510 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:32.054297 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff87aac-78e7-4037-ad49-38c800a27510 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:32.054562 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff87aac-78e7-4037-ad49-38c800a27510 None admin] PATH_INFO: `/v3/users` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:32.055280 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff87aac-78e7-4037-ad49-38c800a27510 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=88113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:33:32.055580 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff87aac-78e7-4037-ad49-38c800a27510 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:32.056999 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff87aac-78e7-4037-ad49-38c800a27510 None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:32.075519 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 289/578] 10.222.0.26 () {56 vars in 1137 bytes} [Wed Aug 24 05:33:31 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:33:32.076296 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff87aac-78e7-4037-ad49-38c800a27510 None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:32.097302 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51afae9d-ff77-4c3a-a424-980c2c54fc87 None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:32.130696 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28441c7f-dc6e-4406-965a-b08b7084b744 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:32.131295 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28441c7f-dc6e-4406-965a-b08b7084b744 None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:32.131569 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28441c7f-dc6e-4406-965a-b08b7084b744 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:32.131835 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28441c7f-dc6e-4406-965a-b08b7084b744 None admin] PATH_INFO: `/v3/domains` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:32.132469 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28441c7f-dc6e-4406-965a-b08b7084b744 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:33:32.132769 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28441c7f-dc6e-4406-965a-b08b7084b744 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:32.134164 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28441c7f-dc6e-4406-965a-b08b7084b744 None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:32.144839 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 290/579] 10.222.0.26 () {56 vars in 1109 bytes} [Wed Aug 24 05:33:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:33:32.145632 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28441c7f-dc6e-4406-965a-b08b7084b744 None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:32.174387 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff87aac-78e7-4037-ad49-38c800a27510 None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:32.209224 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d10d5ca-3140-4caf-83dd-4b3ae616b1b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:32.209820 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d10d5ca-3140-4caf-83dd-4b3ae616b1b9 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:32.210129 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d10d5ca-3140-4caf-83dd-4b3ae616b1b9 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:32.210399 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d10d5ca-3140-4caf-83dd-4b3ae616b1b9 None admin] PATH_INFO: `/v3/roles` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:32.211049 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d10d5ca-3140-4caf-83dd-4b3ae616b1b9 None admin] RBAC: Adding query filter params (name=service) {{(pid=88113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:33:32.211350 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d10d5ca-3140-4caf-83dd-4b3ae616b1b9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:32.212718 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d10d5ca-3140-4caf-83dd-4b3ae616b1b9 None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:32.220907 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 290/580] 10.222.0.26 () {56 vars in 1103 bytes} [Wed Aug 24 05:33:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:33:32.221679 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d10d5ca-3140-4caf-83dd-4b3ae616b1b9 None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:32.234790 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:32.244944 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28441c7f-dc6e-4406-965a-b08b7084b744 None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:32.257933 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:32.279289 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17fe9b7-8dc2-4a71-9d55-584ba16202d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:32.279906 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17fe9b7-8dc2-4a71-9d55-584ba16202d7 None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:32.280186 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17fe9b7-8dc2-4a71-9d55-584ba16202d7 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:32.280456 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17fe9b7-8dc2-4a71-9d55-584ba16202d7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:32.290999 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17fe9b7-8dc2-4a71-9d55-584ba16202d7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:32.292443 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17fe9b7-8dc2-4a71-9d55-584ba16202d7 None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:32.306065 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application [None req-a17fe9b7-8dc2-4a71-9d55-584ba16202d7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:33:32.306065 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:33:32.306065 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:33:32.306065 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:33:32.306065 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:33:32.306065 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:33:32.306065 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:33:32.306065 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:33:32.306065 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:33:32.306065 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:33:32.306065 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:33:32.306065 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:33:32.306065 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 05:33:32.306065 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 05:33:32.306065 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 05:33:32.306065 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 05:33:32.307044 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:33:32.307044 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:33:32.307044 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:33:32.307044 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:33:32.307044 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:33:32.307044 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:33:32.307044 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:33:32.307044 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application with Lock( Aug 24 05:33:32.307044 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:33:32.307044 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:33:32.307044 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:33:32.307044 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:33:32.307044 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:33:32.307044 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:33:32.307044 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:33:32.307044 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:33:32.307044 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 05:33:32.307910 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 05:33:32.307910 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:33:32.307910 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Aug 24 05:33:32.307910 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 291/581] 10.222.0.26 () {56 vars in 1108 bytes} [Wed Aug 24 05:33:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:33:32.307910 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17fe9b7-8dc2-4a71-9d55-584ba16202d7 None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:32.320757 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d10d5ca-3140-4caf-83dd-4b3ae616b1b9 None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:32.353713 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf68992-f587-41f5-ad1d-094a94ea0e23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:32.354385 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf68992-f587-41f5-ad1d-094a94ea0e23 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:32.354661 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf68992-f587-41f5-ad1d-094a94ea0e23 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:32.354929 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf68992-f587-41f5-ad1d-094a94ea0e23 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:32.355643 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf68992-f587-41f5-ad1d-094a94ea0e23 None admin] RBAC: Adding query filter params (role.id=59fa3749ca7f47e2ba1127945e13336c, scope.project.id=ded4fe81d4dc43188dd84e53025ee783, user.id=87ff96222a7c4baea31fc1bebf4d89a9) {{(pid=88113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:33:32.355944 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf68992-f587-41f5-ad1d-094a94ea0e23 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:32.357364 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf68992-f587-41f5-ad1d-094a94ea0e23 None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:32.362905 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 291/582] 10.222.0.26 () {56 vars in 1374 bytes} [Wed Aug 24 05:33:32 2022] GET /identity/v3/role_assignments?user.id=87ff96222a7c4baea31fc1bebf4d89a9&scope.project.id=ded4fe81d4dc43188dd84e53025ee783&role.id=59fa3749ca7f47e2ba1127945e13336c => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:33:32.363684 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf68992-f587-41f5-ad1d-094a94ea0e23 None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:32.419984 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17fe9b7-8dc2-4a71-9d55-584ba16202d7 None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:32.456548 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:32.457101 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c0c283-09cb-411f-9de3-ce4e806d7e63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:32.457758 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c0c283-09cb-411f-9de3-ce4e806d7e63 None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:32.458072 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c0c283-09cb-411f-9de3-ce4e806d7e63 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:32.458348 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c0c283-09cb-411f-9de3-ce4e806d7e63 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:32.470488 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c0c283-09cb-411f-9de3-ce4e806d7e63 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:32.472022 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c0c283-09cb-411f-9de3-ce4e806d7e63 None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:32.485323 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf68992-f587-41f5-ad1d-094a94ea0e23 None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:32.487580 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application [None req-84c0c283-09cb-411f-9de3-ce4e806d7e63 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:33:32.487580 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:33:32.487580 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:33:32.487580 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:33:32.487580 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:33:32.487580 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:33:32.487580 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:33:32.487580 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:33:32.487580 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:33:32.487580 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:33:32.487580 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:33:32.487580 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:33:32.487580 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 05:33:32.487580 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 05:33:32.487580 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 05:33:32.487580 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 05:33:32.488532 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:33:32.488532 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:33:32.488532 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:33:32.488532 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:33:32.488532 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:33:32.488532 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:33:32.488532 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:33:32.488532 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application with Lock( Aug 24 05:33:32.488532 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:33:32.488532 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:33:32.488532 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:33:32.488532 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:33:32.488532 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:33:32.488532 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:33:32.488532 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:33:32.488532 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:33:32.488532 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 05:33:32.490532 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 05:33:32.490532 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:33:32.490532 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Aug 24 05:33:32.490532 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 292/583] 10.222.0.26 () {56 vars in 1108 bytes} [Wed Aug 24 05:33:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:33:32.490532 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c0c283-09cb-411f-9de3-ce4e806d7e63 None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:32.514950 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:32.528815 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6620676-ebc6-4cd1-8ed6-7c725320f577 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:32.529449 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6620676-ebc6-4cd1-8ed6-7c725320f577 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:32.529729 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6620676-ebc6-4cd1-8ed6-7c725320f577 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:32.530062 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6620676-ebc6-4cd1-8ed6-7c725320f577 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:32.537346 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6620676-ebc6-4cd1-8ed6-7c725320f577 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:32.538847 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6620676-ebc6-4cd1-8ed6-7c725320f577 None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:32.551180 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application [None req-c6620676-ebc6-4cd1-8ed6-7c725320f577 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 05:33:32.551180 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:33:32.551180 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:33:32.551180 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:33:32.551180 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:33:32.551180 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:33:32.551180 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:33:32.551180 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:33:32.551180 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:33:32.551180 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:33:32.551180 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:33:32.551180 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:33:32.551180 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 05:33:32.551180 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 05:33:32.551180 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 05:33:32.552061 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 05:33:32.552061 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:33:32.552061 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:33:32.552061 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:33:32.552061 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:33:32.552061 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:33:32.552061 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:33:32.552061 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:33:32.552061 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application with Lock( Aug 24 05:33:32.552061 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:33:32.552061 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:33:32.552061 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:33:32.552061 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:33:32.552061 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:33:32.552061 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:33:32.552061 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:33:32.552061 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:33:32.552976 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 05:33:32.552976 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 05:33:32.552976 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 05:33:32.552976 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 05:33:32.552976 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 05:33:32.552976 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 05:33:32.552976 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 05:33:32.552976 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Aug 24 05:33:32.552976 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 292/584] 10.222.0.26 () {56 vars in 1111 bytes} [Wed Aug 24 05:33:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:33:32.553455 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6620676-ebc6-4cd1-8ed6-7c725320f577 None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:32.617551 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c0c283-09cb-411f-9de3-ce4e806d7e63 None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:32.655157 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2a3846-0812-4fa9-bf9b-c6c4e26c9c05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:32.656153 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2a3846-0812-4fa9-bf9b-c6c4e26c9c05 None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:32.656499 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2a3846-0812-4fa9-bf9b-c6c4e26c9c05 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:32.656836 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2a3846-0812-4fa9-bf9b-c6c4e26c9c05 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:32.663024 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6620676-ebc6-4cd1-8ed6-7c725320f577 None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:32.668572 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2a3846-0812-4fa9-bf9b-c6c4e26c9c05 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:32.670141 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2a3846-0812-4fa9-bf9b-c6c4e26c9c05 None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:32.685389 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application [None req-6f2a3846-0812-4fa9-bf9b-c6c4e26c9c05 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:33:32.685389 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:33:32.685389 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:33:32.685389 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:33:32.685389 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:33:32.685389 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:33:32.685389 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:33:32.685389 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:33:32.685389 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:33:32.685389 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:33:32.685389 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:33:32.685389 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:33:32.685389 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 05:33:32.685389 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 05:33:32.685389 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 05:33:32.685389 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 05:33:32.686388 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:33:32.686388 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:33:32.686388 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:33:32.686388 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:33:32.686388 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:33:32.686388 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:33:32.686388 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:33:32.686388 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application with Lock( Aug 24 05:33:32.686388 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:33:32.686388 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:33:32.686388 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:33:32.686388 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:33:32.686388 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:33:32.686388 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:33:32.686388 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:33:32.686388 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:33:32.686388 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 05:33:32.687297 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 05:33:32.687297 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:33:32.687297 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Aug 24 05:33:32.687297 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 293/585] 10.222.0.26 () {56 vars in 1108 bytes} [Wed Aug 24 05:33:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:33:32.687297 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2a3846-0812-4fa9-bf9b-c6c4e26c9c05 None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:32.705809 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39216e76-785c-44fa-9987-9e5c7f6a900f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:32.706454 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39216e76-785c-44fa-9987-9e5c7f6a900f None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:32.706738 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39216e76-785c-44fa-9987-9e5c7f6a900f None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:32.707012 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39216e76-785c-44fa-9987-9e5c7f6a900f None admin] PATH_INFO: `/v3/domains` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:32.707661 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39216e76-785c-44fa-9987-9e5c7f6a900f None admin] RBAC: Adding query filter params (name=Default) {{(pid=88113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:33:32.707963 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39216e76-785c-44fa-9987-9e5c7f6a900f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:32.709333 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39216e76-785c-44fa-9987-9e5c7f6a900f None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:32.710931 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:32.729044 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 293/586] 10.222.0.26 () {56 vars in 1109 bytes} [Wed Aug 24 05:33:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:33:32.729924 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39216e76-785c-44fa-9987-9e5c7f6a900f None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:32.758621 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:32.794715 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2a3846-0812-4fa9-bf9b-c6c4e26c9c05 None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:32.830644 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc757c9-440d-4b84-8868-40a3890e7ab9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:32.831356 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc757c9-440d-4b84-8868-40a3890e7ab9 None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:32.831638 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc757c9-440d-4b84-8868-40a3890e7ab9 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:32.831937 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc757c9-440d-4b84-8868-40a3890e7ab9 None admin] PATH_INFO: `/v3/domains` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:32.832560 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc757c9-440d-4b84-8868-40a3890e7ab9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:33:32.832862 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc757c9-440d-4b84-8868-40a3890e7ab9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:32.834249 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc757c9-440d-4b84-8868-40a3890e7ab9 None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:32.840322 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39216e76-785c-44fa-9987-9e5c7f6a900f None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:32.846471 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 294/587] 10.222.0.26 () {56 vars in 1109 bytes} [Wed Aug 24 05:33:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:33:32.847281 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc757c9-440d-4b84-8868-40a3890e7ab9 None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:32.879072 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b6e338-196f-48df-b9f8-acc5150ab65f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:32.880164 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b6e338-196f-48df-b9f8-acc5150ab65f None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:32.880448 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b6e338-196f-48df-b9f8-acc5150ab65f None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:32.880714 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b6e338-196f-48df-b9f8-acc5150ab65f None admin] PATH_INFO: `/v3/projects` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:32.881398 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b6e338-196f-48df-b9f8-acc5150ab65f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:33:32.881700 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b6e338-196f-48df-b9f8-acc5150ab65f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:32.883328 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b6e338-196f-48df-b9f8-acc5150ab65f None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:32.896178 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 294/588] 10.222.0.26 () {56 vars in 1148 bytes} [Wed Aug 24 05:33:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:33:32.896983 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b6e338-196f-48df-b9f8-acc5150ab65f None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:32.955458 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:32.969775 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc757c9-440d-4b84-8868-40a3890e7ab9 None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:33.002747 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b6e338-196f-48df-b9f8-acc5150ab65f None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:33.004037 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:33.014788 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053c0c3c-4990-491a-b4d2-25d59d9c09dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:33.015397 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053c0c3c-4990-491a-b4d2-25d59d9c09dc None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:33.015677 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053c0c3c-4990-491a-b4d2-25d59d9c09dc None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:33.015946 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053c0c3c-4990-491a-b4d2-25d59d9c09dc None admin] PATH_INFO: `/v3/domains` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:33.016588 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053c0c3c-4990-491a-b4d2-25d59d9c09dc None admin] RBAC: Adding query filter params (name=Default) {{(pid=88112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:33:33.017452 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053c0c3c-4990-491a-b4d2-25d59d9c09dc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:33.018843 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053c0c3c-4990-491a-b4d2-25d59d9c09dc None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:33.030398 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 295/589] 10.222.0.26 () {56 vars in 1109 bytes} [Wed Aug 24 05:33:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:33:33.035080 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053c0c3c-4990-491a-b4d2-25d59d9c09dc None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:33.043629 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7ecdd0-d640-4c3c-9cef-d38ec8b70d1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:33.044331 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7ecdd0-d640-4c3c-9cef-d38ec8b70d1b None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:33.044684 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7ecdd0-d640-4c3c-9cef-d38ec8b70d1b None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:33.044966 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7ecdd0-d640-4c3c-9cef-d38ec8b70d1b None admin] PATH_INFO: `/v3/users/cinder` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:33.052894 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7ecdd0-d640-4c3c-9cef-d38ec8b70d1b None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:33.054453 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7ecdd0-d640-4c3c-9cef-d38ec8b70d1b None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:33.066009 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application [None req-8c7ecdd0-d640-4c3c-9cef-d38ec8b70d1b None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 05:33:33.066009 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:33:33.066009 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:33:33.066009 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:33:33.066009 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:33:33.066009 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:33:33.066009 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:33:33.066009 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:33:33.066009 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:33:33.066009 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:33:33.066009 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:33:33.066009 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:33:33.066009 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 05:33:33.066009 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 05:33:33.066009 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 05:33:33.066009 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 05:33:33.067121 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:33:33.067121 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:33:33.067121 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 05:33:33.067121 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 05:33:33.067121 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 05:33:33.067121 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 05:33:33.067121 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:33:33.067121 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:33:33.067121 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:33:33.067121 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:33:33.067121 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:33:33.067121 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application with Lock( Aug 24 05:33:33.067121 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:33:33.067121 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:33:33.067121 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:33:33.067121 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:33:33.067121 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:33:33.067121 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:33:33.073091 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:33:33.073091 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:33:33.073091 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 05:33:33.073091 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 05:33:33.073091 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 05:33:33.073091 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 05:33:33.073091 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 05:33:33.073091 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 05:33:33.073091 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 05:33:33.073091 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Aug 24 05:33:33.073091 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 295/590] 10.222.0.26 () {56 vars in 1099 bytes} [Wed Aug 24 05:33:32 2022] GET /identity/v3/users/cinder => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:33:33.073091 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7ecdd0-d640-4c3c-9cef-d38ec8b70d1b None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:33.143728 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053c0c3c-4990-491a-b4d2-25d59d9c09dc None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:33.170433 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7ecdd0-d640-4c3c-9cef-d38ec8b70d1b None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:33.178904 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa79f720-8d73-4eb6-8897-c4f7e653d72a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:33.179619 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa79f720-8d73-4eb6-8897-c4f7e653d72a None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:33.179903 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa79f720-8d73-4eb6-8897-c4f7e653d72a None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:33.180172 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa79f720-8d73-4eb6-8897-c4f7e653d72a None admin] PATH_INFO: `/v3/projects/service` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:33.184984 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:33.187097 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa79f720-8d73-4eb6-8897-c4f7e653d72a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:33.189619 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa79f720-8d73-4eb6-8897-c4f7e653d72a None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:33.201537 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application [None req-fa79f720-8d73-4eb6-8897-c4f7e653d72a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 05:33:33.201537 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:33:33.201537 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:33:33.201537 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:33:33.201537 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:33:33.201537 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:33:33.201537 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:33:33.201537 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:33:33.201537 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:33:33.201537 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:33:33.201537 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:33:33.201537 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:33:33.201537 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 05:33:33.201537 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 05:33:33.201537 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 05:33:33.202601 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 05:33:33.202601 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:33:33.202601 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:33:33.202601 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:33:33.202601 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:33:33.202601 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:33:33.202601 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:33:33.202601 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:33:33.202601 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application with Lock( Aug 24 05:33:33.202601 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:33:33.202601 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:33:33.202601 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:33:33.202601 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:33:33.202601 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:33:33.202601 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:33:33.202601 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:33:33.202601 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:33:33.203507 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 05:33:33.203507 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 05:33:33.203507 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 05:33:33.203507 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 05:33:33.203507 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 05:33:33.203507 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 05:33:33.203507 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 05:33:33.203507 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Aug 24 05:33:33.203507 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 296/591] 10.222.0.26 () {56 vars in 1111 bytes} [Wed Aug 24 05:33:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:33:33.203993 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa79f720-8d73-4eb6-8897-c4f7e653d72a None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:33.213266 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b92535-2606-49e3-9d3b-4558b2fce74f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:33.213927 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b92535-2606-49e3-9d3b-4558b2fce74f None admin] REQUEST_METHOD: `PUT` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:33.214231 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b92535-2606-49e3-9d3b-4558b2fce74f None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:33.214498 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b92535-2606-49e3-9d3b-4558b2fce74f None admin] PATH_INFO: `/v3/projects/ded4fe81d4dc43188dd84e53025ee783/users/7b633e1aec6c4269bce13aa9c89e911a/roles/59fa3749ca7f47e2ba1127945e13336c` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:33.230549 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b92535-2606-49e3-9d3b-4558b2fce74f None admin] RBAC: Authorizing `identity:create_grant(project_id=ded4fe81d4dc43188dd84e53025ee783, user_id=7b633e1aec6c4269bce13aa9c89e911a, role_id=59fa3749ca7f47e2ba1127945e13336c)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:33.231989 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b92535-2606-49e3-9d3b-4558b2fce74f None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:33.247712 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 296/592] 10.222.0.26 () {58 vars in 1439 bytes} [Wed Aug 24 05:33:33 2022] PUT /identity/v3/projects/ded4fe81d4dc43188dd84e53025ee783/users/7b633e1aec6c4269bce13aa9c89e911a/roles/59fa3749ca7f47e2ba1127945e13336c => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:33:33.248507 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b92535-2606-49e3-9d3b-4558b2fce74f None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:33.262140 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:33.327951 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa79f720-8d73-4eb6-8897-c4f7e653d72a None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:33.367669 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dc1dbe-f339-423b-b64a-2f4b717c1499 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:33.368698 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dc1dbe-f339-423b-b64a-2f4b717c1499 None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:33.368698 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dc1dbe-f339-423b-b64a-2f4b717c1499 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:33.368928 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dc1dbe-f339-423b-b64a-2f4b717c1499 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:33.379255 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29dc1dbe-f339-423b-b64a-2f4b717c1499 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:33.380544 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29dc1dbe-f339-423b-b64a-2f4b717c1499 None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:33.393225 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application [None req-29dc1dbe-f339-423b-b64a-2f4b717c1499 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 24 05:33:33.393225 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:33:33.393225 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:33:33.393225 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:33:33.393225 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:33:33.393225 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:33:33.393225 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:33:33.393225 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:33:33.393225 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:33:33.393225 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:33:33.393225 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:33:33.393225 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:33:33.393225 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 05:33:33.393225 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 05:33:33.393225 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 05:33:33.393225 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 05:33:33.394432 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:33:33.394432 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:33:33.394432 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 05:33:33.394432 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 05:33:33.394432 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 05:33:33.394432 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 05:33:33.394432 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:33:33.394432 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:33:33.394432 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:33:33.394432 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:33:33.394432 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:33:33.394432 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application with Lock( Aug 24 05:33:33.394432 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:33:33.394432 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:33:33.394432 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:33:33.394432 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:33:33.394432 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:33:33.394432 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:33:33.395484 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:33:33.395484 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:33:33.395484 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 05:33:33.395484 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 05:33:33.395484 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 05:33:33.395484 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 05:33:33.395484 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 05:33:33.395484 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 05:33:33.395484 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 24 05:33:33.395484 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Aug 24 05:33:33.398315 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 297/593] 10.222.0.26 () {56 vars in 1102 bytes} [Wed Aug 24 05:33:33 2022] GET /identity/v3/users/neutron => generated 85 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:33:33.399234 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dc1dbe-f339-423b-b64a-2f4b717c1499 None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:33.400255 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b92535-2606-49e3-9d3b-4558b2fce74f None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:33.444382 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0159cf0-1b28-47e8-abbf-292b20cf65e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:33.445934 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0159cf0-1b28-47e8-abbf-292b20cf65e7 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:33.446255 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0159cf0-1b28-47e8-abbf-292b20cf65e7 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:33.446532 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0159cf0-1b28-47e8-abbf-292b20cf65e7 None admin] PATH_INFO: `/v3/users` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:33.447702 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0159cf0-1b28-47e8-abbf-292b20cf65e7 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=88113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:33:33.447702 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0159cf0-1b28-47e8-abbf-292b20cf65e7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:33.449155 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0159cf0-1b28-47e8-abbf-292b20cf65e7 None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:33.479745 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 297/594] 10.222.0.26 () {56 vars in 1137 bytes} [Wed Aug 24 05:33:33 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:33:33.480900 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0159cf0-1b28-47e8-abbf-292b20cf65e7 None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:33.518380 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:33.533906 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dc1dbe-f339-423b-b64a-2f4b717c1499 None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:33.544511 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:33.578693 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8430cf2-48bd-4017-a813-999229eb0da2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:33.579332 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8430cf2-48bd-4017-a813-999229eb0da2 None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:33.579614 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8430cf2-48bd-4017-a813-999229eb0da2 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:33.579881 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8430cf2-48bd-4017-a813-999229eb0da2 None admin] PATH_INFO: `/v3/projects` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:33.580997 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8430cf2-48bd-4017-a813-999229eb0da2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:33:33.581305 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8430cf2-48bd-4017-a813-999229eb0da2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:33.583129 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8430cf2-48bd-4017-a813-999229eb0da2 None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:33.599223 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 298/595] 10.222.0.26 () {56 vars in 1148 bytes} [Wed Aug 24 05:33:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:33:33.599888 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8430cf2-48bd-4017-a813-999229eb0da2 None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:33.609262 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0159cf0-1b28-47e8-abbf-292b20cf65e7 None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:33.648068 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1b4227-6f2c-4b41-a36e-ae8fb302dc4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:33.649062 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1b4227-6f2c-4b41-a36e-ae8fb302dc4e None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:33.649549 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1b4227-6f2c-4b41-a36e-ae8fb302dc4e None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:33.650487 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1b4227-6f2c-4b41-a36e-ae8fb302dc4e None admin] PATH_INFO: `/v3/users` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:33.651476 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1b4227-6f2c-4b41-a36e-ae8fb302dc4e None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=88113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:33:33.651988 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1b4227-6f2c-4b41-a36e-ae8fb302dc4e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:33.654336 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1b4227-6f2c-4b41-a36e-ae8fb302dc4e None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:33.678618 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 298/596] 10.222.0.26 () {56 vars in 1139 bytes} [Wed Aug 24 05:33:33 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:33:33.679699 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1b4227-6f2c-4b41-a36e-ae8fb302dc4e None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:33.727434 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8430cf2-48bd-4017-a813-999229eb0da2 None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:33.771100 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1220fe4e-42df-49c5-be36-ac0be9689492 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:33.771739 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1220fe4e-42df-49c5-be36-ac0be9689492 None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:33.772021 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1220fe4e-42df-49c5-be36-ac0be9689492 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:33.772293 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1220fe4e-42df-49c5-be36-ac0be9689492 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:33.783376 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:33.784989 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1220fe4e-42df-49c5-be36-ac0be9689492 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:33.787218 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1220fe4e-42df-49c5-be36-ac0be9689492 None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:33.806677 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application [None req-1220fe4e-42df-49c5-be36-ac0be9689492 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:33:33.806677 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:33:33.806677 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:33:33.806677 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:33:33.806677 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:33:33.806677 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:33:33.806677 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:33:33.806677 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:33:33.806677 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:33:33.806677 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:33:33.806677 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:33:33.806677 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:33:33.806677 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 05:33:33.806677 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 05:33:33.806677 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 05:33:33.806677 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 05:33:33.807696 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:33:33.807696 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:33:33.807696 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:33:33.807696 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:33:33.807696 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:33:33.807696 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:33:33.807696 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:33:33.807696 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application with Lock( Aug 24 05:33:33.807696 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:33:33.807696 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:33:33.807696 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:33:33.807696 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:33:33.807696 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:33:33.807696 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:33:33.807696 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:33:33.807696 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:33:33.807696 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 05:33:33.808680 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 05:33:33.808680 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:33:33.808680 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Aug 24 05:33:33.812675 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 299/597] 10.222.0.26 () {56 vars in 1108 bytes} [Wed Aug 24 05:33:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:33:33.813275 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1b4227-6f2c-4b41-a36e-ae8fb302dc4e None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:33.813573 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1220fe4e-42df-49c5-be36-ac0be9689492 None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:33.837226 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:33.857310 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4475f30b-9294-49d3-af22-466f868395b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:33.858725 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4475f30b-9294-49d3-af22-466f868395b4 None admin] REQUEST_METHOD: `PUT` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:33.859009 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4475f30b-9294-49d3-af22-466f868395b4 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:33.859282 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4475f30b-9294-49d3-af22-466f868395b4 None admin] PATH_INFO: `/v3/projects/ded4fe81d4dc43188dd84e53025ee783/users/7f856958add7474a989325cea7b1b224/roles/59fa3749ca7f47e2ba1127945e13336c` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:33.879533 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4475f30b-9294-49d3-af22-466f868395b4 None admin] RBAC: Authorizing `identity:create_grant(project_id=ded4fe81d4dc43188dd84e53025ee783, user_id=7f856958add7474a989325cea7b1b224, role_id=59fa3749ca7f47e2ba1127945e13336c)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:33.881085 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4475f30b-9294-49d3-af22-466f868395b4 None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:33.898350 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 299/598] 10.222.0.26 () {58 vars in 1439 bytes} [Wed Aug 24 05:33:33 2022] PUT /identity/v3/projects/ded4fe81d4dc43188dd84e53025ee783/users/7f856958add7474a989325cea7b1b224/roles/59fa3749ca7f47e2ba1127945e13336c => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:33:33.899129 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4475f30b-9294-49d3-af22-466f868395b4 None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:33.941725 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1220fe4e-42df-49c5-be36-ac0be9689492 None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:34.017293 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b2d5be-8cc1-4c14-84ca-e7cee59c2896 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:34.017959 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b2d5be-8cc1-4c14-84ca-e7cee59c2896 None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:34.018445 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b2d5be-8cc1-4c14-84ca-e7cee59c2896 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:34.018719 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b2d5be-8cc1-4c14-84ca-e7cee59c2896 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:34.042248 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b2d5be-8cc1-4c14-84ca-e7cee59c2896 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:34.043746 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b2d5be-8cc1-4c14-84ca-e7cee59c2896 None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:34.058895 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4475f30b-9294-49d3-af22-466f868395b4 None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:34.090297 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:34.092319 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application [None req-c1b2d5be-8cc1-4c14-84ca-e7cee59c2896 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:33:34.092319 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:33:34.092319 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:33:34.092319 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:33:34.092319 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:33:34.092319 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:33:34.092319 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:33:34.092319 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:33:34.092319 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:33:34.092319 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:33:34.092319 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:33:34.092319 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:33:34.092319 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 05:33:34.092319 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 05:33:34.092319 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 05:33:34.092319 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 05:33:34.093421 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:33:34.093421 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:33:34.093421 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:33:34.093421 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:33:34.093421 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:33:34.093421 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:33:34.093421 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:33:34.093421 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application with Lock( Aug 24 05:33:34.093421 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:33:34.093421 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:33:34.093421 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:33:34.093421 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:33:34.093421 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:33:34.093421 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:33:34.093421 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:33:34.093421 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:33:34.093421 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 05:33:34.094409 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 05:33:34.094409 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:33:34.094409 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Aug 24 05:33:34.094409 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 300/599] 10.222.0.26 () {56 vars in 1108 bytes} [Wed Aug 24 05:33:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:33:34.100439 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b2d5be-8cc1-4c14-84ca-e7cee59c2896 None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:34.102496 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642ba53f-5d57-45bf-b925-1d8027562463 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:34.103443 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642ba53f-5d57-45bf-b925-1d8027562463 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:34.103726 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642ba53f-5d57-45bf-b925-1d8027562463 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:34.103998 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642ba53f-5d57-45bf-b925-1d8027562463 None admin] PATH_INFO: `/v3/domains` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:34.105702 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642ba53f-5d57-45bf-b925-1d8027562463 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:33:34.106040 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642ba53f-5d57-45bf-b925-1d8027562463 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:34.107425 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642ba53f-5d57-45bf-b925-1d8027562463 None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:34.123641 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 300/600] 10.222.0.26 () {56 vars in 1109 bytes} [Wed Aug 24 05:33:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:33:34.130159 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642ba53f-5d57-45bf-b925-1d8027562463 None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:34.206957 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:34.252937 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642ba53f-5d57-45bf-b925-1d8027562463 None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:34.273590 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b2d5be-8cc1-4c14-84ca-e7cee59c2896 None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:34.299438 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7d29b3-c9c8-4b38-bf8c-e09fb54843f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:34.300076 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7d29b3-c9c8-4b38-bf8c-e09fb54843f3 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:34.300352 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7d29b3-c9c8-4b38-bf8c-e09fb54843f3 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:34.300619 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7d29b3-c9c8-4b38-bf8c-e09fb54843f3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:34.313424 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7d29b3-c9c8-4b38-bf8c-e09fb54843f3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:34.314934 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7d29b3-c9c8-4b38-bf8c-e09fb54843f3 None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:34.335917 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application [None req-cb7d29b3-c9c8-4b38-bf8c-e09fb54843f3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 05:33:34.335917 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:33:34.335917 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:33:34.335917 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:33:34.335917 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:33:34.335917 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:33:34.335917 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:33:34.335917 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:33:34.335917 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:33:34.335917 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:33:34.335917 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:33:34.335917 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:33:34.335917 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 05:33:34.335917 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 05:33:34.335917 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 05:33:34.338120 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 05:33:34.338120 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:33:34.338120 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:33:34.338120 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:33:34.338120 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:33:34.338120 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:33:34.338120 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:33:34.338120 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:33:34.338120 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application with Lock( Aug 24 05:33:34.338120 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:33:34.338120 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:33:34.338120 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:33:34.338120 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:33:34.338120 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:33:34.338120 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:33:34.338120 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:33:34.338120 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:33:34.340195 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 05:33:34.340195 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 05:33:34.340195 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 05:33:34.340195 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 05:33:34.340195 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 05:33:34.340195 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 05:33:34.340195 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 05:33:34.340195 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Aug 24 05:33:34.341181 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2a3d6f-a0d6-4330-b6f0-0815e231a8e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:34.341357 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 301/601] 10.222.0.26 () {56 vars in 1111 bytes} [Wed Aug 24 05:33:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 05:33:34.341497 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2a3d6f-a0d6-4330-b6f0-0815e231a8e0 None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:34.341497 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2a3d6f-a0d6-4330-b6f0-0815e231a8e0 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:34.341497 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2a3d6f-a0d6-4330-b6f0-0815e231a8e0 None admin] PATH_INFO: `/v3/domains` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:34.341497 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2a3d6f-a0d6-4330-b6f0-0815e231a8e0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:33:34.341497 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2a3d6f-a0d6-4330-b6f0-0815e231a8e0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:34.341497 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2a3d6f-a0d6-4330-b6f0-0815e231a8e0 None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:34.345971 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369a75ac-893a-4a1c-93d7-2abb496fc938 None None] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:34.345971 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369a75ac-893a-4a1c-93d7-2abb496fc938 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:34.345971 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369a75ac-893a-4a1c-93d7-2abb496fc938 None None] PATH_INFO: `/` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:34.345971 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 302/602] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 24 05:33:34 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:33:34.346984 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369a75ac-893a-4a1c-93d7-2abb496fc938 None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:34.360774 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 301/603] 10.222.0.26 () {56 vars in 1109 bytes} [Wed Aug 24 05:33:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:33:34.362479 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029b7fd8-5401-431d-b7fc-5c07b2555ce8 None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:34.363093 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029b7fd8-5401-431d-b7fc-5c07b2555ce8 None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:34.363372 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029b7fd8-5401-431d-b7fc-5c07b2555ce8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:34.385622 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-029b7fd8-5401-431d-b7fc-5c07b2555ce8 None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:33:34.386860 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-029b7fd8-5401-431d-b7fc-5c07b2555ce8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:33:34.418330 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:34.469416 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 302/604] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 24 05:33:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 05:33:34.470813 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029b7fd8-5401-431d-b7fc-5c07b2555ce8 None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:34.499157 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369a75ac-893a-4a1c-93d7-2abb496fc938 None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:34.580132 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef9ebdf-f348-4392-b5ce-6511d7d8ddb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:34.580739 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef9ebdf-f348-4392-b5ce-6511d7d8ddb8 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:34.581067 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef9ebdf-f348-4392-b5ce-6511d7d8ddb8 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:34.582541 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef9ebdf-f348-4392-b5ce-6511d7d8ddb8 None admin] PATH_INFO: `/v3/projects` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:34.583230 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef9ebdf-f348-4392-b5ce-6511d7d8ddb8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:33:34.583536 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef9ebdf-f348-4392-b5ce-6511d7d8ddb8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:34.584987 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef9ebdf-f348-4392-b5ce-6511d7d8ddb8 None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:34.586706 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:34.615274 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 303/605] 10.222.0.26 () {56 vars in 1148 bytes} [Wed Aug 24 05:33:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:33:34.623168 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef9ebdf-f348-4392-b5ce-6511d7d8ddb8 None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:34.654309 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029b7fd8-5401-431d-b7fc-5c07b2555ce8 None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:34.698550 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810a9948-88d0-4596-a1c7-0dd47b1d5df8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:34.699282 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810a9948-88d0-4596-a1c7-0dd47b1d5df8 None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:34.699571 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810a9948-88d0-4596-a1c7-0dd47b1d5df8 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:34.699842 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810a9948-88d0-4596-a1c7-0dd47b1d5df8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:34.709317 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810a9948-88d0-4596-a1c7-0dd47b1d5df8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:34.710798 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810a9948-88d0-4596-a1c7-0dd47b1d5df8 None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:34.736186 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application [None req-810a9948-88d0-4596-a1c7-0dd47b1d5df8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 05:33:34.736186 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:33:34.736186 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:33:34.736186 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:33:34.736186 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:33:34.736186 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:33:34.736186 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:33:34.736186 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:33:34.736186 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:33:34.736186 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:33:34.736186 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:33:34.736186 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:33:34.736186 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 05:33:34.736186 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 05:33:34.736186 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 05:33:34.737108 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 05:33:34.737108 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:33:34.737108 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:33:34.737108 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:33:34.737108 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:33:34.737108 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:33:34.737108 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:33:34.737108 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:33:34.737108 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application with Lock( Aug 24 05:33:34.737108 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:33:34.737108 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:33:34.737108 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:33:34.737108 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:33:34.737108 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:33:34.737108 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:33:34.737108 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:33:34.737108 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:33:34.738434 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 05:33:34.738434 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 05:33:34.738434 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 05:33:34.738434 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 05:33:34.738434 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 05:33:34.738434 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 05:33:34.738434 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 05:33:34.738434 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Aug 24 05:33:34.740514 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 303/606] 10.222.0.26 () {56 vars in 1111 bytes} [Wed Aug 24 05:33:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:33:34.746987 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810a9948-88d0-4596-a1c7-0dd47b1d5df8 None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:34.759718 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef9ebdf-f348-4392-b5ce-6511d7d8ddb8 None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:34.779393 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:34.805511 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d66585-aadc-4c43-b688-eb9b664f08ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:34.806568 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d66585-aadc-4c43-b688-eb9b664f08ac None admin] REQUEST_METHOD: `PUT` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:34.807581 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d66585-aadc-4c43-b688-eb9b664f08ac None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:34.807934 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d66585-aadc-4c43-b688-eb9b664f08ac None admin] PATH_INFO: `/v3/projects/ded4fe81d4dc43188dd84e53025ee783/users/17b450afe795495680fc70f522c83750/roles/59fa3749ca7f47e2ba1127945e13336c` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:34.827496 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d66585-aadc-4c43-b688-eb9b664f08ac None admin] RBAC: Authorizing `identity:create_grant(project_id=ded4fe81d4dc43188dd84e53025ee783, user_id=17b450afe795495680fc70f522c83750, role_id=59fa3749ca7f47e2ba1127945e13336c)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:34.829183 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d66585-aadc-4c43-b688-eb9b664f08ac None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:34.846645 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 304/607] 10.222.0.26 () {58 vars in 1439 bytes} [Wed Aug 24 05:33:34 2022] PUT /identity/v3/projects/ded4fe81d4dc43188dd84e53025ee783/users/17b450afe795495680fc70f522c83750/roles/59fa3749ca7f47e2ba1127945e13336c => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:33:34.847703 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d66585-aadc-4c43-b688-eb9b664f08ac None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:34.877399 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810a9948-88d0-4596-a1c7-0dd47b1d5df8 None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:34.933595 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:34.961988 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea26406e-2e10-49de-a2a5-00901263cf38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:34.962627 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea26406e-2e10-49de-a2a5-00901263cf38 None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:34.962907 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea26406e-2e10-49de-a2a5-00901263cf38 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:34.963177 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea26406e-2e10-49de-a2a5-00901263cf38 None admin] PATH_INFO: `/v3/projects` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:34.963895 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea26406e-2e10-49de-a2a5-00901263cf38 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:33:34.964201 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea26406e-2e10-49de-a2a5-00901263cf38 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:34.966824 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea26406e-2e10-49de-a2a5-00901263cf38 None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:34.990246 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 304/608] 10.222.0.26 () {56 vars in 1148 bytes} [Wed Aug 24 05:33:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:33:35.001032 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea26406e-2e10-49de-a2a5-00901263cf38 None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:35.051269 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d66585-aadc-4c43-b688-eb9b664f08ac None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:35.097986 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8302358-78e9-444e-a0e7-f762daf34813 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:35.098994 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8302358-78e9-444e-a0e7-f762daf34813 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:35.099470 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8302358-78e9-444e-a0e7-f762daf34813 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:35.100440 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8302358-78e9-444e-a0e7-f762daf34813 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:35.115335 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8302358-78e9-444e-a0e7-f762daf34813 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:33:35.122485 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application [None req-a8302358-78e9-444e-a0e7-f762daf34813 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 05:33:35.122485 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:33:35.122485 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:33:35.122485 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:33:35.122485 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:33:35.122485 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:33:35.122485 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:33:35.122485 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:33:35.122485 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:33:35.122485 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:33:35.122485 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:33:35.122485 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:33:35.122485 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:33:35.122485 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:33:35.122485 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:33:35.122485 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:33:35.123464 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:33:35.123464 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:33:35.123464 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:33:35.123464 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:33:35.123464 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:33:35.123464 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:33:35.123464 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:33:35.123464 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:33:35.123464 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:33:35.123464 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:33:35.123464 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:33:35.123464 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application with Lock( Aug 24 05:33:35.123464 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:33:35.123464 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:33:35.123464 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:33:35.123464 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:33:35.124295 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:33:35.124295 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:33:35.124295 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:33:35.124295 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:33:35.124295 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:33:35.124295 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:33:35.124295 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:33:35.124295 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:33:35.124295 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:33:35.124295 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:33:35.124295 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 05:33:35.124295 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Aug 24 05:33:35.124295 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 305/609] 10.222.0.26 () {56 vars in 1102 bytes} [Wed Aug 24 05:33:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:33:35.130900 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8302358-78e9-444e-a0e7-f762daf34813 None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:35.133232 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea26406e-2e10-49de-a2a5-00901263cf38 None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:35.172774 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533f685d-3454-4c44-808b-c5c20fd12a2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:35.174379 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533f685d-3454-4c44-808b-c5c20fd12a2d None admin] REQUEST_METHOD: `PUT` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:35.174856 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533f685d-3454-4c44-808b-c5c20fd12a2d None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:35.175336 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533f685d-3454-4c44-808b-c5c20fd12a2d None admin] PATH_INFO: `/v3/projects/ded4fe81d4dc43188dd84e53025ee783/users/874348b647194ac2b5ecbf12c33bf59e/roles/59fa3749ca7f47e2ba1127945e13336c` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:35.189239 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:35.194169 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533f685d-3454-4c44-808b-c5c20fd12a2d None admin] RBAC: Authorizing `identity:create_grant(project_id=ded4fe81d4dc43188dd84e53025ee783, user_id=874348b647194ac2b5ecbf12c33bf59e, role_id=59fa3749ca7f47e2ba1127945e13336c)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:35.195954 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533f685d-3454-4c44-808b-c5c20fd12a2d None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:35.212425 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 305/610] 10.222.0.26 () {58 vars in 1439 bytes} [Wed Aug 24 05:33:35 2022] PUT /identity/v3/projects/ded4fe81d4dc43188dd84e53025ee783/users/874348b647194ac2b5ecbf12c33bf59e/roles/59fa3749ca7f47e2ba1127945e13336c => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:33:35.294297 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8302358-78e9-444e-a0e7-f762daf34813 None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:35.334498 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af47b053-c259-4418-95e2-87707d92f7c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:35.335503 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af47b053-c259-4418-95e2-87707d92f7c9 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:35.336011 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af47b053-c259-4418-95e2-87707d92f7c9 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:35.336475 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af47b053-c259-4418-95e2-87707d92f7c9 None admin] PATH_INFO: `/v3/roles` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:35.337363 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af47b053-c259-4418-95e2-87707d92f7c9 None admin] RBAC: Adding query filter params (name=service) {{(pid=88113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:33:35.337864 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af47b053-c259-4418-95e2-87707d92f7c9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:35.339505 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af47b053-c259-4418-95e2-87707d92f7c9 None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:35.349689 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 306/611] 10.222.0.26 () {56 vars in 1103 bytes} [Wed Aug 24 05:33:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:33:35.359142 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533f685d-3454-4c44-808b-c5c20fd12a2d None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:35.391031 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aed2ac9-a596-4e41-8b9d-a076995fdd99 None None] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:35.391350 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aed2ac9-a596-4e41-8b9d-a076995fdd99 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:35.391656 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aed2ac9-a596-4e41-8b9d-a076995fdd99 None None] PATH_INFO: `/` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:35.393487 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 307/612] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 24 05:33:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:33:35.399086 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805e47d0-ab43-4aa0-a644-10b0751d60ae None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:35.399366 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805e47d0-ab43-4aa0-a644-10b0751d60ae None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:35.399647 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805e47d0-ab43-4aa0-a644-10b0751d60ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:35.408503 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:35.420683 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-805e47d0-ab43-4aa0-a644-10b0751d60ae None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:33:35.421914 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-805e47d0-ab43-4aa0-a644-10b0751d60ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:33:35.504272 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533f685d-3454-4c44-808b-c5c20fd12a2d None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:35.514117 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 308/613] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 24 05:33:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 05:33:35.575169 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b84fd3e-f897-4768-98a0-e4253f4345a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:35.575728 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b84fd3e-f897-4768-98a0-e4253f4345a4 None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:35.576009 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b84fd3e-f897-4768-98a0-e4253f4345a4 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:35.576279 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b84fd3e-f897-4768-98a0-e4253f4345a4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:35.597309 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b84fd3e-f897-4768-98a0-e4253f4345a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:35.598793 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b84fd3e-f897-4768-98a0-e4253f4345a4 None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:35.621645 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application [None req-0b84fd3e-f897-4768-98a0-e4253f4345a4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:33:35.621645 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:33:35.621645 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:33:35.621645 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:33:35.621645 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:33:35.621645 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:33:35.621645 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:33:35.621645 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:33:35.621645 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:33:35.621645 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:33:35.621645 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:33:35.621645 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:33:35.621645 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 05:33:35.621645 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 05:33:35.621645 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 05:33:35.621645 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 05:33:35.622608 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:33:35.622608 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:33:35.622608 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:33:35.622608 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:33:35.622608 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:33:35.622608 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:33:35.622608 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:33:35.622608 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application with Lock( Aug 24 05:33:35.622608 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:33:35.622608 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:33:35.622608 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:33:35.622608 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:33:35.622608 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:33:35.622608 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:33:35.622608 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:33:35.622608 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:33:35.622608 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 05:33:35.623474 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 05:33:35.623474 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:33:35.623474 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Aug 24 05:33:35.623474 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 306/614] 10.222.0.26 () {56 vars in 1108 bytes} [Wed Aug 24 05:33:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:33:35.628517 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805e47d0-ab43-4aa0-a644-10b0751d60ae None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:35.652786 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:35.772199 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805e47d0-ab43-4aa0-a644-10b0751d60ae None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:35.817713 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5063cf-6743-48ba-9051-7669b5df5310 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:35.818360 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5063cf-6743-48ba-9051-7669b5df5310 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:35.818644 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5063cf-6743-48ba-9051-7669b5df5310 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:35.818917 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5063cf-6743-48ba-9051-7669b5df5310 None admin] PATH_INFO: `/v3/domains` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:35.819570 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5063cf-6743-48ba-9051-7669b5df5310 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:33:35.819874 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5063cf-6743-48ba-9051-7669b5df5310 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:35.821256 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5063cf-6743-48ba-9051-7669b5df5310 None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:35.839160 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 309/615] 10.222.0.26 () {56 vars in 1109 bytes} [Wed Aug 24 05:33:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:33:35.844349 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b84fd3e-f897-4768-98a0-e4253f4345a4 None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:35.879317 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5063cf-6743-48ba-9051-7669b5df5310 None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:36.002332 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:36.031933 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b84fd3e-f897-4768-98a0-e4253f4345a4 None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:36.040586 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5063cf-6743-48ba-9051-7669b5df5310 None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:36.058380 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:36.093511 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498fc5f0-25c0-49a0-8cde-52b45fb38fe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:36.094094 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498fc5f0-25c0-49a0-8cde-52b45fb38fe4 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:36.094379 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498fc5f0-25c0-49a0-8cde-52b45fb38fe4 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:36.094675 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498fc5f0-25c0-49a0-8cde-52b45fb38fe4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:36.112667 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e34bf6-b5f8-4f58-9ea3-77cb9a048421 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:36.113309 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e34bf6-b5f8-4f58-9ea3-77cb9a048421 None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:36.113592 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e34bf6-b5f8-4f58-9ea3-77cb9a048421 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:36.113865 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e34bf6-b5f8-4f58-9ea3-77cb9a048421 None admin] PATH_INFO: `/v3/users/swift` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:36.118480 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498fc5f0-25c0-49a0-8cde-52b45fb38fe4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:33:36.123734 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application [None req-498fc5f0-25c0-49a0-8cde-52b45fb38fe4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 05:33:36.123734 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:33:36.123734 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:33:36.123734 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:33:36.123734 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:33:36.123734 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:33:36.123734 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:33:36.123734 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:33:36.123734 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:33:36.123734 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:33:36.123734 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:33:36.123734 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:33:36.123734 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:33:36.123734 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:33:36.123734 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:33:36.123734 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:33:36.124658 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:33:36.124658 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:33:36.124658 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:33:36.124658 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:33:36.124658 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:33:36.124658 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:33:36.124658 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:33:36.124658 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:33:36.124658 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:33:36.124658 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:33:36.124658 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:33:36.124658 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application with Lock( Aug 24 05:33:36.124658 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:33:36.124658 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:33:36.124658 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:33:36.124658 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:33:36.125866 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:33:36.125866 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:33:36.125866 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:33:36.125866 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:33:36.125866 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:33:36.125866 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:33:36.125866 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:33:36.125866 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:33:36.125866 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:33:36.125866 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:33:36.125866 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 05:33:36.125866 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Aug 24 05:33:36.125866 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 310/616] 10.222.0.26 () {56 vars in 1102 bytes} [Wed Aug 24 05:33:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:33:36.131894 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e34bf6-b5f8-4f58-9ea3-77cb9a048421 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:36.133344 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e34bf6-b5f8-4f58-9ea3-77cb9a048421 None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:36.134665 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498fc5f0-25c0-49a0-8cde-52b45fb38fe4 None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:36.156972 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application [None req-32e34bf6-b5f8-4f58-9ea3-77cb9a048421 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 24 05:33:36.156972 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:33:36.156972 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:33:36.156972 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:33:36.156972 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:33:36.156972 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:33:36.156972 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:33:36.156972 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:33:36.156972 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:33:36.156972 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:33:36.156972 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:33:36.156972 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:33:36.156972 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 05:33:36.156972 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 05:33:36.156972 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 05:33:36.156972 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 05:33:36.159355 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:33:36.159355 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:33:36.159355 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 05:33:36.159355 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 05:33:36.159355 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 05:33:36.159355 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 05:33:36.159355 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:33:36.159355 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:33:36.159355 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:33:36.159355 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:33:36.159355 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:33:36.159355 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application with Lock( Aug 24 05:33:36.159355 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:33:36.159355 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:33:36.159355 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:33:36.159355 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:33:36.159355 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:33:36.159355 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:33:36.161585 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:33:36.161585 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:33:36.161585 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 05:33:36.161585 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 05:33:36.161585 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 05:33:36.161585 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 05:33:36.161585 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 05:33:36.161585 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 05:33:36.161585 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 24 05:33:36.161585 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Aug 24 05:33:36.161585 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 307/617] 10.222.0.26 () {56 vars in 1096 bytes} [Wed Aug 24 05:33:35 2022] GET /identity/v3/users/swift => generated 83 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:33:36.170001 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e34bf6-b5f8-4f58-9ea3-77cb9a048421 None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:36.336397 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e34bf6-b5f8-4f58-9ea3-77cb9a048421 None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:36.349214 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498fc5f0-25c0-49a0-8cde-52b45fb38fe4 None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:36.394370 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:36.396880 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dd4137-40a2-40a9-a17f-16018c94c0d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:36.397610 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dd4137-40a2-40a9-a17f-16018c94c0d4 None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:36.397895 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dd4137-40a2-40a9-a17f-16018c94c0d4 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:36.398780 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dd4137-40a2-40a9-a17f-16018c94c0d4 None admin] PATH_INFO: `/v3/users` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:36.399719 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09dd4137-40a2-40a9-a17f-16018c94c0d4 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=88112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:33:36.399897 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ace672-ec22-4e33-b479-2fa87422fdbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:36.400024 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09dd4137-40a2-40a9-a17f-16018c94c0d4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:36.400470 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ace672-ec22-4e33-b479-2fa87422fdbb None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:36.400749 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ace672-ec22-4e33-b479-2fa87422fdbb None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:36.401021 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ace672-ec22-4e33-b479-2fa87422fdbb None admin] PATH_INFO: `/v3/roles` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:36.401426 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09dd4137-40a2-40a9-a17f-16018c94c0d4 None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:36.401688 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ace672-ec22-4e33-b479-2fa87422fdbb None admin] RBAC: Adding query filter params (name=service) {{(pid=88113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:33:36.402035 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ace672-ec22-4e33-b479-2fa87422fdbb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:36.403411 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ace672-ec22-4e33-b479-2fa87422fdbb None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:36.412451 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 311/618] 10.222.0.26 () {56 vars in 1103 bytes} [Wed Aug 24 05:33:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:33:36.413723 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8067f0-b87a-4a41-8dd1-c60efa8b4cbb None None] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:36.414043 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8067f0-b87a-4a41-8dd1-c60efa8b4cbb None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:36.414322 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8067f0-b87a-4a41-8dd1-c60efa8b4cbb None None] PATH_INFO: `/` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:36.415752 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 312/619] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 24 05:33:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:33:36.417235 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8067f0-b87a-4a41-8dd1-c60efa8b4cbb None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:36.429860 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 308/620] 10.222.0.26 () {56 vars in 1135 bytes} [Wed Aug 24 05:33:36 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:33:36.431155 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fd83e6-1807-48e1-bad3-bd3bf86726bd None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:36.431442 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fd83e6-1807-48e1-bad3-bd3bf86726bd None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:36.431715 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fd83e6-1807-48e1-bad3-bd3bf86726bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:36.438191 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:36.451805 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-a8fd83e6-1807-48e1-bad3-bd3bf86726bd None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:33:36.453005 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-a8fd83e6-1807-48e1-bad3-bd3bf86726bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:33:36.535949 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 309/621] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 24 05:33:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 05:33:36.536934 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fd83e6-1807-48e1-bad3-bd3bf86726bd None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:36.562651 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8067f0-b87a-4a41-8dd1-c60efa8b4cbb None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:36.646826 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22076e87-35fc-4622-9449-19f1eeb91fd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:36.647865 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22076e87-35fc-4622-9449-19f1eeb91fd2 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:36.648297 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22076e87-35fc-4622-9449-19f1eeb91fd2 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:36.648716 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22076e87-35fc-4622-9449-19f1eeb91fd2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:36.670521 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22076e87-35fc-4622-9449-19f1eeb91fd2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:36.672255 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22076e87-35fc-4622-9449-19f1eeb91fd2 None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:36.683367 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fd83e6-1807-48e1-bad3-bd3bf86726bd None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:36.707206 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application [None req-22076e87-35fc-4622-9449-19f1eeb91fd2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:33:36.707206 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:33:36.707206 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:33:36.707206 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:33:36.707206 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:33:36.707206 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:33:36.707206 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:33:36.707206 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:33:36.707206 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:33:36.707206 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:33:36.707206 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:33:36.707206 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:33:36.707206 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 05:33:36.707206 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 05:33:36.707206 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 05:33:36.707206 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 05:33:36.708214 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:33:36.708214 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:33:36.708214 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:33:36.708214 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:33:36.708214 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:33:36.708214 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:33:36.708214 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:33:36.708214 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application with Lock( Aug 24 05:33:36.708214 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:33:36.708214 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:33:36.708214 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:33:36.708214 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:33:36.708214 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:33:36.708214 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:33:36.708214 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:33:36.708214 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:33:36.708214 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 05:33:36.709134 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 05:33:36.709134 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:33:36.709134 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Aug 24 05:33:36.714059 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 313/622] 10.222.0.26 () {56 vars in 1108 bytes} [Wed Aug 24 05:33:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 05:33:36.718863 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22076e87-35fc-4622-9449-19f1eeb91fd2 None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:36.721852 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:36.729927 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09b441a-3ed7-460e-90c3-c2b6b04fc1f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:36.730573 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09b441a-3ed7-460e-90c3-c2b6b04fc1f6 None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:36.730847 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09b441a-3ed7-460e-90c3-c2b6b04fc1f6 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:36.731114 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09b441a-3ed7-460e-90c3-c2b6b04fc1f6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:36.746339 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09b441a-3ed7-460e-90c3-c2b6b04fc1f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:36.748177 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09b441a-3ed7-460e-90c3-c2b6b04fc1f6 None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:36.762826 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application [None req-b09b441a-3ed7-460e-90c3-c2b6b04fc1f6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:33:36.762826 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:33:36.762826 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:33:36.762826 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:33:36.762826 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:33:36.762826 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:33:36.762826 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:33:36.762826 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:33:36.762826 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:33:36.762826 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:33:36.762826 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:33:36.762826 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:33:36.762826 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 05:33:36.762826 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 05:33:36.762826 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 05:33:36.762826 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 05:33:36.763810 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:33:36.763810 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:33:36.763810 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:33:36.763810 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:33:36.763810 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:33:36.763810 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:33:36.763810 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:33:36.763810 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application with Lock( Aug 24 05:33:36.763810 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:33:36.763810 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:33:36.763810 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:33:36.763810 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:33:36.763810 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:33:36.763810 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:33:36.763810 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:33:36.763810 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:33:36.763810 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 05:33:36.764685 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 05:33:36.764685 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:33:36.764685 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Aug 24 05:33:36.764685 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 310/623] 10.222.0.26 () {56 vars in 1108 bytes} [Wed Aug 24 05:33:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:33:36.770132 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09b441a-3ed7-460e-90c3-c2b6b04fc1f6 None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:36.791380 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:36.850682 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22076e87-35fc-4622-9449-19f1eeb91fd2 None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:36.888479 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d9a6f4-4083-499d-90ae-7c82757affc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:36.889464 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d9a6f4-4083-499d-90ae-7c82757affc7 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:36.889972 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d9a6f4-4083-499d-90ae-7c82757affc7 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:36.890452 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d9a6f4-4083-499d-90ae-7c82757affc7 None admin] PATH_INFO: `/v3/domains` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:36.891364 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d9a6f4-4083-499d-90ae-7c82757affc7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:33:36.891961 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d9a6f4-4083-499d-90ae-7c82757affc7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:36.893551 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d9a6f4-4083-499d-90ae-7c82757affc7 None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:36.906819 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 314/624] 10.222.0.26 () {56 vars in 1109 bytes} [Wed Aug 24 05:33:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:33:36.915268 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d9a6f4-4083-499d-90ae-7c82757affc7 None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:36.938479 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09b441a-3ed7-460e-90c3-c2b6b04fc1f6 None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:36.997569 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8c25fc-681b-4784-8f88-28ef0d2233eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:36.998602 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8c25fc-681b-4784-8f88-28ef0d2233eb None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:36.999513 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8c25fc-681b-4784-8f88-28ef0d2233eb None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:37.000014 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8c25fc-681b-4784-8f88-28ef0d2233eb None admin] PATH_INFO: `/v3/domains` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:37.001315 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8c25fc-681b-4784-8f88-28ef0d2233eb None admin] RBAC: Adding query filter params (name=Default) {{(pid=88112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:33:37.002093 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8c25fc-681b-4784-8f88-28ef0d2233eb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:37.003948 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8c25fc-681b-4784-8f88-28ef0d2233eb None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:37.022124 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 311/625] 10.222.0.26 () {56 vars in 1109 bytes} [Wed Aug 24 05:33:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:33:37.023294 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8c25fc-681b-4784-8f88-28ef0d2233eb None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:37.061548 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d9a6f4-4083-499d-90ae-7c82757affc7 None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:37.071169 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:37.090288 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:37.104109 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e52609-cce0-41d3-a15d-c048bf71c543 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:37.104737 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e52609-cce0-41d3-a15d-c048bf71c543 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:37.105011 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e52609-cce0-41d3-a15d-c048bf71c543 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:37.105277 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e52609-cce0-41d3-a15d-c048bf71c543 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:37.113317 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e52609-cce0-41d3-a15d-c048bf71c543 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:37.114868 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e52609-cce0-41d3-a15d-c048bf71c543 None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:37.128043 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application [None req-79e52609-cce0-41d3-a15d-c048bf71c543 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 05:33:37.128043 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:33:37.128043 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:33:37.128043 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:33:37.128043 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:33:37.128043 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:33:37.128043 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:33:37.128043 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:33:37.128043 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:33:37.128043 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:33:37.128043 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:33:37.128043 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:33:37.128043 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 05:33:37.128043 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 05:33:37.128043 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 05:33:37.128043 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 05:33:37.129052 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:33:37.129052 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:33:37.129052 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 05:33:37.129052 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 05:33:37.129052 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 05:33:37.129052 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 05:33:37.129052 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:33:37.129052 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:33:37.129052 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:33:37.129052 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:33:37.129052 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:33:37.129052 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application with Lock( Aug 24 05:33:37.129052 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:33:37.129052 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:33:37.129052 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:33:37.129052 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:33:37.129052 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:33:37.129052 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:33:37.130437 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:33:37.130437 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:33:37.130437 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 05:33:37.130437 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 05:33:37.130437 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 05:33:37.130437 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 05:33:37.130437 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 05:33:37.130437 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 05:33:37.130437 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 05:33:37.130437 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Aug 24 05:33:37.130437 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 315/626] 10.222.0.26 () {56 vars in 1093 bytes} [Wed Aug 24 05:33:36 2022] GET /identity/v3/users/nova => generated 82 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:33:37.131046 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e52609-cce0-41d3-a15d-c048bf71c543 None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:37.156549 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8c25fc-681b-4784-8f88-28ef0d2233eb None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:37.191172 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2898d6e-c0b1-4e29-896f-226132c71fd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:37.191725 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2898d6e-c0b1-4e29-896f-226132c71fd6 None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:37.192000 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2898d6e-c0b1-4e29-896f-226132c71fd6 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:37.192532 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2898d6e-c0b1-4e29-896f-226132c71fd6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:37.202413 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2898d6e-c0b1-4e29-896f-226132c71fd6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:33:37.207507 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application [None req-b2898d6e-c0b1-4e29-896f-226132c71fd6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 05:33:37.207507 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:33:37.207507 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:33:37.207507 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:33:37.207507 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:33:37.207507 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:33:37.207507 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:33:37.207507 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:33:37.207507 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:33:37.207507 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:33:37.207507 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:33:37.207507 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:33:37.207507 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:33:37.207507 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:33:37.207507 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:33:37.207507 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:33:37.208727 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:33:37.208727 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:33:37.208727 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:33:37.208727 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:33:37.208727 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:33:37.208727 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:33:37.208727 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:33:37.208727 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:33:37.208727 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:33:37.208727 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:33:37.208727 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:33:37.208727 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application with Lock( Aug 24 05:33:37.208727 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:33:37.208727 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:33:37.208727 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:33:37.208727 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:33:37.209732 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:33:37.209732 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:33:37.209732 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:33:37.209732 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:33:37.209732 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:33:37.209732 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:33:37.209732 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:33:37.209732 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:33:37.209732 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:33:37.209732 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:33:37.209732 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 05:33:37.209732 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Aug 24 05:33:37.213359 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 312/627] 10.222.0.26 () {56 vars in 1102 bytes} [Wed Aug 24 05:33:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:33:37.214622 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f58f3c-aa76-4ecd-abac-f31c6a069ebf None None] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:37.214902 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f58f3c-aa76-4ecd-abac-f31c6a069ebf None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:37.215170 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f58f3c-aa76-4ecd-abac-f31c6a069ebf None None] PATH_INFO: `/` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:37.216964 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 313/628] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 24 05:33:37 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:33:37.217083 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f58f3c-aa76-4ecd-abac-f31c6a069ebf None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:37.250713 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e52609-cce0-41d3-a15d-c048bf71c543 None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:37.286850 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019f2a43-35ee-4523-a74a-a2cd0ac048bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:37.287810 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019f2a43-35ee-4523-a74a-a2cd0ac048bd None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:37.288233 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019f2a43-35ee-4523-a74a-a2cd0ac048bd None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:37.288641 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019f2a43-35ee-4523-a74a-a2cd0ac048bd None admin] PATH_INFO: `/v3/projects/service` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:37.296016 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019f2a43-35ee-4523-a74a-a2cd0ac048bd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:37.297826 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019f2a43-35ee-4523-a74a-a2cd0ac048bd None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:37.309831 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application [None req-019f2a43-35ee-4523-a74a-a2cd0ac048bd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 05:33:37.309831 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:33:37.309831 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:33:37.309831 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:33:37.309831 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:33:37.309831 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:33:37.309831 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:33:37.309831 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:33:37.309831 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:33:37.309831 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:33:37.309831 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:33:37.309831 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:33:37.309831 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 05:33:37.309831 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 05:33:37.309831 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 05:33:37.310916 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 05:33:37.310916 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:33:37.310916 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:33:37.310916 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:33:37.310916 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:33:37.310916 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:33:37.310916 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:33:37.310916 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:33:37.310916 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application with Lock( Aug 24 05:33:37.310916 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:33:37.310916 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:33:37.310916 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:33:37.310916 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:33:37.310916 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:33:37.310916 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:33:37.310916 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:33:37.310916 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:33:37.312095 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 05:33:37.312095 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 05:33:37.312095 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 05:33:37.312095 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 05:33:37.312095 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 05:33:37.312095 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 05:33:37.312095 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 05:33:37.312095 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Aug 24 05:33:37.314082 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 316/629] 10.222.0.26 () {56 vars in 1111 bytes} [Wed Aug 24 05:33:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:33:37.314997 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019f2a43-35ee-4523-a74a-a2cd0ac048bd None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:37.323586 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f58f3c-aa76-4ecd-abac-f31c6a069ebf None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:37.325984 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:37.347188 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:37.365016 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a55d0f-072e-4c39-b6e7-1d4d71a5a605 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:37.366275 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a55d0f-072e-4c39-b6e7-1d4d71a5a605 None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:37.366771 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a55d0f-072e-4c39-b6e7-1d4d71a5a605 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:37.367242 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a55d0f-072e-4c39-b6e7-1d4d71a5a605 None admin] PATH_INFO: `/v3/users` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:37.368231 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a55d0f-072e-4c39-b6e7-1d4d71a5a605 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:33:37.368767 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a55d0f-072e-4c39-b6e7-1d4d71a5a605 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:37.370636 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a55d0f-072e-4c39-b6e7-1d4d71a5a605 None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:37.389327 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 314/630] 10.222.0.26 () {56 vars in 1133 bytes} [Wed Aug 24 05:33:37 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:33:37.390959 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc4f288-7e92-4215-a449-9d4744478b96 None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:37.391246 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc4f288-7e92-4215-a449-9d4744478b96 None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:37.392058 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc4f288-7e92-4215-a449-9d4744478b96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:37.411064 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-9bc4f288-7e92-4215-a449-9d4744478b96 None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:33:37.412548 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-9bc4f288-7e92-4215-a449-9d4744478b96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:33:37.426545 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019f2a43-35ee-4523-a74a-a2cd0ac048bd None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:37.461889 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21a4c13-17bb-404b-bf5e-0a61d02e3ba1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:37.462519 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21a4c13-17bb-404b-bf5e-0a61d02e3ba1 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:37.462801 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21a4c13-17bb-404b-bf5e-0a61d02e3ba1 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:37.463072 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21a4c13-17bb-404b-bf5e-0a61d02e3ba1 None admin] PATH_INFO: `/v3/roles` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:37.463739 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21a4c13-17bb-404b-bf5e-0a61d02e3ba1 None admin] RBAC: Adding query filter params (name=service) {{(pid=88113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:33:37.464044 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21a4c13-17bb-404b-bf5e-0a61d02e3ba1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:37.465409 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21a4c13-17bb-404b-bf5e-0a61d02e3ba1 None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:37.473788 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 317/631] 10.222.0.26 () {56 vars in 1103 bytes} [Wed Aug 24 05:33:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:33:37.474642 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21a4c13-17bb-404b-bf5e-0a61d02e3ba1 None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:37.483205 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 315/632] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 24 05:33:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 05:33:37.484041 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc4f288-7e92-4215-a449-9d4744478b96 None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:37.569635 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:37.584635 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21a4c13-17bb-404b-bf5e-0a61d02e3ba1 None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:37.586416 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:37.597834 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc4f288-7e92-4215-a449-9d4744478b96 None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:37.618275 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e75b58-fc81-40a2-8b0f-a3a48249513e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:37.618882 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e75b58-fc81-40a2-8b0f-a3a48249513e None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:37.619164 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e75b58-fc81-40a2-8b0f-a3a48249513e None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:37.619438 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e75b58-fc81-40a2-8b0f-a3a48249513e None admin] PATH_INFO: `/v3/projects` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:37.620123 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e75b58-fc81-40a2-8b0f-a3a48249513e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:33:37.620424 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e75b58-fc81-40a2-8b0f-a3a48249513e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:37.621847 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e75b58-fc81-40a2-8b0f-a3a48249513e None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:37.634360 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 318/633] 10.222.0.26 () {56 vars in 1148 bytes} [Wed Aug 24 05:33:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:33:37.634658 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53a43c7-1d0a-4a4d-8fbc-48f2a850093b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:37.635487 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53a43c7-1d0a-4a4d-8fbc-48f2a850093b None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:37.635594 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d30338-6944-47aa-ab37-f8ee181c3572 None None] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:37.635799 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d30338-6944-47aa-ab37-f8ee181c3572 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:37.636070 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d30338-6944-47aa-ab37-f8ee181c3572 None None] PATH_INFO: `/` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:37.636293 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53a43c7-1d0a-4a4d-8fbc-48f2a850093b None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:37.636693 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53a43c7-1d0a-4a4d-8fbc-48f2a850093b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:37.641294 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 319/634] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 24 05:33:37 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:33:37.642705 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d30338-6944-47aa-ab37-f8ee181c3572 None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:37.711634 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53a43c7-1d0a-4a4d-8fbc-48f2a850093b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:37.713144 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53a43c7-1d0a-4a4d-8fbc-48f2a850093b None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:37.745583 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d30338-6944-47aa-ab37-f8ee181c3572 None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:37.780238 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc9e511-520f-445c-9e07-137a1b54c86a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:37.780855 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc9e511-520f-445c-9e07-137a1b54c86a None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:37.781129 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc9e511-520f-445c-9e07-137a1b54c86a None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:37.781391 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc9e511-520f-445c-9e07-137a1b54c86a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:37.791269 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc9e511-520f-445c-9e07-137a1b54c86a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:37.792713 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc9e511-520f-445c-9e07-137a1b54c86a None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:37.801343 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:37.801575 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:37.807945 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application [None req-cdc9e511-520f-445c-9e07-137a1b54c86a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:33:37.807945 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:33:37.807945 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:33:37.807945 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:33:37.807945 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:33:37.807945 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:33:37.807945 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:33:37.807945 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:33:37.807945 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:33:37.807945 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:33:37.807945 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:33:37.807945 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:33:37.807945 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 05:33:37.807945 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 05:33:37.807945 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 05:33:37.807945 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 05:33:37.808911 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:33:37.808911 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:33:37.808911 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:33:37.808911 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:33:37.808911 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:33:37.808911 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:33:37.808911 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:33:37.808911 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application with Lock( Aug 24 05:33:37.808911 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:33:37.808911 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:33:37.808911 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:33:37.808911 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:33:37.808911 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:33:37.808911 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:33:37.808911 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:33:37.808911 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:33:37.808911 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 05:33:37.809802 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 05:33:37.809802 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:33:37.809802 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Aug 24 05:33:37.816774 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 316/635] 10.222.0.26 () {58 vars in 1282 bytes} [Wed Aug 24 05:33:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 05:33:37.816774 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53a43c7-1d0a-4a4d-8fbc-48f2a850093b None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:37.817014 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 320/636] 10.222.0.26 () {56 vars in 1108 bytes} [Wed Aug 24 05:33:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:33:37.817014 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a995d6-febc-469d-bd61-e73166858ff0 None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:37.817014 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a995d6-febc-469d-bd61-e73166858ff0 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:37.817014 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a995d6-febc-469d-bd61-e73166858ff0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:37.833832 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-81a995d6-febc-469d-bd61-e73166858ff0 None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:33:37.835068 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-81a995d6-febc-469d-bd61-e73166858ff0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:33:37.899915 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 321/637] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 24 05:33:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 05:33:37.900756 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a995d6-febc-469d-bd61-e73166858ff0 None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:37.921304 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53a43c7-1d0a-4a4d-8fbc-48f2a850093b None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:37.957096 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fab3f3-39ea-413a-9a2f-c9ed1a4d2a33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:37.957745 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fab3f3-39ea-413a-9a2f-c9ed1a4d2a33 None admin] REQUEST_METHOD: `PUT` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:37.958047 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fab3f3-39ea-413a-9a2f-c9ed1a4d2a33 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:37.958319 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fab3f3-39ea-413a-9a2f-c9ed1a4d2a33 None admin] PATH_INFO: `/v3/projects/ded4fe81d4dc43188dd84e53025ee783/users/87ff96222a7c4baea31fc1bebf4d89a9/roles/59fa3749ca7f47e2ba1127945e13336c` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:37.972982 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fab3f3-39ea-413a-9a2f-c9ed1a4d2a33 None admin] RBAC: Authorizing `identity:create_grant(project_id=ded4fe81d4dc43188dd84e53025ee783, user_id=87ff96222a7c4baea31fc1bebf4d89a9, role_id=59fa3749ca7f47e2ba1127945e13336c)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:37.975252 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fab3f3-39ea-413a-9a2f-c9ed1a4d2a33 None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:37.997982 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 317/638] 10.222.0.26 () {58 vars in 1439 bytes} [Wed Aug 24 05:33:37 2022] PUT /identity/v3/projects/ded4fe81d4dc43188dd84e53025ee783/users/87ff96222a7c4baea31fc1bebf4d89a9/roles/59fa3749ca7f47e2ba1127945e13336c => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:33:37.997982 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fab3f3-39ea-413a-9a2f-c9ed1a4d2a33 None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:38.017860 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a995d6-febc-469d-bd61-e73166858ff0 None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:38.055256 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:38.062400 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:38.070635 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34db2e7f-3c20-45c8-bf38-ef6fc4af736e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:38.071378 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34db2e7f-3c20-45c8-bf38-ef6fc4af736e None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:38.071749 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34db2e7f-3c20-45c8-bf38-ef6fc4af736e None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:38.072701 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34db2e7f-3c20-45c8-bf38-ef6fc4af736e None admin] PATH_INFO: `/v3/roles/service` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:38.088147 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34db2e7f-3c20-45c8-bf38-ef6fc4af736e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:33:38.094380 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application [None req-34db2e7f-3c20-45c8-bf38-ef6fc4af736e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 05:33:38.094380 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:33:38.094380 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:33:38.094380 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:33:38.094380 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:33:38.094380 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:33:38.094380 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:33:38.094380 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:33:38.094380 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:33:38.094380 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:33:38.094380 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:33:38.094380 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:33:38.094380 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:33:38.094380 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:33:38.094380 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:33:38.094380 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:33:38.095686 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:33:38.095686 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:33:38.095686 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:33:38.095686 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:33:38.095686 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:33:38.095686 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:33:38.095686 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:33:38.095686 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:33:38.095686 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:33:38.095686 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:33:38.095686 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:33:38.095686 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application with Lock( Aug 24 05:33:38.095686 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:33:38.095686 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:33:38.095686 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:33:38.095686 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:33:38.096708 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:33:38.096708 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:33:38.096708 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:33:38.096708 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:33:38.096708 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:33:38.096708 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:33:38.096708 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:33:38.096708 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:33:38.096708 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:33:38.096708 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:33:38.096708 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 05:33:38.096708 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Aug 24 05:33:38.096708 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 322/639] 10.222.0.26 () {56 vars in 1102 bytes} [Wed Aug 24 05:33:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:33:38.096708 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34db2e7f-3c20-45c8-bf38-ef6fc4af736e None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:38.145998 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fab3f3-39ea-413a-9a2f-c9ed1a4d2a33 None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:38.188378 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2636c545-78b5-4706-8ef3-8d21a9d1c31e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:38.189497 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2636c545-78b5-4706-8ef3-8d21a9d1c31e None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:38.189773 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2636c545-78b5-4706-8ef3-8d21a9d1c31e None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:38.190074 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2636c545-78b5-4706-8ef3-8d21a9d1c31e None admin] PATH_INFO: `/v3/domains` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:38.190830 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2636c545-78b5-4706-8ef3-8d21a9d1c31e None admin] RBAC: Adding query filter params (name=Default) {{(pid=88112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:33:38.191124 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2636c545-78b5-4706-8ef3-8d21a9d1c31e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:38.192870 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2636c545-78b5-4706-8ef3-8d21a9d1c31e None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:38.206491 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 318/640] 10.222.0.26 () {56 vars in 1109 bytes} [Wed Aug 24 05:33:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:33:38.207205 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2636c545-78b5-4706-8ef3-8d21a9d1c31e None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:38.229500 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34db2e7f-3c20-45c8-bf38-ef6fc4af736e None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:38.265803 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133b990b-765a-49d7-9d1c-47f33dba401c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:38.266551 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133b990b-765a-49d7-9d1c-47f33dba401c None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:38.266829 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133b990b-765a-49d7-9d1c-47f33dba401c None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:38.267094 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133b990b-765a-49d7-9d1c-47f33dba401c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:38.277655 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133b990b-765a-49d7-9d1c-47f33dba401c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:38.279191 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133b990b-765a-49d7-9d1c-47f33dba401c None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:38.294780 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application [None req-133b990b-765a-49d7-9d1c-47f33dba401c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:33:38.294780 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:33:38.294780 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:33:38.294780 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:33:38.294780 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:33:38.294780 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:33:38.294780 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:33:38.294780 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:33:38.294780 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:33:38.294780 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:33:38.294780 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:33:38.294780 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:33:38.294780 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 05:33:38.294780 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 05:33:38.294780 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 05:33:38.294780 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 05:33:38.295965 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:33:38.295965 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:33:38.295965 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:33:38.295965 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:33:38.295965 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:33:38.295965 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:33:38.295965 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:33:38.295965 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application with Lock( Aug 24 05:33:38.295965 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:33:38.295965 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:33:38.295965 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:33:38.295965 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:33:38.295965 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:33:38.295965 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:33:38.295965 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:33:38.295965 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:33:38.295965 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 05:33:38.296949 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 05:33:38.296949 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:33:38.296949 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Aug 24 05:33:38.296949 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 323/641] 10.222.0.26 () {56 vars in 1108 bytes} [Wed Aug 24 05:33:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:33:38.297170 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133b990b-765a-49d7-9d1c-47f33dba401c None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:38.318309 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2636c545-78b5-4706-8ef3-8d21a9d1c31e None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:38.320078 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:38.343523 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:38.356351 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1be3377-675f-4682-9b6f-8e502833fba0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:38.357049 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1be3377-675f-4682-9b6f-8e502833fba0 None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:38.357410 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1be3377-675f-4682-9b6f-8e502833fba0 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:38.357685 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1be3377-675f-4682-9b6f-8e502833fba0 None admin] PATH_INFO: `/v3/roles` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:38.358394 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1be3377-675f-4682-9b6f-8e502833fba0 None admin] RBAC: Adding query filter params (name=service) {{(pid=88112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:33:38.358704 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1be3377-675f-4682-9b6f-8e502833fba0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:38.360073 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1be3377-675f-4682-9b6f-8e502833fba0 None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:38.373542 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 319/642] 10.222.0.26 () {56 vars in 1103 bytes} [Wed Aug 24 05:33:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:33:38.373542 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1be3377-675f-4682-9b6f-8e502833fba0 None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:38.409968 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133b990b-765a-49d7-9d1c-47f33dba401c None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:38.444817 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b16133c-ea05-4cf0-ab29-83842981a9d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:38.445558 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b16133c-ea05-4cf0-ab29-83842981a9d0 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:38.445926 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b16133c-ea05-4cf0-ab29-83842981a9d0 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:38.446548 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b16133c-ea05-4cf0-ab29-83842981a9d0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:38.457312 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b16133c-ea05-4cf0-ab29-83842981a9d0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:33:38.462547 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application [None req-4b16133c-ea05-4cf0-ab29-83842981a9d0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 05:33:38.462547 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:33:38.462547 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:33:38.462547 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:33:38.462547 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:33:38.462547 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:33:38.462547 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:33:38.462547 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:33:38.462547 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:33:38.462547 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:33:38.462547 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:33:38.462547 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:33:38.462547 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:33:38.462547 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:33:38.462547 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:33:38.462547 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:33:38.463533 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:33:38.463533 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:33:38.463533 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:33:38.463533 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:33:38.463533 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:33:38.463533 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:33:38.463533 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:33:38.463533 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:33:38.463533 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:33:38.463533 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:33:38.463533 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:33:38.463533 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application with Lock( Aug 24 05:33:38.463533 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:33:38.463533 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:33:38.463533 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:33:38.463533 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:33:38.464409 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:33:38.464409 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:33:38.464409 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:33:38.464409 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:33:38.464409 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:33:38.464409 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:33:38.464409 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:33:38.464409 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:33:38.464409 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:33:38.464409 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:33:38.464409 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 05:33:38.464409 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Aug 24 05:33:38.464409 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 324/643] 10.222.0.26 () {56 vars in 1102 bytes} [Wed Aug 24 05:33:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:33:38.464409 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b16133c-ea05-4cf0-ab29-83842981a9d0 None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:38.481546 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1be3377-675f-4682-9b6f-8e502833fba0 None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:38.524253 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1496ce9-0bf1-4864-b001-04fa8a29fddd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:38.524905 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1496ce9-0bf1-4864-b001-04fa8a29fddd None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:38.525210 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1496ce9-0bf1-4864-b001-04fa8a29fddd None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:38.525879 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1496ce9-0bf1-4864-b001-04fa8a29fddd None admin] PATH_INFO: `/v3/users/glance` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:38.536920 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1496ce9-0bf1-4864-b001-04fa8a29fddd None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:38.536920 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1496ce9-0bf1-4864-b001-04fa8a29fddd None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:38.549233 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application [None req-b1496ce9-0bf1-4864-b001-04fa8a29fddd None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 24 05:33:38.549233 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:33:38.549233 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:33:38.549233 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:33:38.549233 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:33:38.549233 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:33:38.549233 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:33:38.549233 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:33:38.549233 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:33:38.549233 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:33:38.549233 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:33:38.549233 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:33:38.549233 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 05:33:38.549233 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 05:33:38.549233 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 05:33:38.549233 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 05:33:38.550403 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:33:38.550403 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:33:38.550403 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 05:33:38.550403 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 05:33:38.550403 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 05:33:38.550403 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 05:33:38.550403 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:33:38.550403 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:33:38.550403 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:33:38.550403 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:33:38.550403 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:33:38.550403 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application with Lock( Aug 24 05:33:38.550403 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:33:38.550403 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:33:38.550403 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:33:38.550403 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:33:38.550403 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:33:38.550403 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:33:38.551681 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:33:38.551681 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:33:38.551681 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 05:33:38.551681 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 05:33:38.551681 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 05:33:38.551681 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 05:33:38.551681 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 05:33:38.551681 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 05:33:38.551681 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 24 05:33:38.551681 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Aug 24 05:33:38.552967 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 320/644] 10.222.0.26 () {56 vars in 1099 bytes} [Wed Aug 24 05:33:38 2022] GET /identity/v3/users/glance => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:33:38.553896 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1496ce9-0bf1-4864-b001-04fa8a29fddd None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:38.578079 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b16133c-ea05-4cf0-ab29-83842981a9d0 None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:38.579770 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:38.584683 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:38.616994 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e6bc6d-6725-4ec7-9f38-3cc9e590b4a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:38.617598 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e6bc6d-6725-4ec7-9f38-3cc9e590b4a7 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:38.617993 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e6bc6d-6725-4ec7-9f38-3cc9e590b4a7 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:38.618177 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e6bc6d-6725-4ec7-9f38-3cc9e590b4a7 None admin] PATH_INFO: `/v3/domains` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:38.618821 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e6bc6d-6725-4ec7-9f38-3cc9e590b4a7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:33:38.619125 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e6bc6d-6725-4ec7-9f38-3cc9e590b4a7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:38.620557 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e6bc6d-6725-4ec7-9f38-3cc9e590b4a7 None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:38.638084 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 325/645] 10.222.0.26 () {56 vars in 1109 bytes} [Wed Aug 24 05:33:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:33:38.638084 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e6bc6d-6725-4ec7-9f38-3cc9e590b4a7 None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:38.664914 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1496ce9-0bf1-4864-b001-04fa8a29fddd None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:38.700696 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ed6d9e-a324-45c9-bff8-7d4cb410d250 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:38.701409 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ed6d9e-a324-45c9-bff8-7d4cb410d250 None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:38.701773 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ed6d9e-a324-45c9-bff8-7d4cb410d250 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:38.702142 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ed6d9e-a324-45c9-bff8-7d4cb410d250 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:38.713697 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ed6d9e-a324-45c9-bff8-7d4cb410d250 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:38.715243 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ed6d9e-a324-45c9-bff8-7d4cb410d250 None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:38.729822 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application [None req-c9ed6d9e-a324-45c9-bff8-7d4cb410d250 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:33:38.729822 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:33:38.729822 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:33:38.729822 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:33:38.729822 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:33:38.729822 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:33:38.729822 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:33:38.729822 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:33:38.729822 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:33:38.729822 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:33:38.729822 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:33:38.729822 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:33:38.729822 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 05:33:38.729822 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 05:33:38.729822 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 05:33:38.729822 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 05:33:38.730987 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:33:38.730987 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:33:38.730987 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:33:38.730987 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:33:38.730987 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:33:38.730987 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:33:38.730987 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:33:38.730987 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application with Lock( Aug 24 05:33:38.730987 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:33:38.730987 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:33:38.730987 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:33:38.730987 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:33:38.730987 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:33:38.730987 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:33:38.730987 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:33:38.730987 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:33:38.730987 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 05:33:38.731947 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 05:33:38.731947 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:33:38.731947 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Aug 24 05:33:38.731947 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 321/646] 10.222.0.26 () {56 vars in 1108 bytes} [Wed Aug 24 05:33:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:33:38.732193 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ed6d9e-a324-45c9-bff8-7d4cb410d250 None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:38.754403 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e6bc6d-6725-4ec7-9f38-3cc9e590b4a7 None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:38.790363 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92b5678-793f-4384-8528-505868a1278e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:38.791008 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92b5678-793f-4384-8528-505868a1278e None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:38.791289 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92b5678-793f-4384-8528-505868a1278e None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:38.791566 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92b5678-793f-4384-8528-505868a1278e None admin] PATH_INFO: `/v3/roles` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:38.792234 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92b5678-793f-4384-8528-505868a1278e None admin] RBAC: Adding query filter params (name=service) {{(pid=88113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:33:38.792544 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92b5678-793f-4384-8528-505868a1278e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:38.793907 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92b5678-793f-4384-8528-505868a1278e None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:38.802484 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 326/647] 10.222.0.26 () {56 vars in 1103 bytes} [Wed Aug 24 05:33:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:33:38.803085 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92b5678-793f-4384-8528-505868a1278e None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:38.820206 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:38.832225 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:38.849543 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ed6d9e-a324-45c9-bff8-7d4cb410d250 None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:38.884277 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c72081a-4135-4e2a-b6cd-5dd6693e6153 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:38.885113 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c72081a-4135-4e2a-b6cd-5dd6693e6153 None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:38.885391 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c72081a-4135-4e2a-b6cd-5dd6693e6153 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:38.885656 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c72081a-4135-4e2a-b6cd-5dd6693e6153 None admin] PATH_INFO: `/v3/users` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:38.886404 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c72081a-4135-4e2a-b6cd-5dd6693e6153 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=88112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:33:38.886714 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c72081a-4135-4e2a-b6cd-5dd6693e6153 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:38.888122 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c72081a-4135-4e2a-b6cd-5dd6693e6153 None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:38.905815 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 322/648] 10.222.0.26 () {56 vars in 1137 bytes} [Wed Aug 24 05:33:38 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:33:38.906635 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c72081a-4135-4e2a-b6cd-5dd6693e6153 None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:38.917832 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92b5678-793f-4384-8528-505868a1278e None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:38.954918 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6a7d54-a056-490f-98f4-16be34852757 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:38.955538 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6a7d54-a056-490f-98f4-16be34852757 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:38.955928 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6a7d54-a056-490f-98f4-16be34852757 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:38.956199 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6a7d54-a056-490f-98f4-16be34852757 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:38.963855 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6a7d54-a056-490f-98f4-16be34852757 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:38.965491 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6a7d54-a056-490f-98f4-16be34852757 None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:38.978644 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application [None req-5b6a7d54-a056-490f-98f4-16be34852757 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 05:33:38.978644 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:33:38.978644 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:33:38.978644 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:33:38.978644 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:33:38.978644 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:33:38.978644 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:33:38.978644 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:33:38.978644 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:33:38.978644 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:33:38.978644 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:33:38.978644 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:33:38.978644 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 05:33:38.978644 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 05:33:38.978644 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 05:33:38.979732 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 05:33:38.979732 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:33:38.979732 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:33:38.979732 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:33:38.979732 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:33:38.979732 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:33:38.979732 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:33:38.979732 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:33:38.979732 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application with Lock( Aug 24 05:33:38.979732 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:33:38.979732 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:33:38.979732 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:33:38.979732 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:33:38.979732 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:33:38.979732 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:33:38.979732 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:33:38.979732 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:33:38.980953 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 05:33:38.980953 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 05:33:38.980953 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 05:33:38.980953 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 05:33:38.980953 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 05:33:38.980953 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 05:33:38.980953 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 05:33:38.980953 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Aug 24 05:33:38.984692 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 327/649] 10.222.0.26 () {56 vars in 1111 bytes} [Wed Aug 24 05:33:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:33:38.985485 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6a7d54-a056-490f-98f4-16be34852757 None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:39.018774 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c72081a-4135-4e2a-b6cd-5dd6693e6153 None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:39.054089 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f46d7e-651b-49ff-ae90-7bf5c6d55040 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:39.054942 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f46d7e-651b-49ff-ae90-7bf5c6d55040 None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:39.055324 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f46d7e-651b-49ff-ae90-7bf5c6d55040 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:39.055702 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f46d7e-651b-49ff-ae90-7bf5c6d55040 None admin] PATH_INFO: `/v3/domains` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:39.056416 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f46d7e-651b-49ff-ae90-7bf5c6d55040 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:33:39.056832 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f46d7e-651b-49ff-ae90-7bf5c6d55040 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:39.058833 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f46d7e-651b-49ff-ae90-7bf5c6d55040 None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:39.060554 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:39.077185 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 323/650] 10.222.0.26 () {56 vars in 1109 bytes} [Wed Aug 24 05:33:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:33:39.077185 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f46d7e-651b-49ff-ae90-7bf5c6d55040 None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:39.081398 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:39.100446 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6a7d54-a056-490f-98f4-16be34852757 None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:39.137307 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375c5419-e0bd-426d-bcc7-73418b328d48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:39.138277 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375c5419-e0bd-426d-bcc7-73418b328d48 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:39.138561 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375c5419-e0bd-426d-bcc7-73418b328d48 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:39.138960 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375c5419-e0bd-426d-bcc7-73418b328d48 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:39.150315 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375c5419-e0bd-426d-bcc7-73418b328d48 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:39.151773 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375c5419-e0bd-426d-bcc7-73418b328d48 None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:39.165815 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application [None req-375c5419-e0bd-426d-bcc7-73418b328d48 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:33:39.165815 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:33:39.165815 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:33:39.165815 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:33:39.165815 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:33:39.165815 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:33:39.165815 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:33:39.165815 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:33:39.165815 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:33:39.165815 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:33:39.165815 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:33:39.165815 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:33:39.165815 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 05:33:39.165815 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 05:33:39.165815 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 05:33:39.165815 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 05:33:39.166855 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:33:39.166855 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:33:39.166855 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:33:39.166855 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:33:39.166855 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:33:39.166855 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:33:39.166855 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:33:39.166855 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application with Lock( Aug 24 05:33:39.166855 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:33:39.166855 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:33:39.166855 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:33:39.166855 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:33:39.166855 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:33:39.166855 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:33:39.166855 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:33:39.166855 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:33:39.166855 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 05:33:39.167776 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 05:33:39.167776 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:33:39.167776 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Aug 24 05:33:39.167776 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 328/651] 10.222.0.26 () {56 vars in 1108 bytes} [Wed Aug 24 05:33:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:33:39.167776 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375c5419-e0bd-426d-bcc7-73418b328d48 None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:39.191591 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f46d7e-651b-49ff-ae90-7bf5c6d55040 None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:39.227549 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747afeb9-6841-467f-903a-e691997835e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:39.228157 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747afeb9-6841-467f-903a-e691997835e1 None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:39.228434 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747afeb9-6841-467f-903a-e691997835e1 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:39.228707 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747afeb9-6841-467f-903a-e691997835e1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:39.282318 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375c5419-e0bd-426d-bcc7-73418b328d48 None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:39.288809 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:39.297539 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747afeb9-6841-467f-903a-e691997835e1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:39.299063 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747afeb9-6841-467f-903a-e691997835e1 None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:39.319547 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3183c5af-504f-4d80-8fb0-0740c4db3b59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:39.320162 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3183c5af-504f-4d80-8fb0-0740c4db3b59 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:39.320439 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3183c5af-504f-4d80-8fb0-0740c4db3b59 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:39.320717 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3183c5af-504f-4d80-8fb0-0740c4db3b59 None admin] PATH_INFO: `/v3/projects` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:39.321406 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3183c5af-504f-4d80-8fb0-0740c4db3b59 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:33:39.321735 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3183c5af-504f-4d80-8fb0-0740c4db3b59 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:39.323250 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3183c5af-504f-4d80-8fb0-0740c4db3b59 None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:39.325773 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:39.341323 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 329/652] 10.222.0.26 () {56 vars in 1148 bytes} [Wed Aug 24 05:33:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:33:39.341323 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3183c5af-504f-4d80-8fb0-0740c4db3b59 None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:39.418128 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 324/653] 10.222.0.26 () {58 vars in 1282 bytes} [Wed Aug 24 05:33:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 05:33:39.419153 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747afeb9-6841-467f-903a-e691997835e1 None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:39.439009 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3183c5af-504f-4d80-8fb0-0740c4db3b59 None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:39.473900 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99576266-e78e-4410-b13a-7a3690f97815 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:39.474563 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99576266-e78e-4410-b13a-7a3690f97815 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:39.474843 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99576266-e78e-4410-b13a-7a3690f97815 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:39.475116 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99576266-e78e-4410-b13a-7a3690f97815 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:39.482576 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99576266-e78e-4410-b13a-7a3690f97815 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:39.484019 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99576266-e78e-4410-b13a-7a3690f97815 None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:39.497211 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application [None req-99576266-e78e-4410-b13a-7a3690f97815 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 05:33:39.497211 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:33:39.497211 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:33:39.497211 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:33:39.497211 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:33:39.497211 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:33:39.497211 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:33:39.497211 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:33:39.497211 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:33:39.497211 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:33:39.497211 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:33:39.497211 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:33:39.497211 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 05:33:39.497211 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 05:33:39.497211 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 05:33:39.497211 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 05:33:39.498379 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:33:39.498379 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:33:39.498379 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 05:33:39.498379 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 05:33:39.498379 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 05:33:39.498379 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 05:33:39.498379 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:33:39.498379 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:33:39.498379 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:33:39.498379 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:33:39.498379 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:33:39.498379 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application with Lock( Aug 24 05:33:39.498379 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:33:39.498379 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:33:39.498379 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:33:39.498379 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:33:39.498379 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:33:39.498379 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:33:39.499534 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:33:39.499534 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:33:39.499534 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 05:33:39.499534 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 05:33:39.499534 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 05:33:39.499534 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 05:33:39.499534 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 05:33:39.499534 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 05:33:39.499534 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 05:33:39.499534 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Aug 24 05:33:39.500555 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 330/654] 10.222.0.26 () {56 vars in 1099 bytes} [Wed Aug 24 05:33:39 2022] GET /identity/v3/users/cinder => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:33:39.502044 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99576266-e78e-4410-b13a-7a3690f97815 None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:39.531487 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:39.538755 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747afeb9-6841-467f-903a-e691997835e1 None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:39.568411 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:39.576498 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5c1c0b-228b-4e10-bc6c-f17e1ca22ae2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:39.577194 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5c1c0b-228b-4e10-bc6c-f17e1ca22ae2 None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:39.577545 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5c1c0b-228b-4e10-bc6c-f17e1ca22ae2 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:39.577887 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5c1c0b-228b-4e10-bc6c-f17e1ca22ae2 None admin] PATH_INFO: `/v3/domains` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:39.578655 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5c1c0b-228b-4e10-bc6c-f17e1ca22ae2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:33:39.579559 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5c1c0b-228b-4e10-bc6c-f17e1ca22ae2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:39.580971 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5c1c0b-228b-4e10-bc6c-f17e1ca22ae2 None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:39.592727 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 325/655] 10.222.0.26 () {56 vars in 1109 bytes} [Wed Aug 24 05:33:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:33:39.593340 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5c1c0b-228b-4e10-bc6c-f17e1ca22ae2 None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:39.620280 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99576266-e78e-4410-b13a-7a3690f97815 None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:39.655665 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e584ca-9b4c-4c5f-a466-7c7254645683 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:39.656261 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e584ca-9b4c-4c5f-a466-7c7254645683 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:39.656546 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e584ca-9b4c-4c5f-a466-7c7254645683 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:39.656811 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e584ca-9b4c-4c5f-a466-7c7254645683 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:39.658258 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e584ca-9b4c-4c5f-a466-7c7254645683 None admin] RBAC: Adding query filter params (role.id=59fa3749ca7f47e2ba1127945e13336c, scope.project.id=ded4fe81d4dc43188dd84e53025ee783, user.id=7b633e1aec6c4269bce13aa9c89e911a) {{(pid=88113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:33:39.658587 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e584ca-9b4c-4c5f-a466-7c7254645683 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:39.660005 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e584ca-9b4c-4c5f-a466-7c7254645683 None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:39.673971 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 331/656] 10.222.0.26 () {56 vars in 1374 bytes} [Wed Aug 24 05:33:39 2022] GET /identity/v3/role_assignments?user.id=7b633e1aec6c4269bce13aa9c89e911a&scope.project.id=ded4fe81d4dc43188dd84e53025ee783&role.id=59fa3749ca7f47e2ba1127945e13336c => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:33:39.673971 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e584ca-9b4c-4c5f-a466-7c7254645683 None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:39.712226 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5c1c0b-228b-4e10-bc6c-f17e1ca22ae2 None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:39.755501 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136bcabd-4585-4cb2-8380-525c1ff1c27b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:39.756431 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136bcabd-4585-4cb2-8380-525c1ff1c27b None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:39.756772 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136bcabd-4585-4cb2-8380-525c1ff1c27b None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:39.757114 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136bcabd-4585-4cb2-8380-525c1ff1c27b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:39.774303 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136bcabd-4585-4cb2-8380-525c1ff1c27b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:39.775819 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136bcabd-4585-4cb2-8380-525c1ff1c27b None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:39.796234 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application [None req-136bcabd-4585-4cb2-8380-525c1ff1c27b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:33:39.796234 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:33:39.796234 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:33:39.796234 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:33:39.796234 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:33:39.796234 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:33:39.796234 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:33:39.796234 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:33:39.796234 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:33:39.796234 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:33:39.796234 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:33:39.796234 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:33:39.796234 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 05:33:39.796234 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 05:33:39.796234 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 05:33:39.796234 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 05:33:39.797412 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:33:39.797412 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:33:39.797412 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:33:39.797412 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:33:39.797412 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:33:39.797412 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:33:39.797412 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:33:39.797412 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application with Lock( Aug 24 05:33:39.797412 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:33:39.797412 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:33:39.797412 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:33:39.797412 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:33:39.797412 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:33:39.797412 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:33:39.797412 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:33:39.797412 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:33:39.797412 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 05:33:39.798602 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 05:33:39.798602 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:33:39.798602 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Aug 24 05:33:39.802141 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 326/657] 10.222.0.26 () {56 vars in 1108 bytes} [Wed Aug 24 05:33:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:33:39.804023 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136bcabd-4585-4cb2-8380-525c1ff1c27b None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:39.811247 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e584ca-9b4c-4c5f-a466-7c7254645683 None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:39.818663 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:39.839097 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:39.860357 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661574f8-648b-4e6f-a19d-073758ae1408 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:39.860982 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661574f8-648b-4e6f-a19d-073758ae1408 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:39.861261 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661574f8-648b-4e6f-a19d-073758ae1408 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:39.861533 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661574f8-648b-4e6f-a19d-073758ae1408 None admin] PATH_INFO: `/v3/users` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:39.863977 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661574f8-648b-4e6f-a19d-073758ae1408 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=88113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:33:39.863977 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661574f8-648b-4e6f-a19d-073758ae1408 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:39.864249 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661574f8-648b-4e6f-a19d-073758ae1408 None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:39.883862 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 332/658] 10.222.0.26 () {56 vars in 1137 bytes} [Wed Aug 24 05:33:39 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:33:39.884840 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661574f8-648b-4e6f-a19d-073758ae1408 None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:39.938860 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136bcabd-4585-4cb2-8380-525c1ff1c27b None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:39.976783 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addab92b-7f7b-4e7a-a700-67f7c5947896 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:39.977425 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addab92b-7f7b-4e7a-a700-67f7c5947896 None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:39.977710 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addab92b-7f7b-4e7a-a700-67f7c5947896 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:39.978124 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addab92b-7f7b-4e7a-a700-67f7c5947896 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:39.986959 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addab92b-7f7b-4e7a-a700-67f7c5947896 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:39.988427 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addab92b-7f7b-4e7a-a700-67f7c5947896 None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:39.997908 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661574f8-648b-4e6f-a19d-073758ae1408 None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:39.999949 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application [None req-addab92b-7f7b-4e7a-a700-67f7c5947896 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 24 05:33:39.999949 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:33:39.999949 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:33:39.999949 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:33:39.999949 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:33:39.999949 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:33:39.999949 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:33:39.999949 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:33:39.999949 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:33:39.999949 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:33:39.999949 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:33:39.999949 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:33:39.999949 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 05:33:39.999949 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 05:33:39.999949 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 05:33:39.999949 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 05:33:40.001430 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:33:40.001430 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:33:40.001430 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 05:33:40.001430 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 05:33:40.001430 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 05:33:40.001430 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 05:33:40.001430 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:33:40.001430 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:33:40.001430 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:33:40.001430 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:33:40.001430 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:33:40.001430 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application with Lock( Aug 24 05:33:40.001430 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:33:40.001430 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:33:40.001430 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:33:40.001430 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:33:40.001430 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:33:40.001430 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:33:40.003597 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:33:40.003597 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:33:40.003597 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 05:33:40.003597 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 05:33:40.003597 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 05:33:40.003597 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 05:33:40.003597 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 05:33:40.003597 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 05:33:40.003597 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 24 05:33:40.003597 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Aug 24 05:33:40.003597 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 327/659] 10.222.0.26 () {56 vars in 1102 bytes} [Wed Aug 24 05:33:39 2022] GET /identity/v3/users/neutron => generated 85 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:33:40.003597 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addab92b-7f7b-4e7a-a700-67f7c5947896 None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:40.039897 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c213298-aef3-4aa1-9c68-7aacfee60743 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:40.040510 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c213298-aef3-4aa1-9c68-7aacfee60743 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:40.040796 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c213298-aef3-4aa1-9c68-7aacfee60743 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:40.041065 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c213298-aef3-4aa1-9c68-7aacfee60743 None admin] PATH_INFO: `/v3/domains` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:40.041718 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c213298-aef3-4aa1-9c68-7aacfee60743 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:33:40.042053 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c213298-aef3-4aa1-9c68-7aacfee60743 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:40.043444 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c213298-aef3-4aa1-9c68-7aacfee60743 None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:40.054815 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 333/660] 10.222.0.26 () {56 vars in 1109 bytes} [Wed Aug 24 05:33:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:33:40.056047 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ac20d9-7213-4298-8ce8-da6454307b63 None None] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:40.056333 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ac20d9-7213-4298-8ce8-da6454307b63 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:40.056607 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ac20d9-7213-4298-8ce8-da6454307b63 None None] PATH_INFO: `/` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:40.057983 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 334/661] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 24 05:33:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:33:40.058583 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ac20d9-7213-4298-8ce8-da6454307b63 None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:40.083767 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:40.102201 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:40.125182 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addab92b-7f7b-4e7a-a700-67f7c5947896 None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:40.160995 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7affb2a8-bcfb-47ef-943a-dc3e5f5bc195 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:40.161680 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7affb2a8-bcfb-47ef-943a-dc3e5f5bc195 None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:40.161898 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7affb2a8-bcfb-47ef-943a-dc3e5f5bc195 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:40.162204 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7affb2a8-bcfb-47ef-943a-dc3e5f5bc195 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:40.171997 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ac20d9-7213-4298-8ce8-da6454307b63 None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:40.210465 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93f8b62-1790-416a-a72d-171f022553fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:40.211074 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93f8b62-1790-416a-a72d-171f022553fd None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:40.211358 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93f8b62-1790-416a-a72d-171f022553fd None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:40.211645 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93f8b62-1790-416a-a72d-171f022553fd None admin] PATH_INFO: `/v3/users` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:40.212650 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93f8b62-1790-416a-a72d-171f022553fd None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=88113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:33:40.212650 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93f8b62-1790-416a-a72d-171f022553fd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:40.214115 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93f8b62-1790-416a-a72d-171f022553fd None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:40.237027 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 335/662] 10.222.0.26 () {56 vars in 1139 bytes} [Wed Aug 24 05:33:40 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:33:40.237027 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a9fe21-8698-485b-a7f7-88f959f22b6e None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:40.237027 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a9fe21-8698-485b-a7f7-88f959f22b6e None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:40.237027 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a9fe21-8698-485b-a7f7-88f959f22b6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:40.240567 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7affb2a8-bcfb-47ef-943a-dc3e5f5bc195 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:40.242067 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7affb2a8-bcfb-47ef-943a-dc3e5f5bc195 None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:40.253696 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-e2a9fe21-8698-485b-a7f7-88f959f22b6e None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:33:40.254948 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-e2a9fe21-8698-485b-a7f7-88f959f22b6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:33:40.311861 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:40.330510 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 336/663] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 24 05:33:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 05:33:40.331366 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a9fe21-8698-485b-a7f7-88f959f22b6e None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:40.359289 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:40.361940 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 328/664] 10.222.0.26 () {58 vars in 1282 bytes} [Wed Aug 24 05:33:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 05:33:40.363023 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7affb2a8-bcfb-47ef-943a-dc3e5f5bc195 None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:40.443729 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a9fe21-8698-485b-a7f7-88f959f22b6e None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:40.479748 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd20b67-ae21-4b2c-910f-8771709cdc82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:40.480405 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd20b67-ae21-4b2c-910f-8771709cdc82 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:40.480747 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd20b67-ae21-4b2c-910f-8771709cdc82 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:40.481031 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd20b67-ae21-4b2c-910f-8771709cdc82 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:40.487277 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7affb2a8-bcfb-47ef-943a-dc3e5f5bc195 None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:40.487840 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd20b67-ae21-4b2c-910f-8771709cdc82 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:40.489287 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd20b67-ae21-4b2c-910f-8771709cdc82 None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:40.502018 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application [None req-3dd20b67-ae21-4b2c-910f-8771709cdc82 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 05:33:40.502018 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:33:40.502018 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:33:40.502018 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:33:40.502018 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:33:40.502018 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:33:40.502018 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:33:40.502018 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:33:40.502018 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:33:40.502018 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:33:40.502018 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:33:40.502018 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:33:40.502018 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 05:33:40.502018 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 05:33:40.502018 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 05:33:40.502940 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 05:33:40.502940 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:33:40.502940 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:33:40.502940 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:33:40.502940 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:33:40.502940 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:33:40.502940 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:33:40.502940 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:33:40.502940 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application with Lock( Aug 24 05:33:40.502940 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:33:40.502940 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:33:40.502940 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:33:40.502940 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:33:40.502940 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:33:40.502940 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:33:40.502940 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:33:40.502940 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:33:40.503832 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 05:33:40.503832 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 05:33:40.503832 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 05:33:40.503832 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 05:33:40.503832 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 05:33:40.503832 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 05:33:40.503832 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 05:33:40.503832 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Aug 24 05:33:40.503832 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 337/665] 10.222.0.26 () {56 vars in 1111 bytes} [Wed Aug 24 05:33:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:33:40.504304 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd20b67-ae21-4b2c-910f-8771709cdc82 None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:40.532943 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00810cf-db62-4fe2-bf6a-1921660c883f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:40.533654 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00810cf-db62-4fe2-bf6a-1921660c883f None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:40.539400 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00810cf-db62-4fe2-bf6a-1921660c883f None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:40.539696 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00810cf-db62-4fe2-bf6a-1921660c883f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:40.578374 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:40.592684 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:40.608408 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd20b67-ae21-4b2c-910f-8771709cdc82 None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:40.616481 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00810cf-db62-4fe2-bf6a-1921660c883f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:40.618228 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00810cf-db62-4fe2-bf6a-1921660c883f None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:40.643886 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6b42c0-600f-41e4-9865-f0c327afa039 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:40.644521 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6b42c0-600f-41e4-9865-f0c327afa039 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:40.644833 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6b42c0-600f-41e4-9865-f0c327afa039 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:40.645107 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6b42c0-600f-41e4-9865-f0c327afa039 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:40.655082 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6b42c0-600f-41e4-9865-f0c327afa039 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:40.656511 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6b42c0-600f-41e4-9865-f0c327afa039 None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:40.670933 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application [None req-7a6b42c0-600f-41e4-9865-f0c327afa039 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:33:40.670933 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:33:40.670933 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:33:40.670933 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:33:40.670933 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:33:40.670933 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:33:40.670933 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:33:40.670933 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:33:40.670933 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:33:40.670933 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:33:40.670933 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:33:40.670933 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:33:40.670933 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 05:33:40.670933 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 05:33:40.670933 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 05:33:40.670933 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 05:33:40.672090 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:33:40.672090 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:33:40.672090 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:33:40.672090 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:33:40.672090 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:33:40.672090 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:33:40.672090 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:33:40.672090 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application with Lock( Aug 24 05:33:40.672090 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:33:40.672090 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:33:40.672090 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:33:40.672090 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:33:40.672090 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:33:40.672090 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:33:40.672090 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:33:40.672090 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:33:40.672090 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 05:33:40.673478 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 05:33:40.673478 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:33:40.673478 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Aug 24 05:33:40.673478 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 338/666] 10.222.0.26 () {56 vars in 1108 bytes} [Wed Aug 24 05:33:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:33:40.674820 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6b42c0-600f-41e4-9865-f0c327afa039 None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:40.729170 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 329/667] 10.222.0.26 () {58 vars in 1282 bytes} [Wed Aug 24 05:33:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 05:33:40.730047 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00810cf-db62-4fe2-bf6a-1921660c883f None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:40.791231 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6b42c0-600f-41e4-9865-f0c327afa039 None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:40.802673 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:40.827656 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4af1b2d-5aa5-4615-9e2c-9ea3a5cea22a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:40.828265 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4af1b2d-5aa5-4615-9e2c-9ea3a5cea22a None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:40.828597 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4af1b2d-5aa5-4615-9e2c-9ea3a5cea22a None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:40.829472 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4af1b2d-5aa5-4615-9e2c-9ea3a5cea22a None admin] PATH_INFO: `/v3/projects` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:40.830194 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4af1b2d-5aa5-4615-9e2c-9ea3a5cea22a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:33:40.830498 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4af1b2d-5aa5-4615-9e2c-9ea3a5cea22a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:40.831941 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4af1b2d-5aa5-4615-9e2c-9ea3a5cea22a None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:40.839368 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:40.842591 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00810cf-db62-4fe2-bf6a-1921660c883f None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:40.846362 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 339/668] 10.222.0.26 () {56 vars in 1148 bytes} [Wed Aug 24 05:33:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:33:40.846848 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4af1b2d-5aa5-4615-9e2c-9ea3a5cea22a None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:40.887653 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe21724-5704-42de-ab68-c1ad5544f4c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:40.888292 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe21724-5704-42de-ab68-c1ad5544f4c1 None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:40.888566 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe21724-5704-42de-ab68-c1ad5544f4c1 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:40.888832 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe21724-5704-42de-ab68-c1ad5544f4c1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:40.899989 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe21724-5704-42de-ab68-c1ad5544f4c1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:33:40.904588 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application [None req-cbe21724-5704-42de-ab68-c1ad5544f4c1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 05:33:40.904588 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:33:40.904588 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:33:40.904588 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:33:40.904588 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:33:40.904588 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:33:40.904588 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:33:40.904588 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:33:40.904588 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:33:40.904588 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:33:40.904588 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:33:40.904588 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:33:40.904588 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:33:40.904588 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:33:40.904588 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:33:40.904588 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:33:40.905491 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:33:40.905491 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:33:40.905491 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:33:40.905491 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:33:40.905491 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:33:40.905491 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:33:40.905491 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:33:40.905491 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:33:40.905491 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:33:40.905491 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:33:40.905491 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:33:40.905491 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application with Lock( Aug 24 05:33:40.905491 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:33:40.905491 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:33:40.905491 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:33:40.905491 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:33:40.906338 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:33:40.906338 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:33:40.906338 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:33:40.906338 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:33:40.906338 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:33:40.906338 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:33:40.906338 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:33:40.906338 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:33:40.906338 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:33:40.906338 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:33:40.906338 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 05:33:40.906338 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Aug 24 05:33:40.906338 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 330/669] 10.222.0.26 () {56 vars in 1102 bytes} [Wed Aug 24 05:33:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:33:40.907674 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe21724-5704-42de-ab68-c1ad5544f4c1 None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:40.963776 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4af1b2d-5aa5-4615-9e2c-9ea3a5cea22a None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:41.001144 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d732ae7-9b5a-4529-a893-628cf80ed820 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:41.001742 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d732ae7-9b5a-4529-a893-628cf80ed820 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:41.002060 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d732ae7-9b5a-4529-a893-628cf80ed820 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:41.002329 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d732ae7-9b5a-4529-a893-628cf80ed820 None admin] PATH_INFO: `/v3/domains` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:41.002967 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d732ae7-9b5a-4529-a893-628cf80ed820 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:33:41.003265 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d732ae7-9b5a-4529-a893-628cf80ed820 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:41.004608 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d732ae7-9b5a-4529-a893-628cf80ed820 None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:41.015289 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe21724-5704-42de-ab68-c1ad5544f4c1 None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:41.016047 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 340/670] 10.222.0.26 () {56 vars in 1109 bytes} [Wed Aug 24 05:33:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:33:41.017178 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d732ae7-9b5a-4529-a893-628cf80ed820 None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:41.046964 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:41.057022 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a56560-5eff-4bcf-97e2-88f7d1cc88ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:41.057647 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a56560-5eff-4bcf-97e2-88f7d1cc88ff None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:41.057921 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a56560-5eff-4bcf-97e2-88f7d1cc88ff None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:41.058232 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a56560-5eff-4bcf-97e2-88f7d1cc88ff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:41.072086 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a56560-5eff-4bcf-97e2-88f7d1cc88ff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:41.074043 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a56560-5eff-4bcf-97e2-88f7d1cc88ff None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:41.082488 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:41.089963 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application [None req-c4a56560-5eff-4bcf-97e2-88f7d1cc88ff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:33:41.089963 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:33:41.089963 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:33:41.089963 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:33:41.089963 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:33:41.089963 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:33:41.089963 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:33:41.089963 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:33:41.089963 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:33:41.089963 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:33:41.089963 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:33:41.089963 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:33:41.089963 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 05:33:41.089963 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 05:33:41.089963 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 05:33:41.089963 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 05:33:41.090965 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:33:41.090965 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:33:41.090965 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:33:41.090965 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:33:41.090965 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:33:41.090965 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:33:41.090965 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:33:41.090965 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application with Lock( Aug 24 05:33:41.090965 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:33:41.090965 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:33:41.090965 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:33:41.090965 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:33:41.090965 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:33:41.090965 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:33:41.090965 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:33:41.090965 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:33:41.090965 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 05:33:41.092711 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 05:33:41.092711 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:33:41.092711 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Aug 24 05:33:41.095621 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 331/671] 10.222.0.26 () {56 vars in 1108 bytes} [Wed Aug 24 05:33:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:33:41.096442 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a56560-5eff-4bcf-97e2-88f7d1cc88ff None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:41.129225 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d732ae7-9b5a-4529-a893-628cf80ed820 None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:41.165269 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3598cc84-de87-4f1e-ac74-df0f88164e92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:41.166052 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3598cc84-de87-4f1e-ac74-df0f88164e92 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:41.166339 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3598cc84-de87-4f1e-ac74-df0f88164e92 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:41.166614 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3598cc84-de87-4f1e-ac74-df0f88164e92 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:41.167343 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3598cc84-de87-4f1e-ac74-df0f88164e92 None admin] RBAC: Adding query filter params (role.id=59fa3749ca7f47e2ba1127945e13336c, scope.project.id=ded4fe81d4dc43188dd84e53025ee783, user.id=7f856958add7474a989325cea7b1b224) {{(pid=88113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:33:41.167653 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3598cc84-de87-4f1e-ac74-df0f88164e92 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:41.169083 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3598cc84-de87-4f1e-ac74-df0f88164e92 None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:41.175991 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 341/672] 10.222.0.26 () {56 vars in 1374 bytes} [Wed Aug 24 05:33:41 2022] GET /identity/v3/role_assignments?user.id=7f856958add7474a989325cea7b1b224&scope.project.id=ded4fe81d4dc43188dd84e53025ee783&role.id=59fa3749ca7f47e2ba1127945e13336c => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:33:41.176821 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3598cc84-de87-4f1e-ac74-df0f88164e92 None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:41.215332 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a56560-5eff-4bcf-97e2-88f7d1cc88ff None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:41.261417 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02af3cfe-03a1-4e67-8ac4-1f85d7e9eaf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:41.262296 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02af3cfe-03a1-4e67-8ac4-1f85d7e9eaf7 None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:41.262693 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02af3cfe-03a1-4e67-8ac4-1f85d7e9eaf7 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:41.263573 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02af3cfe-03a1-4e67-8ac4-1f85d7e9eaf7 None admin] PATH_INFO: `/v3/roles` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:41.263868 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02af3cfe-03a1-4e67-8ac4-1f85d7e9eaf7 None admin] RBAC: Adding query filter params (name=service) {{(pid=88112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:33:41.264274 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02af3cfe-03a1-4e67-8ac4-1f85d7e9eaf7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:41.265818 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02af3cfe-03a1-4e67-8ac4-1f85d7e9eaf7 None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:41.280871 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 332/673] 10.222.0.26 () {56 vars in 1103 bytes} [Wed Aug 24 05:33:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:33:41.282029 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02af3cfe-03a1-4e67-8ac4-1f85d7e9eaf7 None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:41.305559 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3598cc84-de87-4f1e-ac74-df0f88164e92 None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:41.327911 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:41.336527 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:41.357490 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5f3f03-89e1-4503-99ed-c86aa1e4082b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:41.357719 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5f3f03-89e1-4503-99ed-c86aa1e4082b None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:41.358230 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5f3f03-89e1-4503-99ed-c86aa1e4082b None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:41.358511 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5f3f03-89e1-4503-99ed-c86aa1e4082b None admin] PATH_INFO: `/v3/projects/service` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:41.366151 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5f3f03-89e1-4503-99ed-c86aa1e4082b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:41.367600 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5f3f03-89e1-4503-99ed-c86aa1e4082b None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:41.382245 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application [None req-5e5f3f03-89e1-4503-99ed-c86aa1e4082b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 05:33:41.382245 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:33:41.382245 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:33:41.382245 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:33:41.382245 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:33:41.382245 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:33:41.382245 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:33:41.382245 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:33:41.382245 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:33:41.382245 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:33:41.382245 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:33:41.382245 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:33:41.382245 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 05:33:41.382245 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 05:33:41.382245 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 05:33:41.383212 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 05:33:41.383212 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:33:41.383212 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:33:41.383212 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:33:41.383212 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:33:41.383212 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:33:41.383212 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:33:41.383212 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:33:41.383212 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application with Lock( Aug 24 05:33:41.383212 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:33:41.383212 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:33:41.383212 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:33:41.383212 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:33:41.383212 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:33:41.383212 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:33:41.383212 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:33:41.383212 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:33:41.384124 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 05:33:41.384124 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 05:33:41.384124 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 05:33:41.384124 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 05:33:41.384124 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 05:33:41.384124 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 05:33:41.384124 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 05:33:41.384124 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Aug 24 05:33:41.384124 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 342/674] 10.222.0.26 () {56 vars in 1111 bytes} [Wed Aug 24 05:33:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:33:41.384124 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5f3f03-89e1-4503-99ed-c86aa1e4082b None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:41.412936 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02af3cfe-03a1-4e67-8ac4-1f85d7e9eaf7 None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:41.454814 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad415fec-d51c-42a0-9bcf-1d506c6e8d2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:41.455608 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad415fec-d51c-42a0-9bcf-1d506c6e8d2a None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:41.455984 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad415fec-d51c-42a0-9bcf-1d506c6e8d2a None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:41.456644 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad415fec-d51c-42a0-9bcf-1d506c6e8d2a None admin] PATH_INFO: `/v3/domains` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:41.457063 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad415fec-d51c-42a0-9bcf-1d506c6e8d2a None admin] RBAC: Adding query filter params (name=Default) {{(pid=88112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:33:41.457433 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad415fec-d51c-42a0-9bcf-1d506c6e8d2a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:41.458983 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad415fec-d51c-42a0-9bcf-1d506c6e8d2a None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:41.474149 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 333/675] 10.222.0.26 () {56 vars in 1109 bytes} [Wed Aug 24 05:33:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:33:41.475138 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad415fec-d51c-42a0-9bcf-1d506c6e8d2a None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:41.521215 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5f3f03-89e1-4503-99ed-c86aa1e4082b None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:41.562469 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa84858-09f4-40f4-b532-e9d74a8a95c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:41.564151 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa84858-09f4-40f4-b532-e9d74a8a95c7 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:41.564151 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa84858-09f4-40f4-b532-e9d74a8a95c7 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:41.564523 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa84858-09f4-40f4-b532-e9d74a8a95c7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:41.577522 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa84858-09f4-40f4-b532-e9d74a8a95c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:41.579967 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa84858-09f4-40f4-b532-e9d74a8a95c7 None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:41.596414 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application [None req-cfa84858-09f4-40f4-b532-e9d74a8a95c7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:33:41.596414 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:33:41.596414 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:33:41.596414 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:33:41.596414 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:33:41.596414 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:33:41.596414 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:33:41.596414 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:33:41.596414 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:33:41.596414 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:33:41.596414 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:33:41.596414 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:33:41.596414 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 05:33:41.596414 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 05:33:41.596414 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 05:33:41.596414 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 05:33:41.597471 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:33:41.597471 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:33:41.597471 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:33:41.597471 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:33:41.597471 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:33:41.597471 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:33:41.597471 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:33:41.597471 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application with Lock( Aug 24 05:33:41.597471 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:33:41.597471 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:33:41.597471 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:33:41.597471 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:33:41.597471 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:33:41.597471 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:33:41.597471 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:33:41.597471 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:33:41.597471 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 05:33:41.598376 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 05:33:41.598376 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:33:41.598376 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Aug 24 05:33:41.602698 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 343/676] 10.222.0.26 () {56 vars in 1108 bytes} [Wed Aug 24 05:33:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:33:41.603576 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa84858-09f4-40f4-b532-e9d74a8a95c7 None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:41.609269 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:41.615567 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad415fec-d51c-42a0-9bcf-1d506c6e8d2a None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:41.642741 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:41.667025 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5de739d-b33d-4696-aae8-6e7ecb088e9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:41.668321 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5de739d-b33d-4696-aae8-6e7ecb088e9e None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:41.669069 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5de739d-b33d-4696-aae8-6e7ecb088e9e None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:41.669563 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5de739d-b33d-4696-aae8-6e7ecb088e9e None admin] PATH_INFO: `/v3/projects` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:41.671038 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5de739d-b33d-4696-aae8-6e7ecb088e9e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:33:41.671556 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5de739d-b33d-4696-aae8-6e7ecb088e9e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:41.673888 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5de739d-b33d-4696-aae8-6e7ecb088e9e None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:41.689294 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 334/677] 10.222.0.26 () {56 vars in 1148 bytes} [Wed Aug 24 05:33:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:33:41.690437 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5de739d-b33d-4696-aae8-6e7ecb088e9e None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:41.729321 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa84858-09f4-40f4-b532-e9d74a8a95c7 None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:41.765634 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dea14c6-a280-488a-93e5-aa9446262e72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:41.766335 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dea14c6-a280-488a-93e5-aa9446262e72 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:41.766620 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dea14c6-a280-488a-93e5-aa9446262e72 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:41.766897 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dea14c6-a280-488a-93e5-aa9446262e72 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:41.774385 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dea14c6-a280-488a-93e5-aa9446262e72 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:41.775858 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dea14c6-a280-488a-93e5-aa9446262e72 None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:41.787203 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application [None req-6dea14c6-a280-488a-93e5-aa9446262e72 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 05:33:41.787203 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:33:41.787203 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:33:41.787203 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:33:41.787203 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:33:41.787203 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:33:41.787203 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:33:41.787203 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:33:41.787203 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:33:41.787203 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:33:41.787203 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:33:41.787203 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:33:41.787203 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 05:33:41.787203 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 05:33:41.787203 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 05:33:41.788095 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 05:33:41.788095 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:33:41.788095 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:33:41.788095 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:33:41.788095 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:33:41.788095 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:33:41.788095 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:33:41.788095 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:33:41.788095 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application with Lock( Aug 24 05:33:41.788095 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:33:41.788095 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:33:41.788095 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:33:41.788095 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:33:41.788095 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:33:41.788095 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:33:41.788095 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:33:41.788095 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:33:41.788992 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 05:33:41.788992 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 05:33:41.788992 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 05:33:41.788992 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 05:33:41.788992 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 05:33:41.788992 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 05:33:41.788992 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 05:33:41.788992 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Aug 24 05:33:41.788992 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 344/678] 10.222.0.26 () {56 vars in 1111 bytes} [Wed Aug 24 05:33:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:33:41.789513 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dea14c6-a280-488a-93e5-aa9446262e72 None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:41.811854 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5de739d-b33d-4696-aae8-6e7ecb088e9e None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:41.847819 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11873ad7-e993-41ce-8120-e25315987c1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:41.848346 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11873ad7-e993-41ce-8120-e25315987c1d None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:41.848629 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11873ad7-e993-41ce-8120-e25315987c1d None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:41.848890 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11873ad7-e993-41ce-8120-e25315987c1d None admin] PATH_INFO: `/v3/domains` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:41.849524 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11873ad7-e993-41ce-8120-e25315987c1d None admin] RBAC: Adding query filter params (name=Default) {{(pid=88112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:33:41.849822 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11873ad7-e993-41ce-8120-e25315987c1d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:41.851225 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11873ad7-e993-41ce-8120-e25315987c1d None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:41.868511 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 335/679] 10.222.0.26 () {56 vars in 1109 bytes} [Wed Aug 24 05:33:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:33:41.868511 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf6c767-80e0-46da-8b77-5eee23a1a254 None None] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:41.868511 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf6c767-80e0-46da-8b77-5eee23a1a254 None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:41.868511 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf6c767-80e0-46da-8b77-5eee23a1a254 None None] PATH_INFO: `/` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:41.868511 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 336/680] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 24 05:33:41 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:33:41.868511 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf6c767-80e0-46da-8b77-5eee23a1a254 None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:41.891493 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:41.899355 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:41.907221 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dea14c6-a280-488a-93e5-aa9446262e72 None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:41.943821 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9b2b30-b3e2-42e6-8eab-dd22eefb9a5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:41.944425 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9b2b30-b3e2-42e6-8eab-dd22eefb9a5f None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:41.944709 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9b2b30-b3e2-42e6-8eab-dd22eefb9a5f None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:41.944981 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9b2b30-b3e2-42e6-8eab-dd22eefb9a5f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:41.945738 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9b2b30-b3e2-42e6-8eab-dd22eefb9a5f None admin] RBAC: Adding query filter params (role.id=59fa3749ca7f47e2ba1127945e13336c, scope.project.id=ded4fe81d4dc43188dd84e53025ee783, user.id=17b450afe795495680fc70f522c83750) {{(pid=88113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:33:41.946088 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9b2b30-b3e2-42e6-8eab-dd22eefb9a5f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:41.947516 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9b2b30-b3e2-42e6-8eab-dd22eefb9a5f None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:41.953836 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 345/681] 10.222.0.26 () {56 vars in 1374 bytes} [Wed Aug 24 05:33:41 2022] GET /identity/v3/role_assignments?user.id=17b450afe795495680fc70f522c83750&scope.project.id=ded4fe81d4dc43188dd84e53025ee783&role.id=59fa3749ca7f47e2ba1127945e13336c => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:33:41.954833 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9b2b30-b3e2-42e6-8eab-dd22eefb9a5f None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:41.983134 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf6c767-80e0-46da-8b77-5eee23a1a254 None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:42.023576 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c7bdd9-6019-4a1a-9ec9-fc435678f694 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:42.024537 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c7bdd9-6019-4a1a-9ec9-fc435678f694 None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:42.025001 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c7bdd9-6019-4a1a-9ec9-fc435678f694 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:42.025580 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c7bdd9-6019-4a1a-9ec9-fc435678f694 None admin] PATH_INFO: `/v3/projects` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:42.026637 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c7bdd9-6019-4a1a-9ec9-fc435678f694 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:33:42.026943 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c7bdd9-6019-4a1a-9ec9-fc435678f694 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:42.028391 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c7bdd9-6019-4a1a-9ec9-fc435678f694 None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:42.043162 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 337/682] 10.222.0.26 () {56 vars in 1148 bytes} [Wed Aug 24 05:33:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:33:42.044575 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50d1050-f9e4-4339-bc31-c3f9fdb181c1 None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:42.044860 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50d1050-f9e4-4339-bc31-c3f9fdb181c1 None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:42.045131 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50d1050-f9e4-4339-bc31-c3f9fdb181c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:42.065525 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-d50d1050-f9e4-4339-bc31-c3f9fdb181c1 None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:33:42.066780 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-d50d1050-f9e4-4339-bc31-c3f9fdb181c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:33:42.108495 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9b2b30-b3e2-42e6-8eab-dd22eefb9a5f None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:42.150992 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 338/683] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 24 05:33:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 05:33:42.150992 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50d1050-f9e4-4339-bc31-c3f9fdb181c1 None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:42.162931 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d6dc75-d1aa-44f5-9559-ce13661b5e53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:42.163572 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d6dc75-d1aa-44f5-9559-ce13661b5e53 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:42.163852 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d6dc75-d1aa-44f5-9559-ce13661b5e53 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:42.164021 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:42.164139 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d6dc75-d1aa-44f5-9559-ce13661b5e53 None admin] PATH_INFO: `/v3/users/swift` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:42.176584 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d6dc75-d1aa-44f5-9559-ce13661b5e53 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:42.178060 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d6dc75-d1aa-44f5-9559-ce13661b5e53 None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:42.195295 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application [None req-d3d6dc75-d1aa-44f5-9559-ce13661b5e53 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 24 05:33:42.195295 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:33:42.195295 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:33:42.195295 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:33:42.195295 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:33:42.195295 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:33:42.195295 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:33:42.195295 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:33:42.195295 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:33:42.195295 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:33:42.195295 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:33:42.195295 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:33:42.195295 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 05:33:42.195295 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 05:33:42.195295 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 05:33:42.195295 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 05:33:42.196507 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:33:42.196507 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:33:42.196507 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 05:33:42.196507 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 05:33:42.196507 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 05:33:42.196507 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 05:33:42.196507 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:33:42.196507 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:33:42.196507 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:33:42.196507 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:33:42.196507 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:33:42.196507 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application with Lock( Aug 24 05:33:42.196507 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:33:42.196507 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:33:42.196507 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:33:42.196507 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:33:42.196507 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:33:42.196507 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:33:42.197783 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:33:42.197783 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:33:42.197783 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 05:33:42.197783 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 05:33:42.197783 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 05:33:42.197783 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 05:33:42.197783 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 05:33:42.197783 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 05:33:42.197783 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 24 05:33:42.197783 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Aug 24 05:33:42.201159 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 346/684] 10.222.0.26 () {56 vars in 1096 bytes} [Wed Aug 24 05:33:41 2022] GET /identity/v3/users/swift => generated 83 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:33:42.202031 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d6dc75-d1aa-44f5-9559-ce13661b5e53 None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:42.226483 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:42.283673 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50d1050-f9e4-4339-bc31-c3f9fdb181c1 None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:42.317386 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d6dc75-d1aa-44f5-9559-ce13661b5e53 None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:42.343043 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a141fbc7-ab75-466e-a946-283891e85927 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:42.343671 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a141fbc7-ab75-466e-a946-283891e85927 None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:42.343947 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a141fbc7-ab75-466e-a946-283891e85927 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:42.344217 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a141fbc7-ab75-466e-a946-283891e85927 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:42.345007 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a141fbc7-ab75-466e-a946-283891e85927 None admin] RBAC: Adding query filter params (role.id=59fa3749ca7f47e2ba1127945e13336c, scope.project.id=ded4fe81d4dc43188dd84e53025ee783, user.id=874348b647194ac2b5ecbf12c33bf59e) {{(pid=88112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:33:42.345311 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a141fbc7-ab75-466e-a946-283891e85927 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:42.346770 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a141fbc7-ab75-466e-a946-283891e85927 None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:42.355549 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 339/685] 10.222.0.26 () {56 vars in 1374 bytes} [Wed Aug 24 05:33:42 2022] GET /identity/v3/role_assignments?user.id=874348b647194ac2b5ecbf12c33bf59e&scope.project.id=ded4fe81d4dc43188dd84e53025ee783&role.id=59fa3749ca7f47e2ba1127945e13336c => generated 608 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:33:42.367050 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c0a456-eabb-451b-8287-8c0d9ebb7f4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:42.367588 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c0a456-eabb-451b-8287-8c0d9ebb7f4c None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:42.367869 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c0a456-eabb-451b-8287-8c0d9ebb7f4c None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:42.368143 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c0a456-eabb-451b-8287-8c0d9ebb7f4c None admin] PATH_INFO: `/v3/users` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:42.368886 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c0a456-eabb-451b-8287-8c0d9ebb7f4c None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=88113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:33:42.369189 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c0a456-eabb-451b-8287-8c0d9ebb7f4c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:42.370886 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c0a456-eabb-451b-8287-8c0d9ebb7f4c None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:42.392570 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 347/686] 10.222.0.26 () {56 vars in 1135 bytes} [Wed Aug 24 05:33:42 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:33:42.403525 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a141fbc7-ab75-466e-a946-283891e85927 None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:42.484054 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c0a456-eabb-451b-8287-8c0d9ebb7f4c None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:42.498228 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:42.546634 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a141fbc7-ab75-466e-a946-283891e85927 None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:42.626765 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf037fa9-5058-4c55-a45b-9951b07a8d55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:42.627367 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:42.627453 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf037fa9-5058-4c55-a45b-9951b07a8d55 None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:42.627578 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf037fa9-5058-4c55-a45b-9951b07a8d55 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:42.627855 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf037fa9-5058-4c55-a45b-9951b07a8d55 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:42.654556 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c0a456-eabb-451b-8287-8c0d9ebb7f4c None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:42.694183 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f07045-a3ab-4a79-997c-ca95de831d82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:42.695025 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f07045-a3ab-4a79-997c-ca95de831d82 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:42.695401 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f07045-a3ab-4a79-997c-ca95de831d82 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:42.695843 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f07045-a3ab-4a79-997c-ca95de831d82 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:42.704613 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf037fa9-5058-4c55-a45b-9951b07a8d55 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:42.706126 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf037fa9-5058-4c55-a45b-9951b07a8d55 None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:42.706997 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f07045-a3ab-4a79-997c-ca95de831d82 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:33:42.711782 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application [None req-60f07045-a3ab-4a79-997c-ca95de831d82 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 05:33:42.711782 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:33:42.711782 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:33:42.711782 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:33:42.711782 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:33:42.711782 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:33:42.711782 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:33:42.711782 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:33:42.711782 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:33:42.711782 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:33:42.711782 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:33:42.711782 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:33:42.711782 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:33:42.711782 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:33:42.711782 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:33:42.711782 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:33:42.712922 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:33:42.712922 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:33:42.712922 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:33:42.712922 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:33:42.712922 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:33:42.712922 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:33:42.712922 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:33:42.712922 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:33:42.712922 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:33:42.712922 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:33:42.712922 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:33:42.712922 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application with Lock( Aug 24 05:33:42.712922 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:33:42.712922 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:33:42.712922 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:33:42.712922 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:33:42.714001 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:33:42.714001 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:33:42.714001 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:33:42.714001 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:33:42.714001 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:33:42.714001 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:33:42.714001 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:33:42.714001 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:33:42.714001 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:33:42.714001 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:33:42.714001 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 05:33:42.714001 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Aug 24 05:33:42.716514 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 348/687] 10.222.0.26 () {56 vars in 1096 bytes} [Wed Aug 24 05:33:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 05:33:42.721724 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f07045-a3ab-4a79-997c-ca95de831d82 None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:42.796569 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:42.851961 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f07045-a3ab-4a79-997c-ca95de831d82 None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:42.854900 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 340/688] 10.222.0.26 () {58 vars in 1282 bytes} [Wed Aug 24 05:33:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 457 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 05:33:42.861058 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf037fa9-5058-4c55-a45b-9951b07a8d55 None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:42.892173 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74824ed0-45f4-4aed-b1c4-4d1505103ea6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:42.892706 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74824ed0-45f4-4aed-b1c4-4d1505103ea6 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:42.892984 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74824ed0-45f4-4aed-b1c4-4d1505103ea6 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:42.893254 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74824ed0-45f4-4aed-b1c4-4d1505103ea6 None admin] PATH_INFO: `/v3/roles` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:42.893925 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74824ed0-45f4-4aed-b1c4-4d1505103ea6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:33:42.894388 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74824ed0-45f4-4aed-b1c4-4d1505103ea6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:42.895885 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74824ed0-45f4-4aed-b1c4-4d1505103ea6 None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:42.898581 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:42.909022 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 349/689] 10.222.0.26 () {56 vars in 1099 bytes} [Wed Aug 24 05:33:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:33:42.915970 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74824ed0-45f4-4aed-b1c4-4d1505103ea6 None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:43.035880 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74824ed0-45f4-4aed-b1c4-4d1505103ea6 None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:43.073201 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dcad55-40bb-4e6d-81b0-32ed369ab6b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:43.073831 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dcad55-40bb-4e6d-81b0-32ed369ab6b8 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:43.074203 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dcad55-40bb-4e6d-81b0-32ed369ab6b8 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:43.074484 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dcad55-40bb-4e6d-81b0-32ed369ab6b8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:43.086416 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7dcad55-40bb-4e6d-81b0-32ed369ab6b8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:43.088358 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7dcad55-40bb-4e6d-81b0-32ed369ab6b8 None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:43.103587 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application [None req-b7dcad55-40bb-4e6d-81b0-32ed369ab6b8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:33:43.103587 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:33:43.103587 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:33:43.103587 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:33:43.103587 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:33:43.103587 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:33:43.103587 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:33:43.103587 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:33:43.103587 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:33:43.103587 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:33:43.103587 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:33:43.103587 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:33:43.103587 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 05:33:43.103587 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 05:33:43.103587 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 05:33:43.103587 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 05:33:43.104547 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:33:43.104547 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:33:43.104547 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:33:43.104547 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:33:43.104547 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:33:43.104547 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:33:43.104547 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:33:43.104547 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application with Lock( Aug 24 05:33:43.104547 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:33:43.104547 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:33:43.104547 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:33:43.104547 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:33:43.104547 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:33:43.104547 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:33:43.104547 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:33:43.104547 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:33:43.104547 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 05:33:43.106102 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 05:33:43.106102 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:33:43.106102 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Aug 24 05:33:43.106102 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 350/690] 10.222.0.26 () {56 vars in 1108 bytes} [Wed Aug 24 05:33:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:33:43.114090 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dcad55-40bb-4e6d-81b0-32ed369ab6b8 None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:43.120660 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf037fa9-5058-4c55-a45b-9951b07a8d55 None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:43.178247 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:43.178886 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c293e5d-64a8-46cd-be82-89298923808d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:43.179302 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c293e5d-64a8-46cd-be82-89298923808d None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:43.179587 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c293e5d-64a8-46cd-be82-89298923808d None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:43.179861 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c293e5d-64a8-46cd-be82-89298923808d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:43.200540 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c293e5d-64a8-46cd-be82-89298923808d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:43.202080 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c293e5d-64a8-46cd-be82-89298923808d None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:43.228838 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application [None req-8c293e5d-64a8-46cd-be82-89298923808d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:33:43.228838 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:33:43.228838 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:33:43.228838 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:33:43.228838 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:33:43.228838 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:33:43.228838 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:33:43.228838 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:33:43.228838 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:33:43.228838 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:33:43.228838 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:33:43.228838 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:33:43.228838 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 05:33:43.228838 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 05:33:43.228838 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 05:33:43.228838 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 05:33:43.231089 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:33:43.231089 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:33:43.231089 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:33:43.231089 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:33:43.231089 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:33:43.231089 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:33:43.231089 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:33:43.231089 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application with Lock( Aug 24 05:33:43.231089 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:33:43.231089 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:33:43.231089 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:33:43.231089 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:33:43.231089 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:33:43.231089 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:33:43.231089 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:33:43.231089 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:33:43.231089 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 05:33:43.233218 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 05:33:43.233218 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:33:43.233218 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Aug 24 05:33:43.233598 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dcad55-40bb-4e6d-81b0-32ed369ab6b8 None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:43.238378 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 341/691] 10.222.0.26 () {56 vars in 1108 bytes} [Wed Aug 24 05:33:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 378 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 05:33:43.243584 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c293e5d-64a8-46cd-be82-89298923808d None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:43.266895 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8ac957-6b7d-4e7b-8332-3066dd6dfd6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:43.267508 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8ac957-6b7d-4e7b-8332-3066dd6dfd6a None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:43.267785 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8ac957-6b7d-4e7b-8332-3066dd6dfd6a None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:43.268062 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8ac957-6b7d-4e7b-8332-3066dd6dfd6a None admin] PATH_INFO: `/v3/domains` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:43.268711 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8ac957-6b7d-4e7b-8332-3066dd6dfd6a None admin] RBAC: Adding query filter params (name=Default) {{(pid=88113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:33:43.269013 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8ac957-6b7d-4e7b-8332-3066dd6dfd6a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:43.270710 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8ac957-6b7d-4e7b-8332-3066dd6dfd6a None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:43.283689 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 351/692] 10.222.0.26 () {56 vars in 1109 bytes} [Wed Aug 24 05:33:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:33:43.290902 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:43.291043 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8ac957-6b7d-4e7b-8332-3066dd6dfd6a None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:43.413422 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8ac957-6b7d-4e7b-8332-3066dd6dfd6a None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:43.424762 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c293e5d-64a8-46cd-be82-89298923808d None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:43.428765 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:43.457655 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9661fae-c46c-45a9-bc12-bf5c01af3189 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:43.458843 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9661fae-c46c-45a9-bc12-bf5c01af3189 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:43.459317 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9661fae-c46c-45a9-bc12-bf5c01af3189 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:43.459995 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9661fae-c46c-45a9-bc12-bf5c01af3189 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:43.466085 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dcf3c8-c96a-421a-bf60-642d1acf540e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:43.466820 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dcf3c8-c96a-421a-bf60-642d1acf540e None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:43.467198 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dcf3c8-c96a-421a-bf60-642d1acf540e None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:43.467568 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dcf3c8-c96a-421a-bf60-642d1acf540e None admin] PATH_INFO: `/v3/domains` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:43.468304 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94dcf3c8-c96a-421a-bf60-642d1acf540e None admin] RBAC: Adding query filter params (name=Default) {{(pid=88112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:33:43.468979 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94dcf3c8-c96a-421a-bf60-642d1acf540e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:43.470190 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9661fae-c46c-45a9-bc12-bf5c01af3189 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:43.471127 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94dcf3c8-c96a-421a-bf60-642d1acf540e None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:43.472009 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9661fae-c46c-45a9-bc12-bf5c01af3189 None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:43.485472 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 342/693] 10.222.0.26 () {56 vars in 1109 bytes} [Wed Aug 24 05:33:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:33:43.486996 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa793cc-86c8-4110-903e-a8f6f8b83f14 None None] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:43.487397 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa793cc-86c8-4110-903e-a8f6f8b83f14 None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:43.487572 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application [None req-b9661fae-c46c-45a9-bc12-bf5c01af3189 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 05:33:43.487572 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:33:43.487572 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:33:43.487572 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:33:43.487572 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:33:43.487572 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:33:43.487572 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:33:43.487572 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:33:43.487572 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:33:43.487572 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:33:43.487572 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:33:43.487572 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:33:43.487572 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 05:33:43.487572 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 05:33:43.487572 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 05:33:43.487572 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 05:33:43.488680 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:33:43.488680 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:33:43.488680 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 05:33:43.488680 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 05:33:43.488680 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 05:33:43.488680 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 05:33:43.488680 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:33:43.488680 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:33:43.488680 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:33:43.488680 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:33:43.488680 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:33:43.488680 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application with Lock( Aug 24 05:33:43.488680 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:33:43.488680 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:33:43.488680 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:33:43.488680 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:33:43.488680 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:33:43.488680 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:33:43.489874 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:33:43.489874 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:33:43.489874 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 05:33:43.489874 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 05:33:43.489874 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 05:33:43.489874 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 05:33:43.489874 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 05:33:43.489874 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 05:33:43.489874 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 05:33:43.489874 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Aug 24 05:33:43.499020 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa793cc-86c8-4110-903e-a8f6f8b83f14 None None] PATH_INFO: `/` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:43.499020 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 343/694] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 24 05:33:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:33:43.499020 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa793cc-86c8-4110-903e-a8f6f8b83f14 None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:43.499252 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 352/695] 10.222.0.26 () {56 vars in 1093 bytes} [Wed Aug 24 05:33:43 2022] GET /identity/v3/users/nova => generated 82 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:33:43.500382 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d00d13-2467-43d3-a55b-c8701b3f4b34 None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:43.500714 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d00d13-2467-43d3-a55b-c8701b3f4b34 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:43.500991 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d00d13-2467-43d3-a55b-c8701b3f4b34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:43.527225 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-64d00d13-2467-43d3-a55b-c8701b3f4b34 None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:33:43.528510 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-64d00d13-2467-43d3-a55b-c8701b3f4b34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:33:43.604611 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 353/696] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 24 05:33:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 05:33:43.604611 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d00d13-2467-43d3-a55b-c8701b3f4b34 None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:43.605718 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:43.638850 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa793cc-86c8-4110-903e-a8f6f8b83f14 None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:43.700860 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d06c2e-b340-416b-8b6e-2d3ae213bdb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:43.701854 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d06c2e-b340-416b-8b6e-2d3ae213bdb1 None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:43.702398 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d06c2e-b340-416b-8b6e-2d3ae213bdb1 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:43.702807 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:43.702968 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d06c2e-b340-416b-8b6e-2d3ae213bdb1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:43.708382 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d00d13-2467-43d3-a55b-c8701b3f4b34 None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:43.719098 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d06c2e-b340-416b-8b6e-2d3ae213bdb1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:43.720727 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d06c2e-b340-416b-8b6e-2d3ae213bdb1 None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:43.739959 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application [None req-41d06c2e-b340-416b-8b6e-2d3ae213bdb1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 05:33:43.739959 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:33:43.739959 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:33:43.739959 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:33:43.739959 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:33:43.739959 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:33:43.739959 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:33:43.739959 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:33:43.739959 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:33:43.739959 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:33:43.739959 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:33:43.739959 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:33:43.739959 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 05:33:43.739959 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 05:33:43.739959 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 05:33:43.741093 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 05:33:43.741093 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:33:43.741093 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:33:43.741093 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:33:43.741093 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:33:43.741093 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:33:43.741093 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:33:43.741093 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:33:43.741093 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application with Lock( Aug 24 05:33:43.741093 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:33:43.741093 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:33:43.741093 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:33:43.741093 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:33:43.741093 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:33:43.741093 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:33:43.741093 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:33:43.741093 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:33:43.742231 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 05:33:43.742231 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 05:33:43.742231 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 05:33:43.742231 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 05:33:43.742231 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 05:33:43.742231 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 05:33:43.742231 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 05:33:43.742231 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Aug 24 05:33:43.747953 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 344/697] 10.222.0.26 () {56 vars in 1111 bytes} [Wed Aug 24 05:33:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:33:43.749229 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d06c2e-b340-416b-8b6e-2d3ae213bdb1 None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:43.758099 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f591975b-eb28-4dc7-a320-7cc68edadc79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:43.758990 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f591975b-eb28-4dc7-a320-7cc68edadc79 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:43.759473 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f591975b-eb28-4dc7-a320-7cc68edadc79 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:43.759935 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f591975b-eb28-4dc7-a320-7cc68edadc79 None admin] PATH_INFO: `/v3/users` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:43.763083 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f591975b-eb28-4dc7-a320-7cc68edadc79 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:33:43.763599 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f591975b-eb28-4dc7-a320-7cc68edadc79 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:43.765259 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f591975b-eb28-4dc7-a320-7cc68edadc79 None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:43.802919 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 354/698] 10.222.0.26 () {56 vars in 1133 bytes} [Wed Aug 24 05:33:43 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:33:43.808386 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f591975b-eb28-4dc7-a320-7cc68edadc79 None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:43.917961 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f591975b-eb28-4dc7-a320-7cc68edadc79 None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:43.961281 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ce01ab-a98f-4606-99bd-8554564f3c87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:43.962297 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ce01ab-a98f-4606-99bd-8554564f3c87 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:43.962784 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ce01ab-a98f-4606-99bd-8554564f3c87 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:43.963257 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ce01ab-a98f-4606-99bd-8554564f3c87 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:43.966137 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d06c2e-b340-416b-8b6e-2d3ae213bdb1 None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:44.002147 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641d2366-ca77-4769-a4da-9070915471a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:44.002758 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641d2366-ca77-4769-a4da-9070915471a0 None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:44.003041 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641d2366-ca77-4769-a4da-9070915471a0 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:44.009982 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641d2366-ca77-4769-a4da-9070915471a0 None admin] PATH_INFO: `/v3/projects` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:44.009982 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641d2366-ca77-4769-a4da-9070915471a0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:33:44.009982 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641d2366-ca77-4769-a4da-9070915471a0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:44.009982 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641d2366-ca77-4769-a4da-9070915471a0 None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:44.013599 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:44.020276 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 345/699] 10.222.0.26 () {56 vars in 1148 bytes} [Wed Aug 24 05:33:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:33:44.025996 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641d2366-ca77-4769-a4da-9070915471a0 None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:44.041505 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:44.061786 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ce01ab-a98f-4606-99bd-8554564f3c87 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:44.063550 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ce01ab-a98f-4606-99bd-8554564f3c87 None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:44.177655 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 355/700] 10.222.0.26 () {58 vars in 1282 bytes} [Wed Aug 24 05:33:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 05:33:44.178733 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ce01ab-a98f-4606-99bd-8554564f3c87 None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:44.183847 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641d2366-ca77-4769-a4da-9070915471a0 None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:44.224134 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f471661d-7341-4204-a366-5611da93eb87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:44.225109 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f471661d-7341-4204-a366-5611da93eb87 None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:44.225536 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f471661d-7341-4204-a366-5611da93eb87 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:44.226060 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f471661d-7341-4204-a366-5611da93eb87 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:44.227137 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f471661d-7341-4204-a366-5611da93eb87 None admin] RBAC: Adding query filter params (role.id=59fa3749ca7f47e2ba1127945e13336c, scope.project.id=ded4fe81d4dc43188dd84e53025ee783, user.id=87ff96222a7c4baea31fc1bebf4d89a9) {{(pid=88112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:33:44.227689 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f471661d-7341-4204-a366-5611da93eb87 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:44.229416 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f471661d-7341-4204-a366-5611da93eb87 None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:44.236470 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 346/701] 10.222.0.26 () {56 vars in 1374 bytes} [Wed Aug 24 05:33:44 2022] GET /identity/v3/role_assignments?user.id=87ff96222a7c4baea31fc1bebf4d89a9&scope.project.id=ded4fe81d4dc43188dd84e53025ee783&role.id=59fa3749ca7f47e2ba1127945e13336c => generated 608 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:33:44.237588 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f471661d-7341-4204-a366-5611da93eb87 None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:44.241097 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:44.286972 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ce01ab-a98f-4606-99bd-8554564f3c87 None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:44.322009 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:44.325656 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed8c79c-5b7e-49ca-8c06-73e7b8d95816 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:44.326335 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed8c79c-5b7e-49ca-8c06-73e7b8d95816 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:44.326719 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed8c79c-5b7e-49ca-8c06-73e7b8d95816 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:44.327098 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed8c79c-5b7e-49ca-8c06-73e7b8d95816 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:44.339977 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed8c79c-5b7e-49ca-8c06-73e7b8d95816 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:44.341558 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed8c79c-5b7e-49ca-8c06-73e7b8d95816 None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:44.359333 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application [None req-9ed8c79c-5b7e-49ca-8c06-73e7b8d95816 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:33:44.359333 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:33:44.359333 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:33:44.359333 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:33:44.359333 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:33:44.359333 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:33:44.359333 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:33:44.359333 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:33:44.359333 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:33:44.359333 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:33:44.359333 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:33:44.359333 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:33:44.359333 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 05:33:44.359333 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 05:33:44.359333 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 05:33:44.359333 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 05:33:44.360409 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:33:44.360409 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:33:44.360409 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:33:44.360409 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:33:44.360409 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:33:44.360409 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:33:44.360409 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:33:44.360409 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application with Lock( Aug 24 05:33:44.360409 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:33:44.360409 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:33:44.360409 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:33:44.360409 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:33:44.360409 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:33:44.360409 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:33:44.360409 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:33:44.360409 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:33:44.360409 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 05:33:44.361321 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 05:33:44.361321 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:33:44.361321 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Aug 24 05:33:44.361321 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 356/702] 10.222.0.26 () {56 vars in 1108 bytes} [Wed Aug 24 05:33:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:33:44.362392 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f471661d-7341-4204-a366-5611da93eb87 None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:44.366074 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed8c79c-5b7e-49ca-8c06-73e7b8d95816 None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:44.401607 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9044f90a-8b2f-41d0-ad9c-c388ccc94586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:44.402682 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9044f90a-8b2f-41d0-ad9c-c388ccc94586 None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:44.403209 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9044f90a-8b2f-41d0-ad9c-c388ccc94586 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:44.403617 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9044f90a-8b2f-41d0-ad9c-c388ccc94586 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:44.417365 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9044f90a-8b2f-41d0-ad9c-c388ccc94586 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:44.419242 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9044f90a-8b2f-41d0-ad9c-c388ccc94586 None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:44.436182 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application [None req-9044f90a-8b2f-41d0-ad9c-c388ccc94586 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:33:44.436182 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:33:44.436182 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:33:44.436182 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:33:44.436182 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:33:44.436182 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:33:44.436182 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:33:44.436182 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:33:44.436182 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:33:44.436182 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:33:44.436182 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:33:44.436182 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:33:44.436182 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 05:33:44.436182 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 05:33:44.436182 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 05:33:44.436182 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 05:33:44.437484 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:33:44.437484 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:33:44.437484 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:33:44.437484 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:33:44.437484 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:33:44.437484 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:33:44.437484 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:33:44.437484 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application with Lock( Aug 24 05:33:44.437484 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:33:44.437484 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:33:44.437484 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:33:44.437484 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:33:44.437484 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:33:44.437484 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:33:44.437484 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:33:44.437484 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:33:44.437484 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 05:33:44.439231 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 05:33:44.439231 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:33:44.439231 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Aug 24 05:33:44.441070 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 347/703] 10.222.0.26 () {56 vars in 1108 bytes} [Wed Aug 24 05:33:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:33:44.442900 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa29c738-b58f-4f01-8b42-757db8f7422c None None] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:44.443393 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa29c738-b58f-4f01-8b42-757db8f7422c None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:44.443813 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa29c738-b58f-4f01-8b42-757db8f7422c None None] PATH_INFO: `/` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:44.445486 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 348/704] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 24 05:33:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:33:44.446357 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa29c738-b58f-4f01-8b42-757db8f7422c None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:44.488831 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed8c79c-5b7e-49ca-8c06-73e7b8d95816 None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:44.506128 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:44.548835 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845a3e0a-7df8-47bd-adf1-20acb79b76f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:44.549696 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845a3e0a-7df8-47bd-adf1-20acb79b76f6 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:44.550214 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845a3e0a-7df8-47bd-adf1-20acb79b76f6 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:44.550656 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845a3e0a-7df8-47bd-adf1-20acb79b76f6 None admin] PATH_INFO: `/v3/domains` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:44.551496 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845a3e0a-7df8-47bd-adf1-20acb79b76f6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:33:44.551872 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845a3e0a-7df8-47bd-adf1-20acb79b76f6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:44.553331 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845a3e0a-7df8-47bd-adf1-20acb79b76f6 None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:44.569523 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 357/705] 10.222.0.26 () {56 vars in 1109 bytes} [Wed Aug 24 05:33:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:33:44.571788 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e86a9e-9ac3-4c6a-93e0-cdaedcd32fa2 None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:44.572401 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e86a9e-9ac3-4c6a-93e0-cdaedcd32fa2 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:44.572401 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e86a9e-9ac3-4c6a-93e0-cdaedcd32fa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:44.580034 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa29c738-b58f-4f01-8b42-757db8f7422c None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:44.594606 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-32e86a9e-9ac3-4c6a-93e0-cdaedcd32fa2 None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:33:44.596246 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-32e86a9e-9ac3-4c6a-93e0-cdaedcd32fa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:33:44.607864 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:44.623799 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baccf50-7f10-48a3-877c-f0e6f35fa20f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:44.624682 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baccf50-7f10-48a3-877c-f0e6f35fa20f None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:44.625180 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baccf50-7f10-48a3-877c-f0e6f35fa20f None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:44.626366 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baccf50-7f10-48a3-877c-f0e6f35fa20f None admin] PATH_INFO: `/v3/domains` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:44.627600 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0baccf50-7f10-48a3-877c-f0e6f35fa20f None admin] RBAC: Adding query filter params (name=Default) {{(pid=88112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:33:44.628053 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0baccf50-7f10-48a3-877c-f0e6f35fa20f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:44.629637 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0baccf50-7f10-48a3-877c-f0e6f35fa20f None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:44.643486 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 349/706] 10.222.0.26 () {56 vars in 1109 bytes} [Wed Aug 24 05:33:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:33:44.645109 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baccf50-7f10-48a3-877c-f0e6f35fa20f None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:44.687991 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 358/707] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 24 05:33:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 05:33:44.689349 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e86a9e-9ac3-4c6a-93e0-cdaedcd32fa2 None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:44.772223 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baccf50-7f10-48a3-877c-f0e6f35fa20f None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:44.795347 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:44.799213 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e86a9e-9ac3-4c6a-93e0-cdaedcd32fa2 None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:44.821533 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909f5e39-8b37-4f07-b90b-9b091ef54a35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:44.822662 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909f5e39-8b37-4f07-b90b-9b091ef54a35 None admin] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:44.822948 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909f5e39-8b37-4f07-b90b-9b091ef54a35 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:44.823224 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909f5e39-8b37-4f07-b90b-9b091ef54a35 None admin] PATH_INFO: `/v3/users` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:44.823871 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909f5e39-8b37-4f07-b90b-9b091ef54a35 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:44.825344 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909f5e39-8b37-4f07-b90b-9b091ef54a35 None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:44.845334 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc692f6-22ac-4299-b526-b1553c653312 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:44.846169 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc692f6-22ac-4299-b526-b1553c653312 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:44.846736 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc692f6-22ac-4299-b526-b1553c653312 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:44.847019 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc692f6-22ac-4299-b526-b1553c653312 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:44.856397 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc692f6-22ac-4299-b526-b1553c653312 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:44.856785 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 350/708] 10.222.0.26 () {60 vars in 1132 bytes} [Wed Aug 24 05:33:44 2022] POST /identity/v3/users => generated 254 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:33:44.858324 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc692f6-22ac-4299-b526-b1553c653312 None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:44.858830 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40cef61-dfde-467c-acd4-232f09944d7a None None] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:44.859300 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40cef61-dfde-467c-acd4-232f09944d7a None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:44.860260 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40cef61-dfde-467c-acd4-232f09944d7a None None] PATH_INFO: `/` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:44.866331 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 351/709] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 24 05:33:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:33:44.872416 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea0caa0-409f-484d-9124-651857fa5d8d None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:44.872998 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea0caa0-409f-484d-9124-651857fa5d8d None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:44.873414 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea0caa0-409f-484d-9124-651857fa5d8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:44.879621 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application [None req-dfc692f6-22ac-4299-b526-b1553c653312 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 05:33:44.879621 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:33:44.879621 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:33:44.879621 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:33:44.879621 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:33:44.879621 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:33:44.879621 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:33:44.879621 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:33:44.879621 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:33:44.879621 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:33:44.879621 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:33:44.879621 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:33:44.879621 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 05:33:44.879621 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 05:33:44.879621 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 05:33:44.880737 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 05:33:44.880737 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:33:44.880737 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:33:44.880737 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:33:44.880737 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:33:44.880737 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:33:44.880737 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:33:44.880737 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:33:44.880737 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application with Lock( Aug 24 05:33:44.880737 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:33:44.880737 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:33:44.880737 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:33:44.880737 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:33:44.880737 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:33:44.880737 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:33:44.880737 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:33:44.880737 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:33:44.881934 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 05:33:44.881934 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 05:33:44.881934 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 05:33:44.881934 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 05:33:44.881934 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 05:33:44.881934 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 05:33:44.881934 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 05:33:44.881934 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Aug 24 05:33:44.881934 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 359/710] 10.222.0.26 () {56 vars in 1111 bytes} [Wed Aug 24 05:33:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:33:44.887042 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc692f6-22ac-4299-b526-b1553c653312 None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:44.915990 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-1ea0caa0-409f-484d-9124-651857fa5d8d None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:33:44.917212 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-1ea0caa0-409f-484d-9124-651857fa5d8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:33:44.996894 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:45.041849 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 352/711] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 24 05:33:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 05:33:45.042834 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea0caa0-409f-484d-9124-651857fa5d8d None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:45.047159 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc692f6-22ac-4299-b526-b1553c653312 None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:45.092410 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696858ae-b3d6-497c-a3b2-4d333a074358 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:45.093026 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696858ae-b3d6-497c-a3b2-4d333a074358 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:45.093308 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696858ae-b3d6-497c-a3b2-4d333a074358 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:45.093581 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696858ae-b3d6-497c-a3b2-4d333a074358 None admin] PATH_INFO: `/v3/projects` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:45.095017 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696858ae-b3d6-497c-a3b2-4d333a074358 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:33:45.095322 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696858ae-b3d6-497c-a3b2-4d333a074358 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:45.097578 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696858ae-b3d6-497c-a3b2-4d333a074358 None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:45.114724 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 360/712] 10.222.0.26 () {56 vars in 1148 bytes} [Wed Aug 24 05:33:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:33:45.120242 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696858ae-b3d6-497c-a3b2-4d333a074358 None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:45.145128 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:45.173263 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea0caa0-409f-484d-9124-651857fa5d8d None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:45.208366 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d5d4ff-6a53-4c23-a577-3055f341985e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:45.209004 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d5d4ff-6a53-4c23-a577-3055f341985e None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:45.209281 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d5d4ff-6a53-4c23-a577-3055f341985e None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:45.209554 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d5d4ff-6a53-4c23-a577-3055f341985e None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:45.210172 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d5d4ff-6a53-4c23-a577-3055f341985e None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:45.211541 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d5d4ff-6a53-4c23-a577-3055f341985e None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:45.223633 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application [None req-90d5d4ff-6a53-4c23-a577-3055f341985e None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 05:33:45.223633 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:33:45.223633 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 05:33:45.223633 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 05:33:45.223633 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 05:33:45.223633 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 05:33:45.223633 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 05:33:45.223633 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 05:33:45.223633 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 05:33:45.223633 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Aug 24 05:33:45.223633 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 05:33:45.223633 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Aug 24 05:33:45.223633 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:33:45.223633 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:33:45.223633 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:33:45.223633 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:33:45.223633 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:33:45.224732 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:33:45.224732 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:33:45.224732 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:33:45.224732 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:33:45.224732 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:33:45.224732 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:33:45.224732 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 05:33:45.224732 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 05:33:45.224732 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 05:33:45.224732 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 05:33:45.224732 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:33:45.224732 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:33:45.224732 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:33:45.224732 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:33:45.224732 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:33:45.224732 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:33:45.225818 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:33:45.225818 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application with Lock( Aug 24 05:33:45.225818 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:33:45.225818 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:33:45.225818 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:33:45.225818 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:33:45.225818 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:33:45.225818 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:33:45.225818 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:33:45.225818 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:33:45.225818 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 05:33:45.225818 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 05:33:45.225818 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 05:33:45.225818 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Aug 24 05:33:45.225818 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 353/713] 10.222.0.26 () {56 vars in 1129 bytes} [Wed Aug 24 05:33:45 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:33:45.230852 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d5d4ff-6a53-4c23-a577-3055f341985e None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:45.240224 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696858ae-b3d6-497c-a3b2-4d333a074358 None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:45.270151 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:45.279860 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af83eea-5213-49cb-925c-131a7b61b75a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:45.280465 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af83eea-5213-49cb-925c-131a7b61b75a None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:45.280845 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af83eea-5213-49cb-925c-131a7b61b75a None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:45.281120 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af83eea-5213-49cb-925c-131a7b61b75a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:45.286401 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af83eea-5213-49cb-925c-131a7b61b75a None admin] RBAC: Adding query filter params (role.id=640bda0879494e60b72680ee505285f0, scope.project.id=ded4fe81d4dc43188dd84e53025ee783, user.id=7b633e1aec6c4269bce13aa9c89e911a) {{(pid=88113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:33:45.286723 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af83eea-5213-49cb-925c-131a7b61b75a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:45.288369 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af83eea-5213-49cb-925c-131a7b61b75a None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:45.300436 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 361/714] 10.222.0.26 () {56 vars in 1374 bytes} [Wed Aug 24 05:33:45 2022] GET /identity/v3/role_assignments?user.id=7b633e1aec6c4269bce13aa9c89e911a&scope.project.id=ded4fe81d4dc43188dd84e53025ee783&role.id=640bda0879494e60b72680ee505285f0 => generated 259 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:33:45.347668 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d5d4ff-6a53-4c23-a577-3055f341985e None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:45.349020 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af83eea-5213-49cb-925c-131a7b61b75a None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:45.383435 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cb29ea-48c9-484e-b2ed-621ee693da51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:45.384077 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cb29ea-48c9-484e-b2ed-621ee693da51 None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:45.384355 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cb29ea-48c9-484e-b2ed-621ee693da51 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:45.384625 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cb29ea-48c9-484e-b2ed-621ee693da51 None admin] PATH_INFO: `/v3/services` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:45.385263 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cb29ea-48c9-484e-b2ed-621ee693da51 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=88112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:33:45.385817 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cb29ea-48c9-484e-b2ed-621ee693da51 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:45.386996 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cb29ea-48c9-484e-b2ed-621ee693da51 None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:45.397324 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 354/715] 10.222.0.26 () {56 vars in 1124 bytes} [Wed Aug 24 05:33:45 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:33:45.402905 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cb29ea-48c9-484e-b2ed-621ee693da51 None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:45.508409 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:45.528918 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af83eea-5213-49cb-925c-131a7b61b75a None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:45.566365 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7be989-8bd8-4b29-81d6-9ca9064535d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:45.567445 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7be989-8bd8-4b29-81d6-9ca9064535d8 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:45.567815 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7be989-8bd8-4b29-81d6-9ca9064535d8 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:45.568180 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7be989-8bd8-4b29-81d6-9ca9064535d8 None admin] PATH_INFO: `/v3/services/network` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:45.568916 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7be989-8bd8-4b29-81d6-9ca9064535d8 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:45.570503 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7be989-8bd8-4b29-81d6-9ca9064535d8 None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:45.571140 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:45.578027 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cb29ea-48c9-484e-b2ed-621ee693da51 None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:45.595416 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application [None req-fa7be989-8bd8-4b29-81d6-9ca9064535d8 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 05:33:45.595416 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:33:45.595416 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 05:33:45.595416 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 05:33:45.595416 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 05:33:45.595416 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 05:33:45.595416 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 05:33:45.595416 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 05:33:45.595416 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 05:33:45.595416 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Aug 24 05:33:45.595416 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 05:33:45.595416 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Aug 24 05:33:45.595416 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:33:45.595416 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:33:45.595416 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:33:45.595416 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:33:45.595416 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:33:45.596524 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:33:45.596524 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:33:45.596524 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:33:45.596524 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:33:45.596524 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:33:45.596524 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:33:45.596524 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 05:33:45.596524 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 05:33:45.596524 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 05:33:45.596524 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 05:33:45.596524 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:33:45.596524 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:33:45.596524 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:33:45.596524 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:33:45.596524 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:33:45.596524 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:33:45.597369 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:33:45.597369 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application with Lock( Aug 24 05:33:45.597369 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:33:45.597369 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:33:45.597369 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:33:45.597369 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:33:45.597369 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:33:45.597369 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:33:45.597369 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:33:45.597369 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:33:45.597369 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 05:33:45.597369 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 05:33:45.597369 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 05:33:45.597369 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Aug 24 05:33:45.600355 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 362/716] 10.222.0.26 () {56 vars in 1111 bytes} [Wed Aug 24 05:33:45 2022] GET /identity/v3/services/network => generated 88 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:33:45.615795 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7be989-8bd8-4b29-81d6-9ca9064535d8 None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:45.630994 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e910b178-73f2-4843-ae18-51f8f1cd9131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:45.631627 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e910b178-73f2-4843-ae18-51f8f1cd9131 None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:45.631909 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e910b178-73f2-4843-ae18-51f8f1cd9131 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:45.632178 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e910b178-73f2-4843-ae18-51f8f1cd9131 None admin] PATH_INFO: `/v3/services` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:45.632816 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e910b178-73f2-4843-ae18-51f8f1cd9131 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=88112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:33:45.633119 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e910b178-73f2-4843-ae18-51f8f1cd9131 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:45.635400 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e910b178-73f2-4843-ae18-51f8f1cd9131 None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:45.647123 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 355/717] 10.222.0.26 () {56 vars in 1124 bytes} [Wed Aug 24 05:33:45 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:33:45.792914 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7be989-8bd8-4b29-81d6-9ca9064535d8 None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:45.834777 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef5cf47-6787-4a55-b6f3-65628f0a6b1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:45.835308 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef5cf47-6787-4a55-b6f3-65628f0a6b1e None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:45.835583 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef5cf47-6787-4a55-b6f3-65628f0a6b1e None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:45.835849 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef5cf47-6787-4a55-b6f3-65628f0a6b1e None admin] PATH_INFO: `/v3/services` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:45.836475 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef5cf47-6787-4a55-b6f3-65628f0a6b1e None admin] RBAC: Adding query filter params (name=network) {{(pid=88113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:33:45.836771 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef5cf47-6787-4a55-b6f3-65628f0a6b1e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:45.838176 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef5cf47-6787-4a55-b6f3-65628f0a6b1e None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:45.843472 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 363/718] 10.222.0.26 () {56 vars in 1112 bytes} [Wed Aug 24 05:33:45 2022] GET /identity/v3/services?name=network => generated 124 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:33:45.849100 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e910b178-73f2-4843-ae18-51f8f1cd9131 None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:45.960181 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e910b178-73f2-4843-ae18-51f8f1cd9131 None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:45.999028 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4181ba6e-1e8e-4f17-812e-226c7e82dc01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:45.999945 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4181ba6e-1e8e-4f17-812e-226c7e82dc01 None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:46.000452 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4181ba6e-1e8e-4f17-812e-226c7e82dc01 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:46.000910 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4181ba6e-1e8e-4f17-812e-226c7e82dc01 None admin] PATH_INFO: `/v3/services` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:46.001762 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4181ba6e-1e8e-4f17-812e-226c7e82dc01 None admin] RBAC: Adding query filter params (type=network) {{(pid=88112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:33:46.002277 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4181ba6e-1e8e-4f17-812e-226c7e82dc01 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:46.005396 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4181ba6e-1e8e-4f17-812e-226c7e82dc01 None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:46.010747 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 356/719] 10.222.0.26 () {56 vars in 1112 bytes} [Wed Aug 24 05:33:45 2022] GET /identity/v3/services?type=network => generated 124 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:33:46.507848 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb490bd3-250a-4c33-b72c-dfc669be1cb4 None None] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:46.508364 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb490bd3-250a-4c33-b72c-dfc669be1cb4 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:46.508461 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb490bd3-250a-4c33-b72c-dfc669be1cb4 None None] PATH_INFO: `/` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:46.509987 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 364/720] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 24 05:33:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:33:46.515243 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fb1cad-4b05-41a7-8769-c6c2a218de03 None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:46.515538 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fb1cad-4b05-41a7-8769-c6c2a218de03 None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:46.515813 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fb1cad-4b05-41a7-8769-c6c2a218de03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:46.534767 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-91fb1cad-4b05-41a7-8769-c6c2a218de03 None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:33:46.535964 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-91fb1cad-4b05-41a7-8769-c6c2a218de03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:33:46.554445 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:46.623858 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 357/721] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 24 05:33:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 05:33:47.001768 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb490bd3-250a-4c33-b72c-dfc669be1cb4 None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:47.018478 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:47.124759 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb490bd3-250a-4c33-b72c-dfc669be1cb4 None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:47.152556 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbec689-6dfc-4d4a-8d47-1d1421b99f58 None None] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:47.153126 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbec689-6dfc-4d4a-8d47-1d1421b99f58 None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:47.153126 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbec689-6dfc-4d4a-8d47-1d1421b99f58 None None] PATH_INFO: `/` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:47.154708 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 358/722] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 24 05:33:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:33:47.160083 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db186e20-d213-4c58-a420-6247adcfc4f3 None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:47.160363 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db186e20-d213-4c58-a420-6247adcfc4f3 None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:47.160635 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db186e20-d213-4c58-a420-6247adcfc4f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:47.178320 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb714ca-2128-4f9b-ac1b-b6247264aaec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:47.178546 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-db186e20-d213-4c58-a420-6247adcfc4f3 None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:33:47.178947 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb714ca-2128-4f9b-ac1b-b6247264aaec None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:47.179222 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb714ca-2128-4f9b-ac1b-b6247264aaec None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:47.179491 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb714ca-2128-4f9b-ac1b-b6247264aaec None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:47.179657 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-db186e20-d213-4c58-a420-6247adcfc4f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:33:47.197641 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb714ca-2128-4f9b-ac1b-b6247264aaec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:33:47.202423 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application [None req-9eb714ca-2128-4f9b-ac1b-b6247264aaec None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 05:33:47.202423 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:33:47.202423 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:33:47.202423 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:33:47.202423 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:33:47.202423 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:33:47.202423 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:33:47.202423 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:33:47.202423 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:33:47.202423 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:33:47.202423 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:33:47.202423 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:33:47.202423 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:33:47.202423 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:33:47.202423 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:33:47.202423 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:33:47.203979 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:33:47.203979 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:33:47.203979 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:33:47.203979 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:33:47.203979 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:33:47.203979 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:33:47.203979 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:33:47.203979 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:33:47.203979 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:33:47.203979 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:33:47.203979 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:33:47.203979 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application with Lock( Aug 24 05:33:47.203979 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:33:47.203979 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:33:47.203979 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:33:47.203979 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:33:47.204819 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:33:47.204819 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:33:47.204819 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:33:47.204819 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:33:47.204819 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:33:47.204819 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:33:47.204819 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:33:47.204819 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:33:47.204819 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:33:47.204819 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:33:47.204819 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 05:33:47.204819 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Aug 24 05:33:47.204819 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 365/723] 10.222.0.26 () {56 vars in 1096 bytes} [Wed Aug 24 05:33:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:33:47.210191 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb714ca-2128-4f9b-ac1b-b6247264aaec None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:47.273330 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 359/724] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 24 05:33:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 05:33:47.317510 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:47.348718 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb714ca-2128-4f9b-ac1b-b6247264aaec None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:47.383415 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29165025-a12c-45d7-8b75-b695fab35afd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:47.384021 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29165025-a12c-45d7-8b75-b695fab35afd None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:47.384295 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29165025-a12c-45d7-8b75-b695fab35afd None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:47.384565 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29165025-a12c-45d7-8b75-b695fab35afd None admin] PATH_INFO: `/v3/roles` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:47.385223 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29165025-a12c-45d7-8b75-b695fab35afd None admin] RBAC: Adding query filter params (name=admin) {{(pid=88113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:33:47.385522 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29165025-a12c-45d7-8b75-b695fab35afd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:47.387032 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29165025-a12c-45d7-8b75-b695fab35afd None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:47.396304 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 366/725] 10.222.0.26 () {56 vars in 1099 bytes} [Wed Aug 24 05:33:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:33:47.401731 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db186e20-d213-4c58-a420-6247adcfc4f3 None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:47.493060 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:47.519155 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db186e20-d213-4c58-a420-6247adcfc4f3 None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:47.567302 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145ceafd-7408-4547-ad63-a56c80f72ca6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:47.568301 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145ceafd-7408-4547-ad63-a56c80f72ca6 None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:47.568866 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145ceafd-7408-4547-ad63-a56c80f72ca6 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:47.569349 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145ceafd-7408-4547-ad63-a56c80f72ca6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:47.580696 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145ceafd-7408-4547-ad63-a56c80f72ca6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:47.582452 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145ceafd-7408-4547-ad63-a56c80f72ca6 None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:47.597432 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application [None req-145ceafd-7408-4547-ad63-a56c80f72ca6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:33:47.597432 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:33:47.597432 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:33:47.597432 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:33:47.597432 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:33:47.597432 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:33:47.597432 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:33:47.597432 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:33:47.597432 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:33:47.597432 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:33:47.597432 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:33:47.597432 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:33:47.597432 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 05:33:47.597432 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 05:33:47.597432 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 05:33:47.597432 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 05:33:47.598463 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:33:47.598463 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:33:47.598463 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:33:47.598463 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:33:47.598463 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:33:47.598463 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:33:47.598463 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:33:47.598463 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application with Lock( Aug 24 05:33:47.598463 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:33:47.598463 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:33:47.598463 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:33:47.598463 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:33:47.598463 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:33:47.598463 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:33:47.598463 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:33:47.598463 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:33:47.598463 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 05:33:47.599352 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 05:33:47.599352 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:33:47.599352 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Aug 24 05:33:47.601470 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 360/726] 10.222.0.26 () {56 vars in 1108 bytes} [Wed Aug 24 05:33:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:33:47.607305 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29165025-a12c-45d7-8b75-b695fab35afd None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:47.685987 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145ceafd-7408-4547-ad63-a56c80f72ca6 None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:47.736909 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29165025-a12c-45d7-8b75-b695fab35afd None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:47.802969 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbb1887-1975-4a37-827e-d160600578a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:47.803502 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbb1887-1975-4a37-827e-d160600578a1 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:47.803775 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbb1887-1975-4a37-827e-d160600578a1 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:47.804047 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbb1887-1975-4a37-827e-d160600578a1 None admin] PATH_INFO: `/v3/domains` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:47.804692 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbb1887-1975-4a37-827e-d160600578a1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:33:47.804987 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbb1887-1975-4a37-827e-d160600578a1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:47.806383 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbb1887-1975-4a37-827e-d160600578a1 None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:47.810069 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:47.832318 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 367/727] 10.222.0.26 () {56 vars in 1109 bytes} [Wed Aug 24 05:33:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:33:47.838845 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbb1887-1975-4a37-827e-d160600578a1 None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:47.874174 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145ceafd-7408-4547-ad63-a56c80f72ca6 None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:47.932679 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575046f7-ca32-4305-a46e-c3ec71547cae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:47.933302 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575046f7-ca32-4305-a46e-c3ec71547cae None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:47.933678 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575046f7-ca32-4305-a46e-c3ec71547cae None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:47.933971 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575046f7-ca32-4305-a46e-c3ec71547cae None admin] PATH_INFO: `/v3/roles/service` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:47.936870 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:47.947875 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575046f7-ca32-4305-a46e-c3ec71547cae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:33:47.953234 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application [None req-575046f7-ca32-4305-a46e-c3ec71547cae None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 05:33:47.953234 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:33:47.953234 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:33:47.953234 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:33:47.953234 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:33:47.953234 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:33:47.953234 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:33:47.953234 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:33:47.953234 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:33:47.953234 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:33:47.953234 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:33:47.953234 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:33:47.953234 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:33:47.953234 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:33:47.953234 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:33:47.953234 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:33:47.954199 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:33:47.954199 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:33:47.954199 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:33:47.954199 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:33:47.954199 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:33:47.954199 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:33:47.954199 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:33:47.954199 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:33:47.954199 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:33:47.954199 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:33:47.954199 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:33:47.954199 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application with Lock( Aug 24 05:33:47.954199 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:33:47.954199 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:33:47.954199 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:33:47.954199 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:33:47.955055 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:33:47.955055 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:33:47.955055 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:33:47.955055 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:33:47.955055 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:33:47.955055 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:33:47.955055 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:33:47.955055 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:33:47.955055 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:33:47.955055 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:33:47.955055 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 05:33:47.955055 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Aug 24 05:33:47.955055 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 361/728] 10.222.0.26 () {56 vars in 1102 bytes} [Wed Aug 24 05:33:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 05:33:47.956219 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f69cd40-3ccc-4670-b911-c4df4b212f7a None None] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:47.956318 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f69cd40-3ccc-4670-b911-c4df4b212f7a None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:47.956536 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f69cd40-3ccc-4670-b911-c4df4b212f7a None None] PATH_INFO: `/` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:47.962655 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 362/729] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 24 05:33:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:33:47.963538 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f69cd40-3ccc-4670-b911-c4df4b212f7a None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:47.981722 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbb1887-1975-4a37-827e-d160600578a1 None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:48.023660 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff08d071-b413-4c57-a21d-0992ef5b9210 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:48.024291 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff08d071-b413-4c57-a21d-0992ef5b9210 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:48.024569 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff08d071-b413-4c57-a21d-0992ef5b9210 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:48.024836 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff08d071-b413-4c57-a21d-0992ef5b9210 None admin] PATH_INFO: `/v3/users/swift` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:48.032583 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff08d071-b413-4c57-a21d-0992ef5b9210 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:48.034036 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff08d071-b413-4c57-a21d-0992ef5b9210 None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:48.045053 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application [None req-ff08d071-b413-4c57-a21d-0992ef5b9210 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 24 05:33:48.045053 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:33:48.045053 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:33:48.045053 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:33:48.045053 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:33:48.045053 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:33:48.045053 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:33:48.045053 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:33:48.045053 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:33:48.045053 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:33:48.045053 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:33:48.045053 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:33:48.045053 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 05:33:48.045053 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 05:33:48.045053 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 05:33:48.045053 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 05:33:48.046064 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:33:48.046064 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:33:48.046064 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 05:33:48.046064 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 05:33:48.046064 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 05:33:48.046064 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 05:33:48.046064 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:33:48.046064 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:33:48.046064 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:33:48.046064 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:33:48.046064 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:33:48.046064 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application with Lock( Aug 24 05:33:48.046064 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:33:48.046064 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:33:48.046064 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:33:48.046064 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:33:48.046064 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:33:48.046064 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:33:48.047107 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:33:48.047107 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:33:48.047107 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 05:33:48.047107 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 05:33:48.047107 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 05:33:48.047107 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 05:33:48.047107 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 05:33:48.047107 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 05:33:48.047107 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 24 05:33:48.047107 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Aug 24 05:33:48.047107 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 368/730] 10.222.0.26 () {56 vars in 1096 bytes} [Wed Aug 24 05:33:47 2022] GET /identity/v3/users/swift => generated 83 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:33:48.048262 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a43a6d-1170-4282-8fb2-22e595be7e59 None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:48.048552 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a43a6d-1170-4282-8fb2-22e595be7e59 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:48.048894 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a43a6d-1170-4282-8fb2-22e595be7e59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:48.066316 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-49a43a6d-1170-4282-8fb2-22e595be7e59 None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:33:48.067668 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-49a43a6d-1170-4282-8fb2-22e595be7e59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:33:48.085841 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f69cd40-3ccc-4670-b911-c4df4b212f7a None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:48.118557 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:48.123782 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3730d94d-5f8d-4747-afcc-d8c04f948e76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:48.124404 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3730d94d-5f8d-4747-afcc-d8c04f948e76 None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:48.124688 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3730d94d-5f8d-4747-afcc-d8c04f948e76 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:48.124956 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3730d94d-5f8d-4747-afcc-d8c04f948e76 None admin] PATH_INFO: `/v3/roles` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:48.125668 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3730d94d-5f8d-4747-afcc-d8c04f948e76 None admin] RBAC: Adding query filter params (name=service) {{(pid=88112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:33:48.125988 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3730d94d-5f8d-4747-afcc-d8c04f948e76 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:48.127349 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3730d94d-5f8d-4747-afcc-d8c04f948e76 None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:48.136206 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 363/731] 10.222.0.26 () {56 vars in 1103 bytes} [Wed Aug 24 05:33:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:33:48.139218 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673e4208-5af7-4f63-a51b-b15a08b4d4f7 None None] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:48.139506 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673e4208-5af7-4f63-a51b-b15a08b4d4f7 None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:48.139777 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673e4208-5af7-4f63-a51b-b15a08b4d4f7 None None] PATH_INFO: `/` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:48.141355 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 364/732] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 24 05:33:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:33:48.142108 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673e4208-5af7-4f63-a51b-b15a08b4d4f7 None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:48.154284 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 369/733] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 24 05:33:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 05:33:48.154284 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a43a6d-1170-4282-8fb2-22e595be7e59 None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:48.230530 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:48.289818 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a43a6d-1170-4282-8fb2-22e595be7e59 None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:48.295562 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673e4208-5af7-4f63-a51b-b15a08b4d4f7 None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:48.337481 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c82509b-9150-4da5-ad93-97299d369c54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:48.338470 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c82509b-9150-4da5-ad93-97299d369c54 None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:48.339504 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c82509b-9150-4da5-ad93-97299d369c54 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:48.340013 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c82509b-9150-4da5-ad93-97299d369c54 None admin] PATH_INFO: `/v3/users` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:48.340947 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c82509b-9150-4da5-ad93-97299d369c54 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=88112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:33:48.341467 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c82509b-9150-4da5-ad93-97299d369c54 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:48.343635 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c82509b-9150-4da5-ad93-97299d369c54 None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:48.368960 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 365/734] 10.222.0.26 () {56 vars in 1135 bytes} [Wed Aug 24 05:33:48 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:33:48.370983 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea34f678-405d-4cbd-8a62-e37a66860013 None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:48.371553 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea34f678-405d-4cbd-8a62-e37a66860013 None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:48.371855 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970dcad4-ab29-4e54-af06-b7d1dc0e8b4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:48.372282 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea34f678-405d-4cbd-8a62-e37a66860013 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:48.372496 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970dcad4-ab29-4e54-af06-b7d1dc0e8b4b None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:48.372762 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970dcad4-ab29-4e54-af06-b7d1dc0e8b4b None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:48.373180 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970dcad4-ab29-4e54-af06-b7d1dc0e8b4b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:48.385511 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970dcad4-ab29-4e54-af06-b7d1dc0e8b4b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:48.387696 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970dcad4-ab29-4e54-af06-b7d1dc0e8b4b None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:48.397101 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-ea34f678-405d-4cbd-8a62-e37a66860013 None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:33:48.399307 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-ea34f678-405d-4cbd-8a62-e37a66860013 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:33:48.404525 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application [None req-970dcad4-ab29-4e54-af06-b7d1dc0e8b4b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:33:48.404525 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:33:48.404525 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:33:48.404525 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:33:48.404525 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:33:48.404525 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:33:48.404525 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:33:48.404525 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:33:48.404525 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:33:48.404525 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:33:48.404525 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:33:48.404525 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:33:48.404525 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 05:33:48.404525 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 05:33:48.404525 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 05:33:48.404525 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 05:33:48.405538 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:33:48.405538 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:33:48.405538 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:33:48.405538 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:33:48.405538 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:33:48.405538 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:33:48.405538 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:33:48.405538 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application with Lock( Aug 24 05:33:48.405538 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:33:48.405538 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:33:48.405538 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:33:48.405538 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:33:48.405538 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:33:48.405538 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:33:48.405538 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:33:48.405538 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:33:48.405538 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 05:33:48.407053 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 05:33:48.407053 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:33:48.407053 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Aug 24 05:33:48.410365 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 370/735] 10.222.0.26 () {56 vars in 1108 bytes} [Wed Aug 24 05:33:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:33:48.411279 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970dcad4-ab29-4e54-af06-b7d1dc0e8b4b None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:48.464894 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:48.497980 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 366/736] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 24 05:33:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 05:33:48.497980 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea34f678-405d-4cbd-8a62-e37a66860013 None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:48.555005 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:48.585076 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970dcad4-ab29-4e54-af06-b7d1dc0e8b4b None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:48.624139 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea34f678-405d-4cbd-8a62-e37a66860013 None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:48.667865 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16b8c72-7a88-464c-99ac-65e3e0786ab6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:48.668550 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16b8c72-7a88-464c-99ac-65e3e0786ab6 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:48.668829 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16b8c72-7a88-464c-99ac-65e3e0786ab6 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:48.668954 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d2e682-fbb3-4603-8896-a67e0dc64601 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:48.669146 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16b8c72-7a88-464c-99ac-65e3e0786ab6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:48.671529 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d2e682-fbb3-4603-8896-a67e0dc64601 None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:48.671529 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d2e682-fbb3-4603-8896-a67e0dc64601 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:48.671529 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d2e682-fbb3-4603-8896-a67e0dc64601 None admin] PATH_INFO: `/v3/domains` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:48.671529 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d2e682-fbb3-4603-8896-a67e0dc64601 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:33:48.671529 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d2e682-fbb3-4603-8896-a67e0dc64601 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:48.672549 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d2e682-fbb3-4603-8896-a67e0dc64601 None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:48.685226 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 367/737] 10.222.0.26 () {56 vars in 1109 bytes} [Wed Aug 24 05:33:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:33:48.691088 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d2e682-fbb3-4603-8896-a67e0dc64601 None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:48.787909 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16b8c72-7a88-464c-99ac-65e3e0786ab6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:48.790018 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16b8c72-7a88-464c-99ac-65e3e0786ab6 None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:48.797769 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d2e682-fbb3-4603-8896-a67e0dc64601 None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:48.806587 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:48.826957 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:48.834774 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f6ad34-a592-4831-8de9-b0f395b6dda5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:48.835381 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f6ad34-a592-4831-8de9-b0f395b6dda5 None admin] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:48.835667 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f6ad34-a592-4831-8de9-b0f395b6dda5 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:48.835947 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f6ad34-a592-4831-8de9-b0f395b6dda5 None admin] PATH_INFO: `/v3/services` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:48.836590 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f6ad34-a592-4831-8de9-b0f395b6dda5 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:48.837976 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f6ad34-a592-4831-8de9-b0f395b6dda5 None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:48.853204 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 368/738] 10.222.0.26 () {60 vars in 1141 bytes} [Wed Aug 24 05:33:48 2022] POST /identity/v3/services => generated 251 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:33:48.854037 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f6ad34-a592-4831-8de9-b0f395b6dda5 None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:48.908044 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 371/739] 10.222.0.26 () {58 vars in 1282 bytes} [Wed Aug 24 05:33:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 492 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 05:33:48.908044 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18505081-3924-49a2-9f43-c5f32520147f None None] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:48.908044 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18505081-3924-49a2-9f43-c5f32520147f None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:48.908044 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18505081-3924-49a2-9f43-c5f32520147f None None] PATH_INFO: `/` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:48.908044 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 372/740] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 24 05:33:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:33:48.908044 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18505081-3924-49a2-9f43-c5f32520147f None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:48.991478 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f6ad34-a592-4831-8de9-b0f395b6dda5 None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:49.023209 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18505081-3924-49a2-9f43-c5f32520147f None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:49.034132 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2245b94c-30c9-4646-b1ff-96160ee7f2a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:49.034762 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2245b94c-30c9-4646-b1ff-96160ee7f2a6 None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:49.035042 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2245b94c-30c9-4646-b1ff-96160ee7f2a6 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:49.035312 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2245b94c-30c9-4646-b1ff-96160ee7f2a6 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:49.047948 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2245b94c-30c9-4646-b1ff-96160ee7f2a6 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:49.050539 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2245b94c-30c9-4646-b1ff-96160ee7f2a6 None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:49.060389 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a52565-eca5-46ae-8ee9-109297e1de47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:49.061015 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a52565-eca5-46ae-8ee9-109297e1de47 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:49.061290 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a52565-eca5-46ae-8ee9-109297e1de47 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:49.061553 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a52565-eca5-46ae-8ee9-109297e1de47 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:49.065076 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:49.068299 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application [None req-2245b94c-30c9-4646-b1ff-96160ee7f2a6 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 05:33:49.068299 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:33:49.068299 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:33:49.068299 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:33:49.068299 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:33:49.068299 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:33:49.068299 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:33:49.068299 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:33:49.068299 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:33:49.068299 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:33:49.068299 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:33:49.068299 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:33:49.068299 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 05:33:49.068299 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 05:33:49.068299 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 05:33:49.068299 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 05:33:49.069215 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:33:49.069215 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:33:49.069215 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 05:33:49.069215 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 05:33:49.069215 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 05:33:49.069215 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 05:33:49.069215 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:33:49.069215 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:33:49.069215 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:33:49.069215 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:33:49.069215 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:33:49.069215 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application with Lock( Aug 24 05:33:49.069215 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:33:49.069215 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:33:49.069215 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:33:49.069215 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:33:49.069215 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:33:49.069215 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:33:49.070192 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:33:49.070192 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:33:49.070192 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 05:33:49.070192 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 05:33:49.070192 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 05:33:49.070192 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 05:33:49.070192 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 05:33:49.070192 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 05:33:49.070192 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 05:33:49.070192 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Aug 24 05:33:49.070192 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 369/741] 10.222.0.26 () {56 vars in 1117 bytes} [Wed Aug 24 05:33:48 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:33:49.070782 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2245b94c-30c9-4646-b1ff-96160ee7f2a6 None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:49.080445 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a52565-eca5-46ae-8ee9-109297e1de47 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:33:49.085107 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application [None req-35a52565-eca5-46ae-8ee9-109297e1de47 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 05:33:49.085107 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:33:49.085107 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:33:49.085107 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:33:49.085107 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:33:49.085107 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:33:49.085107 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:33:49.085107 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:33:49.085107 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:33:49.085107 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:33:49.085107 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:33:49.085107 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:33:49.085107 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:33:49.085107 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:33:49.085107 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:33:49.085107 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:33:49.086060 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:33:49.086060 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:33:49.086060 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:33:49.086060 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:33:49.086060 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:33:49.086060 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:33:49.086060 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:33:49.086060 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:33:49.086060 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:33:49.086060 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:33:49.086060 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:33:49.086060 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application with Lock( Aug 24 05:33:49.086060 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:33:49.086060 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:33:49.086060 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:33:49.086060 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:33:49.086905 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:33:49.086905 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:33:49.086905 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:33:49.086905 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:33:49.086905 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:33:49.086905 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:33:49.086905 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:33:49.086905 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:33:49.086905 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:33:49.086905 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:33:49.086905 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 05:33:49.086905 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Aug 24 05:33:49.086905 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 373/742] 10.222.0.26 () {56 vars in 1096 bytes} [Wed Aug 24 05:33:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:33:49.087598 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76124328-9ea9-4a83-adc5-eea3d83aaf8e None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:49.088255 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76124328-9ea9-4a83-adc5-eea3d83aaf8e None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:49.088255 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76124328-9ea9-4a83-adc5-eea3d83aaf8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:49.101603 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:49.106610 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-76124328-9ea9-4a83-adc5-eea3d83aaf8e None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:33:49.107918 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-76124328-9ea9-4a83-adc5-eea3d83aaf8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:33:49.190056 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 374/743] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 24 05:33:49 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 05:33:49.190056 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76124328-9ea9-4a83-adc5-eea3d83aaf8e None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:49.196086 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2245b94c-30c9-4646-b1ff-96160ee7f2a6 None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:49.237596 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb6e8e7-054d-416e-aafb-d6f18f73bc8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:49.238402 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb6e8e7-054d-416e-aafb-d6f18f73bc8e None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:49.238701 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb6e8e7-054d-416e-aafb-d6f18f73bc8e None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:49.238967 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb6e8e7-054d-416e-aafb-d6f18f73bc8e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:49.253486 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb6e8e7-054d-416e-aafb-d6f18f73bc8e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:49.255298 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb6e8e7-054d-416e-aafb-d6f18f73bc8e None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:49.273612 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application [None req-edb6e8e7-054d-416e-aafb-d6f18f73bc8e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:33:49.273612 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:33:49.273612 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:33:49.273612 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:33:49.273612 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:33:49.273612 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:33:49.273612 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:33:49.273612 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:33:49.273612 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:33:49.273612 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:33:49.273612 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:33:49.273612 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:33:49.273612 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 05:33:49.273612 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 05:33:49.273612 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 05:33:49.273612 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 05:33:49.274667 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:33:49.274667 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:33:49.274667 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:33:49.274667 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:33:49.274667 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:33:49.274667 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:33:49.274667 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:33:49.274667 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application with Lock( Aug 24 05:33:49.274667 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:33:49.274667 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:33:49.274667 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:33:49.274667 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:33:49.274667 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:33:49.274667 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:33:49.274667 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:33:49.274667 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:33:49.274667 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 05:33:49.275581 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 05:33:49.275581 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:33:49.275581 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Aug 24 05:33:49.275581 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 370/744] 10.222.0.26 () {56 vars in 1108 bytes} [Wed Aug 24 05:33:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:33:49.276800 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb6e8e7-054d-416e-aafb-d6f18f73bc8e None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:49.294851 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76124328-9ea9-4a83-adc5-eea3d83aaf8e None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:49.327549 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:49.340212 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9f935f-ae80-4b5c-95e5-ac3d30802402 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:49.341059 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9f935f-ae80-4b5c-95e5-ac3d30802402 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:49.341487 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9f935f-ae80-4b5c-95e5-ac3d30802402 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:49.341909 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9f935f-ae80-4b5c-95e5-ac3d30802402 None admin] PATH_INFO: `/v3/users` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:49.343367 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9f935f-ae80-4b5c-95e5-ac3d30802402 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=88113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:33:49.344101 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9f935f-ae80-4b5c-95e5-ac3d30802402 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:49.346213 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9f935f-ae80-4b5c-95e5-ac3d30802402 None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:49.366430 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:49.370365 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 375/745] 10.222.0.26 () {56 vars in 1149 bytes} [Wed Aug 24 05:33:49 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:33:49.371693 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9f935f-ae80-4b5c-95e5-ac3d30802402 None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:49.394411 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb6e8e7-054d-416e-aafb-d6f18f73bc8e None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:49.440399 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7725689-af39-4a7c-a89c-7359cb0b6e23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:49.441512 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7725689-af39-4a7c-a89c-7359cb0b6e23 None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:49.442241 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7725689-af39-4a7c-a89c-7359cb0b6e23 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:49.442925 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7725689-af39-4a7c-a89c-7359cb0b6e23 None admin] PATH_INFO: `/v3/roles` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:49.444211 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7725689-af39-4a7c-a89c-7359cb0b6e23 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:33:49.444948 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7725689-af39-4a7c-a89c-7359cb0b6e23 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:49.447169 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7725689-af39-4a7c-a89c-7359cb0b6e23 None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:49.459353 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 371/746] 10.222.0.26 () {56 vars in 1099 bytes} [Wed Aug 24 05:33:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:33:49.460407 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7725689-af39-4a7c-a89c-7359cb0b6e23 None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:49.496672 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9f935f-ae80-4b5c-95e5-ac3d30802402 None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:49.542970 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2357ace6-bb8e-4899-ab33-3dba4f41670c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:49.543592 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2357ace6-bb8e-4899-ab33-3dba4f41670c None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:49.543871 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2357ace6-bb8e-4899-ab33-3dba4f41670c None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:49.544143 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2357ace6-bb8e-4899-ab33-3dba4f41670c None admin] PATH_INFO: `/v3/domains` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:49.544787 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2357ace6-bb8e-4899-ab33-3dba4f41670c None admin] RBAC: Adding query filter params (name=Default) {{(pid=88113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:33:49.545091 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2357ace6-bb8e-4899-ab33-3dba4f41670c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:49.546496 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2357ace6-bb8e-4899-ab33-3dba4f41670c None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:49.558812 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 376/747] 10.222.0.26 () {56 vars in 1109 bytes} [Wed Aug 24 05:33:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:33:49.563822 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2357ace6-bb8e-4899-ab33-3dba4f41670c None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:49.583736 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7725689-af39-4a7c-a89c-7359cb0b6e23 None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:49.611444 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:49.623169 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d6622b-e3d4-48b1-94ec-036161c5dd1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:49.623850 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d6622b-e3d4-48b1-94ec-036161c5dd1f None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:49.624130 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d6622b-e3d4-48b1-94ec-036161c5dd1f None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:49.624429 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d6622b-e3d4-48b1-94ec-036161c5dd1f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:49.628746 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:49.669466 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2357ace6-bb8e-4899-ab33-3dba4f41670c None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:49.697992 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d6622b-e3d4-48b1-94ec-036161c5dd1f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:49.699527 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d6622b-e3d4-48b1-94ec-036161c5dd1f None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:49.707386 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363b68c2-e971-42c0-9017-caa7d33a9761 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:49.707943 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363b68c2-e971-42c0-9017-caa7d33a9761 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:49.708219 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363b68c2-e971-42c0-9017-caa7d33a9761 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:49.708485 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363b68c2-e971-42c0-9017-caa7d33a9761 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:49.719459 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363b68c2-e971-42c0-9017-caa7d33a9761 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:49.720889 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363b68c2-e971-42c0-9017-caa7d33a9761 None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:49.735598 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application [None req-363b68c2-e971-42c0-9017-caa7d33a9761 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:33:49.735598 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:33:49.735598 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:33:49.735598 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:33:49.735598 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:33:49.735598 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:33:49.735598 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:33:49.735598 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:33:49.735598 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:33:49.735598 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:33:49.735598 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:33:49.735598 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:33:49.735598 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 05:33:49.735598 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 05:33:49.735598 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 05:33:49.735598 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 05:33:49.736536 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:33:49.736536 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:33:49.736536 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:33:49.736536 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:33:49.736536 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:33:49.736536 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:33:49.736536 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:33:49.736536 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application with Lock( Aug 24 05:33:49.736536 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:33:49.736536 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:33:49.736536 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:33:49.736536 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:33:49.736536 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:33:49.736536 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:33:49.736536 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:33:49.736536 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:33:49.736536 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 05:33:49.737421 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 05:33:49.737421 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:33:49.737421 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Aug 24 05:33:49.737421 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 377/748] 10.222.0.26 () {56 vars in 1108 bytes} [Wed Aug 24 05:33:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:33:49.737643 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363b68c2-e971-42c0-9017-caa7d33a9761 None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:49.808057 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 372/749] 10.222.0.26 () {58 vars in 1282 bytes} [Wed Aug 24 05:33:49 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 05:33:49.809229 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d6622b-e3d4-48b1-94ec-036161c5dd1f None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:49.847234 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:49.852440 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:49.854148 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363b68c2-e971-42c0-9017-caa7d33a9761 None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:49.891183 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cb3224-7386-48f4-bd7c-f8b8c2ec4ccf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:49.891785 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cb3224-7386-48f4-bd7c-f8b8c2ec4ccf None admin] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:49.892064 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cb3224-7386-48f4-bd7c-f8b8c2ec4ccf None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:49.892327 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cb3224-7386-48f4-bd7c-f8b8c2ec4ccf None admin] PATH_INFO: `/v3/services` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:49.892967 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cb3224-7386-48f4-bd7c-f8b8c2ec4ccf None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:49.894363 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cb3224-7386-48f4-bd7c-f8b8c2ec4ccf None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:49.910634 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 378/750] 10.222.0.26 () {60 vars in 1141 bytes} [Wed Aug 24 05:33:49 2022] POST /identity/v3/services => generated 240 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:33:49.911284 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cb3224-7386-48f4-bd7c-f8b8c2ec4ccf None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:49.925628 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d6622b-e3d4-48b1-94ec-036161c5dd1f None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:49.975891 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f4ad15-9962-4ee6-ba97-82e918857b69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:49.976544 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f4ad15-9962-4ee6-ba97-82e918857b69 None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:49.976894 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f4ad15-9962-4ee6-ba97-82e918857b69 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:49.977236 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f4ad15-9962-4ee6-ba97-82e918857b69 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:49.986195 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f4ad15-9962-4ee6-ba97-82e918857b69 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:49.987836 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f4ad15-9962-4ee6-ba97-82e918857b69 None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:50.000587 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application [None req-61f4ad15-9962-4ee6-ba97-82e918857b69 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 05:33:50.000587 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:33:50.000587 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:33:50.000587 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:33:50.000587 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:33:50.000587 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:33:50.000587 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:33:50.000587 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:33:50.000587 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:33:50.000587 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:33:50.000587 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:33:50.000587 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:33:50.000587 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 05:33:50.000587 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 05:33:50.000587 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 05:33:50.001554 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 05:33:50.001554 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:33:50.001554 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:33:50.001554 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:33:50.001554 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:33:50.001554 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:33:50.001554 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:33:50.001554 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:33:50.001554 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application with Lock( Aug 24 05:33:50.001554 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:33:50.001554 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:33:50.001554 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:33:50.001554 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:33:50.001554 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:33:50.001554 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:33:50.001554 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:33:50.001554 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:33:50.002505 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 05:33:50.002505 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 05:33:50.002505 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 05:33:50.002505 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 05:33:50.002505 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 05:33:50.002505 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 05:33:50.002505 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 05:33:50.002505 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Aug 24 05:33:50.002505 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 373/751] 10.222.0.26 () {56 vars in 1111 bytes} [Wed Aug 24 05:33:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:33:50.003564 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f4ad15-9962-4ee6-ba97-82e918857b69 None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:50.054062 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cb3224-7386-48f4-bd7c-f8b8c2ec4ccf None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:50.095038 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6977050f-a19a-4f0f-88d9-e93d6091d344 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:50.095723 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6977050f-a19a-4f0f-88d9-e93d6091d344 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:50.096007 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6977050f-a19a-4f0f-88d9-e93d6091d344 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:50.096284 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6977050f-a19a-4f0f-88d9-e93d6091d344 None admin] PATH_INFO: `/v3/domains` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:50.096987 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6977050f-a19a-4f0f-88d9-e93d6091d344 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:33:50.097299 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6977050f-a19a-4f0f-88d9-e93d6091d344 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:50.098759 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6977050f-a19a-4f0f-88d9-e93d6091d344 None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:50.112764 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 379/752] 10.222.0.26 () {56 vars in 1109 bytes} [Wed Aug 24 05:33:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:33:50.113590 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6977050f-a19a-4f0f-88d9-e93d6091d344 None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:50.124320 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:50.135059 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:50.135346 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f4ad15-9962-4ee6-ba97-82e918857b69 None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:50.171466 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf01590-ba29-4eac-8f74-05bb58ccf1a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:50.172822 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf01590-ba29-4eac-8f74-05bb58ccf1a4 None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:50.173198 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf01590-ba29-4eac-8f74-05bb58ccf1a4 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:50.173563 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf01590-ba29-4eac-8f74-05bb58ccf1a4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:50.185412 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf01590-ba29-4eac-8f74-05bb58ccf1a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:50.187070 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf01590-ba29-4eac-8f74-05bb58ccf1a4 None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:50.201876 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application [None req-aaf01590-ba29-4eac-8f74-05bb58ccf1a4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:33:50.201876 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:33:50.201876 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:33:50.201876 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:33:50.201876 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:33:50.201876 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:33:50.201876 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:33:50.201876 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:33:50.201876 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:33:50.201876 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:33:50.201876 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:33:50.201876 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:33:50.201876 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 05:33:50.201876 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 05:33:50.201876 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 05:33:50.201876 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 05:33:50.203104 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:33:50.203104 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:33:50.203104 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:33:50.203104 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:33:50.203104 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:33:50.203104 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:33:50.203104 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:33:50.203104 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application with Lock( Aug 24 05:33:50.203104 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:33:50.203104 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:33:50.203104 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:33:50.203104 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:33:50.203104 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:33:50.203104 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:33:50.203104 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:33:50.203104 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:33:50.203104 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 05:33:50.204254 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 05:33:50.204254 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:33:50.204254 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Aug 24 05:33:50.205578 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 374/753] 10.222.0.26 () {56 vars in 1108 bytes} [Wed Aug 24 05:33:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:33:50.209980 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf01590-ba29-4eac-8f74-05bb58ccf1a4 None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:50.244029 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6977050f-a19a-4f0f-88d9-e93d6091d344 None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:50.288804 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cec4847-c0a5-4c2f-a041-9205a2b3f7e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:50.289423 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cec4847-c0a5-4c2f-a041-9205a2b3f7e8 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:50.289705 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cec4847-c0a5-4c2f-a041-9205a2b3f7e8 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:50.289999 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cec4847-c0a5-4c2f-a041-9205a2b3f7e8 None admin] PATH_INFO: `/v3/projects` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:50.291094 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cec4847-c0a5-4c2f-a041-9205a2b3f7e8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:33:50.291410 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cec4847-c0a5-4c2f-a041-9205a2b3f7e8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:50.293493 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cec4847-c0a5-4c2f-a041-9205a2b3f7e8 None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:50.314143 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 380/754] 10.222.0.26 () {56 vars in 1148 bytes} [Wed Aug 24 05:33:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:33:50.315354 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cec4847-c0a5-4c2f-a041-9205a2b3f7e8 None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:50.334828 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf01590-ba29-4eac-8f74-05bb58ccf1a4 None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:50.374857 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6374776-4696-4974-b6dd-012b0cd998d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:50.376351 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6374776-4696-4974-b6dd-012b0cd998d8 None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:50.377104 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6374776-4696-4974-b6dd-012b0cd998d8 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:50.377564 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6374776-4696-4974-b6dd-012b0cd998d8 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:50.389863 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6374776-4696-4974-b6dd-012b0cd998d8 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:50.392306 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6374776-4696-4974-b6dd-012b0cd998d8 None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:50.408965 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application [None req-c6374776-4696-4974-b6dd-012b0cd998d8 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 05:33:50.408965 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:33:50.408965 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:33:50.408965 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:33:50.408965 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:33:50.408965 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:33:50.408965 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:33:50.408965 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:33:50.408965 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:33:50.408965 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:33:50.408965 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:33:50.408965 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:33:50.408965 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 05:33:50.408965 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 05:33:50.408965 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 05:33:50.408965 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 05:33:50.410099 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:33:50.410099 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:33:50.410099 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 05:33:50.410099 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 05:33:50.410099 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 05:33:50.410099 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 05:33:50.410099 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:33:50.410099 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:33:50.410099 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:33:50.410099 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:33:50.410099 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:33:50.410099 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application with Lock( Aug 24 05:33:50.410099 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:33:50.410099 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:33:50.410099 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:33:50.410099 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:33:50.410099 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:33:50.410099 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:33:50.411036 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:33:50.411036 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:33:50.411036 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 05:33:50.411036 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 05:33:50.411036 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 05:33:50.411036 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 05:33:50.411036 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 05:33:50.411036 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 05:33:50.411036 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 05:33:50.411036 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Aug 24 05:33:50.418484 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 375/755] 10.222.0.26 () {56 vars in 1093 bytes} [Wed Aug 24 05:33:50 2022] GET /identity/v3/users/nova => generated 82 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:33:50.419073 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:50.419209 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6374776-4696-4974-b6dd-012b0cd998d8 None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:50.426204 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:50.455511 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cec4847-c0a5-4c2f-a041-9205a2b3f7e8 None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:50.501281 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c91c5c-a352-40ff-82dd-e422b98156ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:50.502513 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c91c5c-a352-40ff-82dd-e422b98156ad None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:50.503953 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c91c5c-a352-40ff-82dd-e422b98156ad None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:50.504440 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c91c5c-a352-40ff-82dd-e422b98156ad None admin] PATH_INFO: `/v3/domains` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:50.505299 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c91c5c-a352-40ff-82dd-e422b98156ad None admin] RBAC: Adding query filter params (name=Default) {{(pid=88113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:33:50.505811 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c91c5c-a352-40ff-82dd-e422b98156ad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:50.507500 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c91c5c-a352-40ff-82dd-e422b98156ad None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:50.524536 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 381/756] 10.222.0.26 () {56 vars in 1109 bytes} [Wed Aug 24 05:33:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:33:50.529384 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c91c5c-a352-40ff-82dd-e422b98156ad None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:50.542268 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6374776-4696-4974-b6dd-012b0cd998d8 None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:50.578742 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826b7892-93a6-47b2-960b-909abdae175f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:50.579958 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826b7892-93a6-47b2-960b-909abdae175f None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:50.579958 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826b7892-93a6-47b2-960b-909abdae175f None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:50.579958 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826b7892-93a6-47b2-960b-909abdae175f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:50.580644 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826b7892-93a6-47b2-960b-909abdae175f None admin] RBAC: Adding query filter params (role.id=640bda0879494e60b72680ee505285f0, scope.project.id=ded4fe81d4dc43188dd84e53025ee783, user.id=87ff96222a7c4baea31fc1bebf4d89a9) {{(pid=88112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:33:50.580950 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826b7892-93a6-47b2-960b-909abdae175f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:50.582422 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826b7892-93a6-47b2-960b-909abdae175f None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:50.594292 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 376/757] 10.222.0.26 () {56 vars in 1374 bytes} [Wed Aug 24 05:33:50 2022] GET /identity/v3/role_assignments?user.id=87ff96222a7c4baea31fc1bebf4d89a9&scope.project.id=ded4fe81d4dc43188dd84e53025ee783&role.id=640bda0879494e60b72680ee505285f0 => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:33:50.594292 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826b7892-93a6-47b2-960b-909abdae175f None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:50.717659 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c91c5c-a352-40ff-82dd-e422b98156ad None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:50.726236 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:50.787406 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826b7892-93a6-47b2-960b-909abdae175f None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:50.789089 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28c72ad-4261-4749-8007-0190554bc46d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:50.789764 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28c72ad-4261-4749-8007-0190554bc46d None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:50.790032 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28c72ad-4261-4749-8007-0190554bc46d None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:50.790269 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28c72ad-4261-4749-8007-0190554bc46d None admin] PATH_INFO: `/v3/users` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:50.791005 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28c72ad-4261-4749-8007-0190554bc46d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:33:50.791303 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28c72ad-4261-4749-8007-0190554bc46d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:50.793554 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28c72ad-4261-4749-8007-0190554bc46d None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:50.796334 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:50.815970 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 382/758] 10.222.0.26 () {56 vars in 1133 bytes} [Wed Aug 24 05:33:50 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:33:50.817511 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf53d8b-2222-453a-8879-ef921f735f5e None None] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:50.817778 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf53d8b-2222-453a-8879-ef921f735f5e None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:50.818071 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf53d8b-2222-453a-8879-ef921f735f5e None None] PATH_INFO: `/` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:50.819399 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 383/759] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 24 05:33:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:33:50.822800 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf53d8b-2222-453a-8879-ef921f735f5e None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:50.831676 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13ed86d-161b-4852-874e-a85f37faf48e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:50.832703 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13ed86d-161b-4852-874e-a85f37faf48e None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:50.833248 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13ed86d-161b-4852-874e-a85f37faf48e None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:50.833720 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13ed86d-161b-4852-874e-a85f37faf48e None admin] PATH_INFO: `/v3/projects/service` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:50.842756 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13ed86d-161b-4852-874e-a85f37faf48e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:50.845532 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13ed86d-161b-4852-874e-a85f37faf48e None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:50.861484 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application [None req-c13ed86d-161b-4852-874e-a85f37faf48e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 05:33:50.861484 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:33:50.861484 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:33:50.861484 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:33:50.861484 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:33:50.861484 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:33:50.861484 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:33:50.861484 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:33:50.861484 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:33:50.861484 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:33:50.861484 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:33:50.861484 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:33:50.861484 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 05:33:50.861484 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 05:33:50.861484 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 05:33:50.862432 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 05:33:50.862432 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:33:50.862432 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:33:50.862432 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:33:50.862432 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:33:50.862432 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:33:50.862432 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:33:50.862432 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:33:50.862432 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application with Lock( Aug 24 05:33:50.862432 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:33:50.862432 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:33:50.862432 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:33:50.862432 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:33:50.862432 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:33:50.862432 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:33:50.862432 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:33:50.862432 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:33:50.863327 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 05:33:50.863327 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 05:33:50.863327 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 05:33:50.863327 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 05:33:50.863327 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 05:33:50.863327 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 05:33:50.863327 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 05:33:50.863327 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Aug 24 05:33:50.866678 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 377/760] 10.222.0.26 () {56 vars in 1111 bytes} [Wed Aug 24 05:33:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:33:50.872467 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c7e2b5-4ae3-45e3-b0fd-af75256f9763 None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:50.872467 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c7e2b5-4ae3-45e3-b0fd-af75256f9763 None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:50.872467 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c7e2b5-4ae3-45e3-b0fd-af75256f9763 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:50.894334 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-67c7e2b5-4ae3-45e3-b0fd-af75256f9763 None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:33:50.896361 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-67c7e2b5-4ae3-45e3-b0fd-af75256f9763 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:33:50.937816 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf53d8b-2222-453a-8879-ef921f735f5e None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:50.978066 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7aafe3-81cc-470b-a611-52b01f299285 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:50.978697 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7aafe3-81cc-470b-a611-52b01f299285 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:50.978974 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7aafe3-81cc-470b-a611-52b01f299285 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:50.979245 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7aafe3-81cc-470b-a611-52b01f299285 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:50.991069 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7aafe3-81cc-470b-a611-52b01f299285 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:50.993012 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7aafe3-81cc-470b-a611-52b01f299285 None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:50.998223 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 378/761] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 24 05:33:50 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 05:33:50.999171 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c7e2b5-4ae3-45e3-b0fd-af75256f9763 None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:51.010718 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application [None req-1b7aafe3-81cc-470b-a611-52b01f299285 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:33:51.010718 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:33:51.010718 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:33:51.010718 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:33:51.010718 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:33:51.010718 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:33:51.010718 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:33:51.010718 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:33:51.010718 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:33:51.010718 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:33:51.010718 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:33:51.010718 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:33:51.010718 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 05:33:51.010718 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 05:33:51.010718 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 05:33:51.010718 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 05:33:51.011703 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:33:51.011703 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:33:51.011703 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:33:51.011703 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:33:51.011703 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:33:51.011703 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:33:51.011703 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:33:51.011703 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application with Lock( Aug 24 05:33:51.011703 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:33:51.011703 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:33:51.011703 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:33:51.011703 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:33:51.011703 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:33:51.011703 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:33:51.011703 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:33:51.011703 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:33:51.011703 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 05:33:51.012599 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 05:33:51.012599 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:33:51.012599 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Aug 24 05:33:51.014873 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 384/762] 10.222.0.26 () {56 vars in 1108 bytes} [Wed Aug 24 05:33:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:33:51.022098 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7aafe3-81cc-470b-a611-52b01f299285 None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:51.076489 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:51.144363 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7aafe3-81cc-470b-a611-52b01f299285 None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:51.146147 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:51.178994 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7367028-b236-46d6-a809-10db3a74663a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:51.179594 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7367028-b236-46d6-a809-10db3a74663a None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:51.179882 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7367028-b236-46d6-a809-10db3a74663a None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:51.180145 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7367028-b236-46d6-a809-10db3a74663a None admin] PATH_INFO: `/v3/domains` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:51.180799 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7367028-b236-46d6-a809-10db3a74663a None admin] RBAC: Adding query filter params (name=Default) {{(pid=88113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:33:51.181104 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7367028-b236-46d6-a809-10db3a74663a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:51.184119 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7367028-b236-46d6-a809-10db3a74663a None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:51.197230 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 385/763] 10.222.0.26 () {56 vars in 1109 bytes} [Wed Aug 24 05:33:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:33:51.204523 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7367028-b236-46d6-a809-10db3a74663a None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:51.219129 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c7e2b5-4ae3-45e3-b0fd-af75256f9763 None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:51.287754 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2b41e5-fa48-401c-a72f-5de387a87e37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:51.288730 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2b41e5-fa48-401c-a72f-5de387a87e37 None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:51.289683 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2b41e5-fa48-401c-a72f-5de387a87e37 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:51.290986 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2b41e5-fa48-401c-a72f-5de387a87e37 None admin] PATH_INFO: `/v3/projects` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:51.291886 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2b41e5-fa48-401c-a72f-5de387a87e37 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:33:51.293337 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2b41e5-fa48-401c-a72f-5de387a87e37 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:51.296091 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2b41e5-fa48-401c-a72f-5de387a87e37 None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:51.316443 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 379/764] 10.222.0.26 () {56 vars in 1148 bytes} [Wed Aug 24 05:33:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:33:51.323206 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2b41e5-fa48-401c-a72f-5de387a87e37 None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:51.367867 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7367028-b236-46d6-a809-10db3a74663a None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:51.382329 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:51.415445 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72127977-4c88-4a61-a9ae-dc58b5e2f9b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:51.416460 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72127977-4c88-4a61-a9ae-dc58b5e2f9b6 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:51.416952 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72127977-4c88-4a61-a9ae-dc58b5e2f9b6 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:51.417419 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72127977-4c88-4a61-a9ae-dc58b5e2f9b6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:51.428003 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72127977-4c88-4a61-a9ae-dc58b5e2f9b6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:51.430256 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72127977-4c88-4a61-a9ae-dc58b5e2f9b6 None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:51.447982 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application [None req-72127977-4c88-4a61-a9ae-dc58b5e2f9b6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 05:33:51.447982 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:33:51.447982 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:33:51.447982 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:33:51.447982 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:33:51.447982 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:33:51.447982 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:33:51.447982 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:33:51.447982 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:33:51.447982 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:33:51.447982 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:33:51.447982 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:33:51.447982 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 05:33:51.447982 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 05:33:51.447982 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 05:33:51.448901 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 05:33:51.448901 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:33:51.448901 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:33:51.448901 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:33:51.448901 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:33:51.448901 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:33:51.448901 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:33:51.448901 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:33:51.448901 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application with Lock( Aug 24 05:33:51.448901 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:33:51.448901 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:33:51.448901 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:33:51.448901 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:33:51.448901 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:33:51.448901 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:33:51.448901 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:33:51.448901 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:33:51.449779 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 05:33:51.449779 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 05:33:51.449779 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 05:33:51.449779 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 05:33:51.449779 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 05:33:51.449779 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 05:33:51.449779 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 05:33:51.449779 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Aug 24 05:33:51.450325 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2b41e5-fa48-401c-a72f-5de387a87e37 None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:51.457072 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 386/765] 10.222.0.26 () {56 vars in 1111 bytes} [Wed Aug 24 05:33:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:33:51.458211 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72127977-4c88-4a61-a9ae-dc58b5e2f9b6 None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:51.467901 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:51.491127 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc391c3e-df07-466c-b44c-41688c78c24e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:51.491740 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc391c3e-df07-466c-b44c-41688c78c24e None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:51.492022 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc391c3e-df07-466c-b44c-41688c78c24e None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:51.492295 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc391c3e-df07-466c-b44c-41688c78c24e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:51.493193 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc391c3e-df07-466c-b44c-41688c78c24e None admin] RBAC: Adding query filter params (role.id=59fa3749ca7f47e2ba1127945e13336c, scope.project.id=ded4fe81d4dc43188dd84e53025ee783, user.id=6c2c08b27a0f4943b5da908eb7b1cd96) {{(pid=88112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:33:51.493505 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc391c3e-df07-466c-b44c-41688c78c24e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:51.495647 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc391c3e-df07-466c-b44c-41688c78c24e None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:51.506023 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 380/766] 10.222.0.26 () {56 vars in 1374 bytes} [Wed Aug 24 05:33:51 2022] GET /identity/v3/role_assignments?user.id=6c2c08b27a0f4943b5da908eb7b1cd96&scope.project.id=ded4fe81d4dc43188dd84e53025ee783&role.id=59fa3749ca7f47e2ba1127945e13336c => generated 259 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:33:51.507263 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc391c3e-df07-466c-b44c-41688c78c24e None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:51.606903 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72127977-4c88-4a61-a9ae-dc58b5e2f9b6 None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:51.652870 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbdeff6-f96f-4862-952f-a9af04451435 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:51.653483 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbdeff6-f96f-4862-952f-a9af04451435 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:51.653761 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbdeff6-f96f-4862-952f-a9af04451435 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:51.654045 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbdeff6-f96f-4862-952f-a9af04451435 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:51.654633 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbdeff6-f96f-4862-952f-a9af04451435 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:51.656060 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbdeff6-f96f-4862-952f-a9af04451435 None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:51.671292 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application [None req-2fbdeff6-f96f-4862-952f-a9af04451435 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 05:33:51.671292 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:33:51.671292 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 05:33:51.671292 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 05:33:51.671292 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 05:33:51.671292 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 05:33:51.671292 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 05:33:51.671292 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 05:33:51.671292 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 05:33:51.671292 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Aug 24 05:33:51.671292 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 05:33:51.671292 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Aug 24 05:33:51.671292 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:33:51.671292 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:33:51.671292 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:33:51.671292 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:33:51.671292 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:33:51.672411 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:33:51.672411 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:33:51.672411 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:33:51.672411 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:33:51.672411 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:33:51.672411 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:33:51.672411 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 05:33:51.672411 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 05:33:51.672411 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 05:33:51.672411 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 05:33:51.672411 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:33:51.672411 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:33:51.672411 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:33:51.672411 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:33:51.672411 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:33:51.672411 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:33:51.673284 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:33:51.673284 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application with Lock( Aug 24 05:33:51.673284 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:33:51.673284 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:33:51.673284 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:33:51.673284 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:33:51.673284 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:33:51.673284 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:33:51.673284 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:33:51.673284 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:33:51.673284 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 05:33:51.673284 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 05:33:51.673284 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 05:33:51.673284 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Aug 24 05:33:51.678906 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 387/767] 10.222.0.26 () {56 vars in 1129 bytes} [Wed Aug 24 05:33:51 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:33:51.685664 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc391c3e-df07-466c-b44c-41688c78c24e None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:51.686889 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbdeff6-f96f-4862-952f-a9af04451435 None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:51.735056 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcb6970-0057-4fb5-94bf-3b4de408c07f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:51.736053 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcb6970-0057-4fb5-94bf-3b4de408c07f None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:51.736539 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcb6970-0057-4fb5-94bf-3b4de408c07f None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:51.737012 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcb6970-0057-4fb5-94bf-3b4de408c07f None admin] PATH_INFO: `/v3/projects` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:51.737961 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcb6970-0057-4fb5-94bf-3b4de408c07f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:33:51.738476 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcb6970-0057-4fb5-94bf-3b4de408c07f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:51.740159 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcb6970-0057-4fb5-94bf-3b4de408c07f None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:51.749126 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:51.759054 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 381/768] 10.222.0.26 () {56 vars in 1148 bytes} [Wed Aug 24 05:33:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:33:51.771110 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcb6970-0057-4fb5-94bf-3b4de408c07f None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:51.820111 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:51.848235 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbdeff6-f96f-4862-952f-a9af04451435 None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:51.898057 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f7996b-34af-4b01-9bc7-14d490e5fd54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:51.899050 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f7996b-34af-4b01-9bc7-14d490e5fd54 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:51.899528 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f7996b-34af-4b01-9bc7-14d490e5fd54 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:51.900022 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f7996b-34af-4b01-9bc7-14d490e5fd54 None admin] PATH_INFO: `/v3/services` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:51.900961 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f7996b-34af-4b01-9bc7-14d490e5fd54 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=88113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:33:51.901456 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f7996b-34af-4b01-9bc7-14d490e5fd54 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:51.903097 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f7996b-34af-4b01-9bc7-14d490e5fd54 None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:51.908713 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 388/769] 10.222.0.26 () {56 vars in 1124 bytes} [Wed Aug 24 05:33:51 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:33:51.914867 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f7996b-34af-4b01-9bc7-14d490e5fd54 None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:51.933143 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcb6970-0057-4fb5-94bf-3b4de408c07f None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:51.986798 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f9002e-a1d3-4bfd-ab91-0ec92e3f266a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:51.987466 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f9002e-a1d3-4bfd-ab91-0ec92e3f266a None admin] REQUEST_METHOD: `PUT` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:51.987736 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f9002e-a1d3-4bfd-ab91-0ec92e3f266a None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:51.988012 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f9002e-a1d3-4bfd-ab91-0ec92e3f266a None admin] PATH_INFO: `/v3/projects/ded4fe81d4dc43188dd84e53025ee783/users/7b633e1aec6c4269bce13aa9c89e911a/roles/640bda0879494e60b72680ee505285f0` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:51.990314 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f9002e-a1d3-4bfd-ab91-0ec92e3f266a None admin] RBAC: Authorizing `identity:create_grant(project_id=ded4fe81d4dc43188dd84e53025ee783, user_id=7b633e1aec6c4269bce13aa9c89e911a, role_id=640bda0879494e60b72680ee505285f0)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:51.992384 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f9002e-a1d3-4bfd-ab91-0ec92e3f266a None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:52.011389 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 382/770] 10.222.0.26 () {58 vars in 1439 bytes} [Wed Aug 24 05:33:51 2022] PUT /identity/v3/projects/ded4fe81d4dc43188dd84e53025ee783/users/7b633e1aec6c4269bce13aa9c89e911a/roles/640bda0879494e60b72680ee505285f0 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 05:33:52.012768 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da76cda-bd8c-42e4-9b68-6cb630be02e9 None None] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:52.013057 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da76cda-bd8c-42e4-9b68-6cb630be02e9 None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:52.013332 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da76cda-bd8c-42e4-9b68-6cb630be02e9 None None] PATH_INFO: `/` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:52.015014 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 383/771] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 24 05:33:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:33:52.035858 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83856bb4-d5ad-4ec8-ad1f-68806892f162 None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:52.036227 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83856bb4-d5ad-4ec8-ad1f-68806892f162 None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:52.036444 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83856bb4-d5ad-4ec8-ad1f-68806892f162 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:52.071571 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-83856bb4-d5ad-4ec8-ad1f-68806892f162 None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:33:52.075639 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-83856bb4-d5ad-4ec8-ad1f-68806892f162 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:33:52.089259 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:52.106433 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f7996b-34af-4b01-9bc7-14d490e5fd54 None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:52.173201 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf62066-0f2b-403d-b962-816062b82a82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:52.173880 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf62066-0f2b-403d-b962-816062b82a82 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:52.174291 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf62066-0f2b-403d-b962-816062b82a82 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:52.174896 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf62066-0f2b-403d-b962-816062b82a82 None admin] PATH_INFO: `/v3/services` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:52.175804 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf62066-0f2b-403d-b962-816062b82a82 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=88113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:33:52.176110 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf62066-0f2b-403d-b962-816062b82a82 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:52.178031 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf62066-0f2b-403d-b962-816062b82a82 None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:52.182489 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 384/772] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 24 05:33:52 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 05:33:52.185001 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 389/773] 10.222.0.26 () {56 vars in 1124 bytes} [Wed Aug 24 05:33:51 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:33:52.192697 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83856bb4-d5ad-4ec8-ad1f-68806892f162 None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:52.244103 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:52.298889 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83856bb4-d5ad-4ec8-ad1f-68806892f162 None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:52.334546 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e5d6f5-82bf-48dc-bd3f-1bc518b0d5a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:52.335168 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e5d6f5-82bf-48dc-bd3f-1bc518b0d5a9 None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:52.335447 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e5d6f5-82bf-48dc-bd3f-1bc518b0d5a9 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:52.335716 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e5d6f5-82bf-48dc-bd3f-1bc518b0d5a9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:52.336419 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e5d6f5-82bf-48dc-bd3f-1bc518b0d5a9 None admin] RBAC: Adding query filter params (interface=public, service_id=3fc117ffa92045688c932940e3dc7b76, region_id=RegionOne) {{(pid=88112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:33:52.336721 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e5d6f5-82bf-48dc-bd3f-1bc518b0d5a9 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:52.338167 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e5d6f5-82bf-48dc-bd3f-1bc518b0d5a9 None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:52.346683 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 385/774] 10.222.0.26 () {56 vars in 1251 bytes} [Wed Aug 24 05:33:52 2022] GET /identity/v3/endpoints?service_id=3fc117ffa92045688c932940e3dc7b76&interface=public®ion_id=RegionOne => generated 194 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:33:52.352178 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf62066-0f2b-403d-b962-816062b82a82 None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:52.455145 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf62066-0f2b-403d-b962-816062b82a82 None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:52.490919 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e5d6f5-82bf-48dc-bd3f-1bc518b0d5a9 None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:52.491624 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcc75e4-6a93-4b50-9aab-5120ee3cf1f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:52.502092 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcc75e4-6a93-4b50-9aab-5120ee3cf1f4 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:52.502386 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcc75e4-6a93-4b50-9aab-5120ee3cf1f4 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:52.502646 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcc75e4-6a93-4b50-9aab-5120ee3cf1f4 None admin] PATH_INFO: `/v3/services` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:52.503273 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcc75e4-6a93-4b50-9aab-5120ee3cf1f4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:52.504663 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcc75e4-6a93-4b50-9aab-5120ee3cf1f4 None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:52.512270 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 390/775] 10.222.0.26 () {56 vars in 1087 bytes} [Wed Aug 24 05:33:52 2022] GET /identity/v3/services => generated 772 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:33:52.642144 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:52.649993 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e5d6f5-82bf-48dc-bd3f-1bc518b0d5a9 None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:52.686618 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4002f3-c2fa-428c-9827-44105dc9c55d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:52.688142 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4002f3-c2fa-428c-9827-44105dc9c55d None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:52.688628 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4002f3-c2fa-428c-9827-44105dc9c55d None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:52.689170 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4002f3-c2fa-428c-9827-44105dc9c55d None admin] PATH_INFO: `/v3/services/network` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:52.690010 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4002f3-c2fa-428c-9827-44105dc9c55d None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:52.691769 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4002f3-c2fa-428c-9827-44105dc9c55d None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:52.702275 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application [None req-1c4002f3-c2fa-428c-9827-44105dc9c55d None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 05:33:52.702275 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:33:52.702275 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 05:33:52.702275 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 05:33:52.702275 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 05:33:52.702275 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 05:33:52.702275 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 05:33:52.702275 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 05:33:52.702275 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 05:33:52.702275 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Aug 24 05:33:52.702275 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 05:33:52.702275 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Aug 24 05:33:52.702275 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:33:52.702275 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:33:52.702275 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:33:52.702275 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:33:52.702275 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:33:52.703922 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:33:52.703922 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:33:52.703922 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:33:52.703922 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:33:52.703922 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:33:52.703922 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:33:52.703922 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 05:33:52.703922 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 05:33:52.703922 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 05:33:52.703922 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 05:33:52.703922 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:33:52.703922 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:33:52.703922 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:33:52.703922 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:33:52.703922 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:33:52.703922 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:33:52.704755 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:33:52.704755 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application with Lock( Aug 24 05:33:52.704755 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:33:52.704755 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:33:52.704755 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:33:52.704755 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:33:52.704755 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:33:52.704755 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:33:52.704755 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:33:52.704755 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:33:52.704755 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 05:33:52.704755 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 05:33:52.704755 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 05:33:52.704755 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Aug 24 05:33:52.707999 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 386/776] 10.222.0.26 () {56 vars in 1111 bytes} [Wed Aug 24 05:33:52 2022] GET /identity/v3/services/network => generated 88 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 05:33:52.714270 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcc75e4-6a93-4b50-9aab-5120ee3cf1f4 None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:52.735986 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d106355-94c6-431a-9827-b6a82ba05681 None None] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:52.736330 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d106355-94c6-431a-9827-b6a82ba05681 None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:52.736549 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d106355-94c6-431a-9827-b6a82ba05681 None None] PATH_INFO: `/` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:52.738178 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 387/777] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 24 05:33:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:33:52.743407 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5e4c5b-c687-4821-9c28-6c816a3f63f1 None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:52.743692 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5e4c5b-c687-4821-9c28-6c816a3f63f1 None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:52.743966 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5e4c5b-c687-4821-9c28-6c816a3f63f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:52.765094 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-6b5e4c5b-c687-4821-9c28-6c816a3f63f1 None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:33:52.766892 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-6b5e4c5b-c687-4821-9c28-6c816a3f63f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:33:52.769013 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:52.887205 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 388/778] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 24 05:33:52 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 05:33:52.899063 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcc75e4-6a93-4b50-9aab-5120ee3cf1f4 None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:52.945637 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ac0b24-fd20-499f-a387-f6987d828c90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:52.946312 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ac0b24-fd20-499f-a387-f6987d828c90 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:52.946594 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ac0b24-fd20-499f-a387-f6987d828c90 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:52.946867 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ac0b24-fd20-499f-a387-f6987d828c90 None admin] PATH_INFO: `/v3/services` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:52.947504 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ac0b24-fd20-499f-a387-f6987d828c90 None admin] RBAC: Adding query filter params (name=network) {{(pid=88113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:33:52.947806 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ac0b24-fd20-499f-a387-f6987d828c90 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:52.949177 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ac0b24-fd20-499f-a387-f6987d828c90 None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:52.954109 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 391/779] 10.222.0.26 () {56 vars in 1112 bytes} [Wed Aug 24 05:33:52 2022] GET /identity/v3/services?name=network => generated 124 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:33:52.959991 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5e4c5b-c687-4821-9c28-6c816a3f63f1 None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:53.073408 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:53.083440 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5e4c5b-c687-4821-9c28-6c816a3f63f1 None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:53.128351 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a924d55b-95b3-43b7-ae98-020da925ebeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:53.128968 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a924d55b-95b3-43b7-ae98-020da925ebeb None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:53.129247 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a924d55b-95b3-43b7-ae98-020da925ebeb None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:53.129521 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a924d55b-95b3-43b7-ae98-020da925ebeb None admin] PATH_INFO: `/v3/services` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:53.130180 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a924d55b-95b3-43b7-ae98-020da925ebeb None admin] RBAC: Adding query filter params (type=network) {{(pid=88112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:33:53.130482 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a924d55b-95b3-43b7-ae98-020da925ebeb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:53.131969 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a924d55b-95b3-43b7-ae98-020da925ebeb None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:53.140968 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 389/780] 10.222.0.26 () {56 vars in 1112 bytes} [Wed Aug 24 05:33:52 2022] GET /identity/v3/services?type=network => generated 350 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:33:53.146648 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ac0b24-fd20-499f-a387-f6987d828c90 None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:53.196601 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a924d55b-95b3-43b7-ae98-020da925ebeb None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:53.286844 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:53.302485 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ac0b24-fd20-499f-a387-f6987d828c90 None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:53.331273 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a924d55b-95b3-43b7-ae98-020da925ebeb None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:53.337258 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95eee179-5fce-42c7-8197-81e514c54ba5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:53.337873 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95eee179-5fce-42c7-8197-81e514c54ba5 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:53.338185 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95eee179-5fce-42c7-8197-81e514c54ba5 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:53.338461 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95eee179-5fce-42c7-8197-81e514c54ba5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:53.339163 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95eee179-5fce-42c7-8197-81e514c54ba5 None admin] RBAC: Adding query filter params (interface=public, service_id=bf77742fc6ab4ee598c1c0044760fd8e, region_id=RegionOne) {{(pid=88113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:33:53.339472 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95eee179-5fce-42c7-8197-81e514c54ba5 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:53.340852 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95eee179-5fce-42c7-8197-81e514c54ba5 None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:53.349204 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 392/781] 10.222.0.26 () {56 vars in 1251 bytes} [Wed Aug 24 05:33:53 2022] GET /identity/v3/endpoints?service_id=bf77742fc6ab4ee598c1c0044760fd8e&interface=public®ion_id=RegionOne => generated 194 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:33:53.354617 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95eee179-5fce-42c7-8197-81e514c54ba5 None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:53.379690 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f319f6e-8b5d-4a00-9171-b8fa7e9c3de9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:53.380382 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f319f6e-8b5d-4a00-9171-b8fa7e9c3de9 None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:53.380666 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f319f6e-8b5d-4a00-9171-b8fa7e9c3de9 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:53.380938 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f319f6e-8b5d-4a00-9171-b8fa7e9c3de9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:53.392235 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f319f6e-8b5d-4a00-9171-b8fa7e9c3de9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:33:53.397454 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application [None req-6f319f6e-8b5d-4a00-9171-b8fa7e9c3de9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 05:33:53.397454 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:33:53.397454 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:33:53.397454 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:33:53.397454 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:33:53.397454 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:33:53.397454 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:33:53.397454 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:33:53.397454 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:33:53.397454 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:33:53.397454 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:33:53.397454 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:33:53.397454 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:33:53.397454 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:33:53.397454 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:33:53.397454 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:33:53.398432 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:33:53.398432 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:33:53.398432 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:33:53.398432 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:33:53.398432 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:33:53.398432 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:33:53.398432 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:33:53.398432 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:33:53.398432 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:33:53.398432 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:33:53.398432 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:33:53.398432 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application with Lock( Aug 24 05:33:53.398432 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:33:53.398432 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:33:53.398432 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:33:53.398432 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:33:53.399838 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:33:53.399838 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:33:53.399838 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:33:53.399838 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:33:53.399838 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:33:53.399838 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:33:53.399838 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:33:53.399838 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:33:53.399838 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:33:53.399838 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:33:53.399838 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 05:33:53.399838 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Aug 24 05:33:53.399838 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 390/782] 10.222.0.26 () {56 vars in 1096 bytes} [Wed Aug 24 05:33:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 05:33:53.404757 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f319f6e-8b5d-4a00-9171-b8fa7e9c3de9 None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:53.442407 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:53.510599 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f319f6e-8b5d-4a00-9171-b8fa7e9c3de9 None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:53.533131 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95eee179-5fce-42c7-8197-81e514c54ba5 None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:53.555224 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4b042d-93e7-4ea2-af0d-1c54b0df2a1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:53.555839 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4b042d-93e7-4ea2-af0d-1c54b0df2a1c None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:53.556118 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4b042d-93e7-4ea2-af0d-1c54b0df2a1c None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:53.556449 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4b042d-93e7-4ea2-af0d-1c54b0df2a1c None admin] PATH_INFO: `/v3/roles` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:53.557118 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4b042d-93e7-4ea2-af0d-1c54b0df2a1c None admin] RBAC: Adding query filter params (name=admin) {{(pid=88112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:33:53.557468 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4b042d-93e7-4ea2-af0d-1c54b0df2a1c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:53.558854 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4b042d-93e7-4ea2-af0d-1c54b0df2a1c None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:53.577312 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 391/783] 10.222.0.26 () {56 vars in 1099 bytes} [Wed Aug 24 05:33:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:33:53.583690 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4b042d-93e7-4ea2-af0d-1c54b0df2a1c None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:53.604140 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906f300d-2687-417c-95b1-31500406a5ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:53.604798 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906f300d-2687-417c-95b1-31500406a5ec None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:53.605081 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906f300d-2687-417c-95b1-31500406a5ec None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:53.605350 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906f300d-2687-417c-95b1-31500406a5ec None admin] PATH_INFO: `/v3/services` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:53.605972 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906f300d-2687-417c-95b1-31500406a5ec None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:53.607442 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906f300d-2687-417c-95b1-31500406a5ec None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:53.621347 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 393/784] 10.222.0.26 () {56 vars in 1087 bytes} [Wed Aug 24 05:33:53 2022] GET /identity/v3/services => generated 772 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:33:53.693064 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:53.713330 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4b042d-93e7-4ea2-af0d-1c54b0df2a1c None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:53.750715 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdfb55e-ce68-4b0e-94cd-e653ec85e1f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:53.751410 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdfb55e-ce68-4b0e-94cd-e653ec85e1f9 None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:53.751750 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdfb55e-ce68-4b0e-94cd-e653ec85e1f9 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:53.752026 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdfb55e-ce68-4b0e-94cd-e653ec85e1f9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:53.763462 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdfb55e-ce68-4b0e-94cd-e653ec85e1f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:53.764990 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdfb55e-ce68-4b0e-94cd-e653ec85e1f9 None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:53.780343 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application [None req-9bdfb55e-ce68-4b0e-94cd-e653ec85e1f9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:33:53.780343 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:33:53.780343 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:33:53.780343 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:33:53.780343 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:33:53.780343 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:33:53.780343 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:33:53.780343 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:33:53.780343 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:33:53.780343 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:33:53.780343 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:33:53.780343 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:33:53.780343 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 05:33:53.780343 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 05:33:53.780343 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 05:33:53.780343 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 05:33:53.781446 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:33:53.781446 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:33:53.781446 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:33:53.781446 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:33:53.781446 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:33:53.781446 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:33:53.781446 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:33:53.781446 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application with Lock( Aug 24 05:33:53.781446 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:33:53.781446 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:33:53.781446 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:33:53.781446 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:33:53.781446 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:33:53.781446 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:33:53.781446 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:33:53.781446 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:33:53.781446 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 05:33:53.782978 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 05:33:53.782978 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:33:53.782978 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Aug 24 05:33:53.782978 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 392/785] 10.222.0.26 () {56 vars in 1108 bytes} [Wed Aug 24 05:33:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:33:53.791208 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906f300d-2687-417c-95b1-31500406a5ec None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:53.816654 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:53.933395 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906f300d-2687-417c-95b1-31500406a5ec None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:53.973115 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4799ee54-f8c4-4d37-bba9-0368d97bc824 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:53.973788 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4799ee54-f8c4-4d37-bba9-0368d97bc824 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:53.974111 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4799ee54-f8c4-4d37-bba9-0368d97bc824 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:53.974382 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4799ee54-f8c4-4d37-bba9-0368d97bc824 None admin] PATH_INFO: `/v3/domains` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:53.975024 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4799ee54-f8c4-4d37-bba9-0368d97bc824 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:33:53.975325 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4799ee54-f8c4-4d37-bba9-0368d97bc824 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:53.976698 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4799ee54-f8c4-4d37-bba9-0368d97bc824 None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:53.989754 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 394/786] 10.222.0.26 () {56 vars in 1109 bytes} [Wed Aug 24 05:33:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:33:53.994924 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdfb55e-ce68-4b0e-94cd-e653ec85e1f9 None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:54.051642 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70323c80-d72b-4896-852c-0b7c0d8b36a7 None None] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:54.051885 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70323c80-d72b-4896-852c-0b7c0d8b36a7 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:54.052115 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70323c80-d72b-4896-852c-0b7c0d8b36a7 None None] PATH_INFO: `/` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:54.054374 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 395/787] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 24 05:33:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:33:54.060287 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802f69cb-917e-40e8-a6ab-92e0b5105835 None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:54.060573 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802f69cb-917e-40e8-a6ab-92e0b5105835 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:54.060849 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802f69cb-917e-40e8-a6ab-92e0b5105835 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:54.096230 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-802f69cb-917e-40e8-a6ab-92e0b5105835 None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:33:54.098588 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-802f69cb-917e-40e8-a6ab-92e0b5105835 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:33:54.152086 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdfb55e-ce68-4b0e-94cd-e653ec85e1f9 None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:54.188038 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:54.202629 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c17a31-b39a-4ef8-949c-d686f59b592d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:54.204224 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c17a31-b39a-4ef8-949c-d686f59b592d None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:54.204688 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c17a31-b39a-4ef8-949c-d686f59b592d None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:54.205141 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c17a31-b39a-4ef8-949c-d686f59b592d None admin] PATH_INFO: `/v3/users/swift` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:54.218142 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c17a31-b39a-4ef8-949c-d686f59b592d None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:54.220610 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c17a31-b39a-4ef8-949c-d686f59b592d None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:54.233403 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 396/788] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 24 05:33:54 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 05:33:54.239294 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application [None req-c1c17a31-b39a-4ef8-949c-d686f59b592d None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 24 05:33:54.239294 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:33:54.239294 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:33:54.239294 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:33:54.239294 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:33:54.239294 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:33:54.239294 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:33:54.239294 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:33:54.239294 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:33:54.239294 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:33:54.239294 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:33:54.239294 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:33:54.239294 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 05:33:54.239294 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 05:33:54.239294 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 05:33:54.239294 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 05:33:54.240241 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:33:54.240241 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:33:54.240241 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 05:33:54.240241 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 05:33:54.240241 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 05:33:54.240241 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 05:33:54.240241 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:33:54.240241 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:33:54.240241 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:33:54.240241 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:33:54.240241 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:33:54.240241 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application with Lock( Aug 24 05:33:54.240241 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:33:54.240241 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:33:54.240241 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:33:54.240241 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:33:54.240241 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:33:54.240241 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:33:54.241175 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:33:54.241175 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:33:54.241175 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 05:33:54.241175 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 05:33:54.241175 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 05:33:54.241175 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 05:33:54.241175 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 05:33:54.241175 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 05:33:54.241175 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 24 05:33:54.241175 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Aug 24 05:33:54.243431 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 393/789] 10.222.0.26 () {56 vars in 1096 bytes} [Wed Aug 24 05:33:53 2022] GET /identity/v3/users/swift => generated 83 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:33:54.251395 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802f69cb-917e-40e8-a6ab-92e0b5105835 None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:54.264199 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:54.400772 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802f69cb-917e-40e8-a6ab-92e0b5105835 None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:54.439944 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b885f6f-7084-437f-83bd-d26a008bde6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:54.440561 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b885f6f-7084-437f-83bd-d26a008bde6c None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:54.440841 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b885f6f-7084-437f-83bd-d26a008bde6c None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:54.441114 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b885f6f-7084-437f-83bd-d26a008bde6c None admin] PATH_INFO: `/v3/users` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:54.442120 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b885f6f-7084-437f-83bd-d26a008bde6c None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=88113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:33:54.442424 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b885f6f-7084-437f-83bd-d26a008bde6c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:54.443861 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b885f6f-7084-437f-83bd-d26a008bde6c None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:54.465776 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 397/790] 10.222.0.26 () {56 vars in 1135 bytes} [Wed Aug 24 05:33:54 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:33:54.471466 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c17a31-b39a-4ef8-949c-d686f59b592d None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:54.563700 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b885f6f-7084-437f-83bd-d26a008bde6c None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:54.665896 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:54.670508 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c17a31-b39a-4ef8-949c-d686f59b592d None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:54.706651 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c0faf3-063e-431d-8e04-4f5439217b05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:54.707290 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c0faf3-063e-431d-8e04-4f5439217b05 None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:54.707573 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c0faf3-063e-431d-8e04-4f5439217b05 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:54.707841 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c0faf3-063e-431d-8e04-4f5439217b05 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:54.719217 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c0faf3-063e-431d-8e04-4f5439217b05 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:54.720281 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b885f6f-7084-437f-83bd-d26a008bde6c None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:54.720663 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c0faf3-063e-431d-8e04-4f5439217b05 None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:54.736315 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application [None req-d6c0faf3-063e-431d-8e04-4f5439217b05 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:33:54.736315 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:33:54.736315 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:33:54.736315 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:33:54.736315 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:33:54.736315 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:33:54.736315 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:33:54.736315 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:33:54.736315 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:33:54.736315 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:33:54.736315 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:33:54.736315 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:33:54.736315 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 05:33:54.736315 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 05:33:54.736315 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 05:33:54.736315 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 05:33:54.737277 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:33:54.737277 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:33:54.737277 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:33:54.737277 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:33:54.737277 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:33:54.737277 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:33:54.737277 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:33:54.737277 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application with Lock( Aug 24 05:33:54.737277 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:33:54.737277 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:33:54.737277 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:33:54.737277 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:33:54.737277 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:33:54.737277 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:33:54.737277 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:33:54.737277 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:33:54.737277 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 05:33:54.738225 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 05:33:54.738225 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:33:54.738225 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Aug 24 05:33:54.738225 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 394/791] 10.222.0.26 () {56 vars in 1108 bytes} [Wed Aug 24 05:33:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:33:54.743131 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f12e36-ad6f-4769-8e4c-e65be8a5f6fd None None] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:54.743423 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f12e36-ad6f-4769-8e4c-e65be8a5f6fd None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:54.743686 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f12e36-ad6f-4769-8e4c-e65be8a5f6fd None None] PATH_INFO: `/` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:54.749076 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 395/792] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 24 05:33:54 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:33:54.749076 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f12e36-ad6f-4769-8e4c-e65be8a5f6fd None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:54.769417 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74f74df-518c-40ab-9b1a-bbfab68a2e77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:54.770496 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74f74df-518c-40ab-9b1a-bbfab68a2e77 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:54.770972 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74f74df-518c-40ab-9b1a-bbfab68a2e77 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:54.771454 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74f74df-518c-40ab-9b1a-bbfab68a2e77 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:54.786943 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74f74df-518c-40ab-9b1a-bbfab68a2e77 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:33:54.791932 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application [None req-b74f74df-518c-40ab-9b1a-bbfab68a2e77 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 05:33:54.791932 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:33:54.791932 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:33:54.791932 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:33:54.791932 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:33:54.791932 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:33:54.791932 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:33:54.791932 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:33:54.791932 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:33:54.791932 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:33:54.791932 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:33:54.791932 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:33:54.791932 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:33:54.791932 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:33:54.791932 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:33:54.791932 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:33:54.793261 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:33:54.793261 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:33:54.793261 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:33:54.793261 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:33:54.793261 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:33:54.793261 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:33:54.793261 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:33:54.793261 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:33:54.793261 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:33:54.793261 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:33:54.793261 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:33:54.793261 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application with Lock( Aug 24 05:33:54.793261 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:33:54.793261 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:33:54.793261 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:33:54.793261 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:33:54.794144 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:33:54.794144 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:33:54.794144 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:33:54.794144 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:33:54.794144 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:33:54.794144 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:33:54.794144 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:33:54.794144 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:33:54.794144 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:33:54.794144 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:33:54.794144 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 05:33:54.794144 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Aug 24 05:33:54.798305 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 398/793] 10.222.0.26 () {56 vars in 1102 bytes} [Wed Aug 24 05:33:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 05:33:54.800011 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f54836-1254-4bfd-8029-692d04349c1e None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:54.800317 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f54836-1254-4bfd-8029-692d04349c1e None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:54.800580 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f54836-1254-4bfd-8029-692d04349c1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:54.805667 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:54.822213 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-30f54836-1254-4bfd-8029-692d04349c1e None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:33:54.823737 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-30f54836-1254-4bfd-8029-692d04349c1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:33:54.882527 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f12e36-ad6f-4769-8e4c-e65be8a5f6fd None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:54.896317 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 399/794] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 24 05:33:54 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 05:33:54.897536 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f54836-1254-4bfd-8029-692d04349c1e None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:54.930733 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1b44fb-2954-4466-bc2f-5fda6b9e2a2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:54.932161 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1b44fb-2954-4466-bc2f-5fda6b9e2a2c None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:54.932441 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1b44fb-2954-4466-bc2f-5fda6b9e2a2c None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:54.932712 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1b44fb-2954-4466-bc2f-5fda6b9e2a2c None admin] PATH_INFO: `/v3/domains` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:54.933354 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1b44fb-2954-4466-bc2f-5fda6b9e2a2c None admin] RBAC: Adding query filter params (name=Default) {{(pid=88112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:33:54.933654 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1b44fb-2954-4466-bc2f-5fda6b9e2a2c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:54.935840 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1b44fb-2954-4466-bc2f-5fda6b9e2a2c None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:54.956453 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 396/795] 10.222.0.26 () {56 vars in 1109 bytes} [Wed Aug 24 05:33:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:33:54.956453 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a4bd16-a66f-4ce7-a339-ca0feb0de5b3 None None] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:54.956453 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a4bd16-a66f-4ce7-a339-ca0feb0de5b3 None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:54.956453 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a4bd16-a66f-4ce7-a339-ca0feb0de5b3 None None] PATH_INFO: `/` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:54.959320 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 397/796] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 24 05:33:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:33:54.959993 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a4bd16-a66f-4ce7-a339-ca0feb0de5b3 None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:54.973064 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:55.024716 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f54836-1254-4bfd-8029-692d04349c1e None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:55.061013 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5119fb2d-e4d0-4b7c-b122-0e2328f968cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:55.061859 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5119fb2d-e4d0-4b7c-b122-0e2328f968cf None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:55.062387 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5119fb2d-e4d0-4b7c-b122-0e2328f968cf None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:55.062856 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5119fb2d-e4d0-4b7c-b122-0e2328f968cf None admin] PATH_INFO: `/v3/roles` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:55.063682 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5119fb2d-e4d0-4b7c-b122-0e2328f968cf None admin] RBAC: Adding query filter params (name=service) {{(pid=88113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:33:55.064130 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5119fb2d-e4d0-4b7c-b122-0e2328f968cf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:55.065753 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5119fb2d-e4d0-4b7c-b122-0e2328f968cf None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:55.073730 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:55.075751 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 400/797] 10.222.0.26 () {56 vars in 1103 bytes} [Wed Aug 24 05:33:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:33:55.077570 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b25d60-80cf-485a-baa3-39dc15fc884f None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:55.078145 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b25d60-80cf-485a-baa3-39dc15fc884f None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:55.078645 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b25d60-80cf-485a-baa3-39dc15fc884f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:55.079589 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a4bd16-a66f-4ce7-a339-ca0feb0de5b3 None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:55.099819 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-46b25d60-80cf-485a-baa3-39dc15fc884f None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:33:55.101307 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-46b25d60-80cf-485a-baa3-39dc15fc884f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:33:55.118699 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3de79b7-4594-4066-b42d-0bc406545f74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:55.119427 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3de79b7-4594-4066-b42d-0bc406545f74 None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:55.119793 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3de79b7-4594-4066-b42d-0bc406545f74 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:55.120139 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3de79b7-4594-4066-b42d-0bc406545f74 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:55.127024 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3de79b7-4594-4066-b42d-0bc406545f74 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:55.128525 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3de79b7-4594-4066-b42d-0bc406545f74 None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:55.140251 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application [None req-a3de79b7-4594-4066-b42d-0bc406545f74 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 05:33:55.140251 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:33:55.140251 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:33:55.140251 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:33:55.140251 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:33:55.140251 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:33:55.140251 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:33:55.140251 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:33:55.140251 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:33:55.140251 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:33:55.140251 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:33:55.140251 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:33:55.140251 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 05:33:55.140251 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 05:33:55.140251 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 05:33:55.141664 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 05:33:55.141664 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:33:55.141664 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:33:55.141664 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:33:55.141664 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:33:55.141664 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:33:55.141664 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:33:55.141664 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:33:55.141664 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application with Lock( Aug 24 05:33:55.141664 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:33:55.141664 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:33:55.141664 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:33:55.141664 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:33:55.141664 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:33:55.141664 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:33:55.141664 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:33:55.141664 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:33:55.142588 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 05:33:55.142588 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 05:33:55.142588 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 05:33:55.142588 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 05:33:55.142588 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 05:33:55.142588 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 05:33:55.142588 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 05:33:55.142588 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Aug 24 05:33:55.146793 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 398/798] 10.222.0.26 () {56 vars in 1111 bytes} [Wed Aug 24 05:33:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:33:55.147720 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3de79b7-4594-4066-b42d-0bc406545f74 None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:55.177476 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 401/799] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 24 05:33:55 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 05:33:55.178631 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b25d60-80cf-485a-baa3-39dc15fc884f None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:55.226250 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:55.249758 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3de79b7-4594-4066-b42d-0bc406545f74 None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:55.283908 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92fa934-2707-4aca-af3d-9604fc2888d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:55.284531 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92fa934-2707-4aca-af3d-9604fc2888d0 None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:55.284820 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92fa934-2707-4aca-af3d-9604fc2888d0 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:55.285091 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92fa934-2707-4aca-af3d-9604fc2888d0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:55.293422 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b25d60-80cf-485a-baa3-39dc15fc884f None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:55.299798 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92fa934-2707-4aca-af3d-9604fc2888d0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:55.301294 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92fa934-2707-4aca-af3d-9604fc2888d0 None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:55.316437 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application [None req-c92fa934-2707-4aca-af3d-9604fc2888d0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:33:55.316437 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:33:55.316437 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:33:55.316437 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:33:55.316437 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:33:55.316437 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:33:55.316437 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:33:55.316437 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:33:55.316437 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:33:55.316437 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:33:55.316437 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:33:55.316437 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:33:55.316437 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 05:33:55.316437 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 05:33:55.316437 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 05:33:55.316437 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 05:33:55.317714 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:33:55.317714 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:33:55.317714 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:33:55.317714 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:33:55.317714 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:33:55.317714 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:33:55.317714 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:33:55.317714 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application with Lock( Aug 24 05:33:55.317714 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:33:55.317714 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:33:55.317714 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:33:55.317714 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:33:55.317714 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:33:55.317714 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:33:55.317714 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:33:55.317714 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:33:55.317714 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 05:33:55.318667 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 05:33:55.318667 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:33:55.318667 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Aug 24 05:33:55.318667 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 399/800] 10.222.0.26 () {56 vars in 1108 bytes} [Wed Aug 24 05:33:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:33:55.318890 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92fa934-2707-4aca-af3d-9604fc2888d0 None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:55.333065 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6707e7-7eba-4acd-a73e-77104be3bf2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:55.333920 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:55.334174 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6707e7-7eba-4acd-a73e-77104be3bf2b None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:55.334592 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6707e7-7eba-4acd-a73e-77104be3bf2b None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:55.335626 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6707e7-7eba-4acd-a73e-77104be3bf2b None admin] PATH_INFO: `/v3/projects` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:55.336550 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6707e7-7eba-4acd-a73e-77104be3bf2b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:33:55.337064 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6707e7-7eba-4acd-a73e-77104be3bf2b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:55.338676 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6707e7-7eba-4acd-a73e-77104be3bf2b None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:55.352511 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 402/801] 10.222.0.26 () {56 vars in 1148 bytes} [Wed Aug 24 05:33:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:33:55.353555 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6707e7-7eba-4acd-a73e-77104be3bf2b None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:55.426367 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92fa934-2707-4aca-af3d-9604fc2888d0 None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:55.459341 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6707e7-7eba-4acd-a73e-77104be3bf2b None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:55.461258 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7952b360-7287-4b4b-80df-beb78d01496c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:55.461893 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7952b360-7287-4b4b-80df-beb78d01496c None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:55.462201 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7952b360-7287-4b4b-80df-beb78d01496c None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:55.462481 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7952b360-7287-4b4b-80df-beb78d01496c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:55.463315 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:55.473682 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7952b360-7287-4b4b-80df-beb78d01496c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:33:55.478909 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application [None req-7952b360-7287-4b4b-80df-beb78d01496c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 05:33:55.478909 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:33:55.478909 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:33:55.478909 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:33:55.478909 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:33:55.478909 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:33:55.478909 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:33:55.478909 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:33:55.478909 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:33:55.478909 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:33:55.478909 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:33:55.478909 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:33:55.478909 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:33:55.478909 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:33:55.478909 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:33:55.478909 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:33:55.479836 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:33:55.479836 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:33:55.479836 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:33:55.479836 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:33:55.479836 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:33:55.479836 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:33:55.479836 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:33:55.479836 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:33:55.479836 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:33:55.479836 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:33:55.479836 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:33:55.479836 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application with Lock( Aug 24 05:33:55.479836 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:33:55.479836 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:33:55.479836 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:33:55.479836 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:33:55.480716 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:33:55.480716 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:33:55.480716 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:33:55.480716 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:33:55.480716 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:33:55.480716 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:33:55.480716 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:33:55.480716 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:33:55.480716 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:33:55.480716 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:33:55.480716 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 05:33:55.480716 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Aug 24 05:33:55.480716 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 400/802] 10.222.0.26 () {56 vars in 1096 bytes} [Wed Aug 24 05:33:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:33:55.481422 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7952b360-7287-4b4b-80df-beb78d01496c None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:55.504977 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31dcc25-481a-41d3-bbc0-d20c06ce8de7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:55.505642 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31dcc25-481a-41d3-bbc0-d20c06ce8de7 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:55.505859 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31dcc25-481a-41d3-bbc0-d20c06ce8de7 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:55.506162 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31dcc25-481a-41d3-bbc0-d20c06ce8de7 None admin] PATH_INFO: `/v3/domains` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:55.506854 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31dcc25-481a-41d3-bbc0-d20c06ce8de7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:33:55.507146 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31dcc25-481a-41d3-bbc0-d20c06ce8de7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:55.508490 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31dcc25-481a-41d3-bbc0-d20c06ce8de7 None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:55.521099 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 403/803] 10.222.0.26 () {56 vars in 1109 bytes} [Wed Aug 24 05:33:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:33:55.521737 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31dcc25-481a-41d3-bbc0-d20c06ce8de7 None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:55.570320 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:55.603773 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7952b360-7287-4b4b-80df-beb78d01496c None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:55.632223 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31dcc25-481a-41d3-bbc0-d20c06ce8de7 None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:55.638005 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8d7106-9ba9-44f5-b1e7-43056bd75ee2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:55.638670 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8d7106-9ba9-44f5-b1e7-43056bd75ee2 None admin] REQUEST_METHOD: `PUT` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:55.638948 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8d7106-9ba9-44f5-b1e7-43056bd75ee2 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:55.639216 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8d7106-9ba9-44f5-b1e7-43056bd75ee2 None admin] PATH_INFO: `/v3/projects/ded4fe81d4dc43188dd84e53025ee783/users/87ff96222a7c4baea31fc1bebf4d89a9/roles/640bda0879494e60b72680ee505285f0` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:55.644375 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8d7106-9ba9-44f5-b1e7-43056bd75ee2 None admin] RBAC: Authorizing `identity:create_grant(project_id=ded4fe81d4dc43188dd84e53025ee783, user_id=87ff96222a7c4baea31fc1bebf4d89a9, role_id=640bda0879494e60b72680ee505285f0)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:55.645818 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8d7106-9ba9-44f5-b1e7-43056bd75ee2 None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:55.669712 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ccfaae-bc0a-4d66-ba59-1ef4849207f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:55.670093 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 401/804] 10.222.0.26 () {58 vars in 1439 bytes} [Wed Aug 24 05:33:55 2022] PUT /identity/v3/projects/ded4fe81d4dc43188dd84e53025ee783/users/87ff96222a7c4baea31fc1bebf4d89a9/roles/640bda0879494e60b72680ee505285f0 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:33:55.670560 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ccfaae-bc0a-4d66-ba59-1ef4849207f3 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:55.670891 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ccfaae-bc0a-4d66-ba59-1ef4849207f3 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:55.671039 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8d7106-9ba9-44f5-b1e7-43056bd75ee2 None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:55.671475 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ccfaae-bc0a-4d66-ba59-1ef4849207f3 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:55.671974 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ccfaae-bc0a-4d66-ba59-1ef4849207f3 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:55.673602 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ccfaae-bc0a-4d66-ba59-1ef4849207f3 None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:55.686010 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application [None req-28ccfaae-bc0a-4d66-ba59-1ef4849207f3 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 05:33:55.686010 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:33:55.686010 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 05:33:55.686010 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 05:33:55.686010 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 05:33:55.686010 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 05:33:55.686010 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 05:33:55.686010 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 05:33:55.686010 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 05:33:55.686010 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Aug 24 05:33:55.686010 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 05:33:55.686010 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Aug 24 05:33:55.686010 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:33:55.686010 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:33:55.686010 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:33:55.686010 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:33:55.686010 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:33:55.687069 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:33:55.687069 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:33:55.687069 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:33:55.687069 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:33:55.687069 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:33:55.687069 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:33:55.687069 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 05:33:55.687069 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 05:33:55.687069 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 05:33:55.687069 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 05:33:55.687069 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:33:55.687069 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:33:55.687069 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:33:55.687069 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:33:55.687069 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:33:55.687069 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:33:55.688463 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:33:55.688463 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application with Lock( Aug 24 05:33:55.688463 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:33:55.688463 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:33:55.688463 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:33:55.688463 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:33:55.688463 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:33:55.688463 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:33:55.688463 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:33:55.688463 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:33:55.688463 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 05:33:55.688463 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 05:33:55.688463 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 05:33:55.688463 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Aug 24 05:33:55.690266 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 404/805] 10.222.0.26 () {56 vars in 1129 bytes} [Wed Aug 24 05:33:55 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:33:55.691408 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ccfaae-bc0a-4d66-ba59-1ef4849207f3 None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:55.739446 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:55.793215 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8d7106-9ba9-44f5-b1e7-43056bd75ee2 None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:55.828494 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:55.836663 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1496b3-59f7-4a66-beb3-0389f4b2e046 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:55.837614 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1496b3-59f7-4a66-beb3-0389f4b2e046 None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:55.839956 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1496b3-59f7-4a66-beb3-0389f4b2e046 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:55.840352 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1496b3-59f7-4a66-beb3-0389f4b2e046 None admin] PATH_INFO: `/v3/roles` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:55.841065 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1496b3-59f7-4a66-beb3-0389f4b2e046 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:33:55.841376 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1496b3-59f7-4a66-beb3-0389f4b2e046 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:55.842750 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1496b3-59f7-4a66-beb3-0389f4b2e046 None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:55.843827 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ccfaae-bc0a-4d66-ba59-1ef4849207f3 None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:55.852263 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 402/806] 10.222.0.26 () {56 vars in 1099 bytes} [Wed Aug 24 05:33:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:33:55.853114 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1496b3-59f7-4a66-beb3-0389f4b2e046 None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:55.894101 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03084090-2db4-48a3-a8ec-4eeb081b5fdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:55.894984 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03084090-2db4-48a3-a8ec-4eeb081b5fdc None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:55.895666 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03084090-2db4-48a3-a8ec-4eeb081b5fdc None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:55.896089 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03084090-2db4-48a3-a8ec-4eeb081b5fdc None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:55.907003 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03084090-2db4-48a3-a8ec-4eeb081b5fdc None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:55.909374 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03084090-2db4-48a3-a8ec-4eeb081b5fdc None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:55.926510 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application [None req-03084090-2db4-48a3-a8ec-4eeb081b5fdc None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 05:33:55.926510 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:33:55.926510 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:33:55.926510 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:33:55.926510 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:33:55.926510 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:33:55.926510 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:33:55.926510 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:33:55.926510 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:33:55.926510 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:33:55.926510 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:33:55.926510 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:33:55.926510 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 05:33:55.926510 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 05:33:55.926510 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 05:33:55.926510 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 05:33:55.927673 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:33:55.927673 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:33:55.927673 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 05:33:55.927673 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 05:33:55.927673 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 05:33:55.927673 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 05:33:55.927673 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:33:55.927673 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:33:55.927673 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:33:55.927673 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:33:55.927673 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:33:55.927673 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application with Lock( Aug 24 05:33:55.927673 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:33:55.927673 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:33:55.927673 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:33:55.927673 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:33:55.927673 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:33:55.927673 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:33:55.928846 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:33:55.928846 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:33:55.928846 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 05:33:55.928846 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 05:33:55.928846 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 05:33:55.928846 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 05:33:55.928846 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 05:33:55.928846 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 05:33:55.928846 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 05:33:55.928846 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Aug 24 05:33:55.931913 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 405/807] 10.222.0.26 () {56 vars in 1117 bytes} [Wed Aug 24 05:33:55 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:33:55.932967 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03084090-2db4-48a3-a8ec-4eeb081b5fdc None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:55.975368 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1496b3-59f7-4a66-beb3-0389f4b2e046 None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:56.012131 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f76ef2e-5bb4-45f5-a82a-fa61fbb2fc8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:56.012664 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f76ef2e-5bb4-45f5-a82a-fa61fbb2fc8d None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:56.012981 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f76ef2e-5bb4-45f5-a82a-fa61fbb2fc8d None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:56.013255 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f76ef2e-5bb4-45f5-a82a-fa61fbb2fc8d None admin] PATH_INFO: `/v3/services` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:56.013890 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f76ef2e-5bb4-45f5-a82a-fa61fbb2fc8d None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=88112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:33:56.014224 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f76ef2e-5bb4-45f5-a82a-fa61fbb2fc8d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:56.015685 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f76ef2e-5bb4-45f5-a82a-fa61fbb2fc8d None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:56.020483 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 403/808] 10.222.0.26 () {56 vars in 1124 bytes} [Wed Aug 24 05:33:55 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:33:56.021197 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f76ef2e-5bb4-45f5-a82a-fa61fbb2fc8d None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:56.035475 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:56.050170 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03084090-2db4-48a3-a8ec-4eeb081b5fdc None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:56.083780 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:56.086208 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7638919e-90c8-4e33-93be-9fd712d67969 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:56.086854 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7638919e-90c8-4e33-93be-9fd712d67969 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:56.087162 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7638919e-90c8-4e33-93be-9fd712d67969 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:56.087427 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7638919e-90c8-4e33-93be-9fd712d67969 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:56.099283 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7638919e-90c8-4e33-93be-9fd712d67969 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:56.100820 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7638919e-90c8-4e33-93be-9fd712d67969 None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:56.117090 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application [None req-7638919e-90c8-4e33-93be-9fd712d67969 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:33:56.117090 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:33:56.117090 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:33:56.117090 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:33:56.117090 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:33:56.117090 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:33:56.117090 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:33:56.117090 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:33:56.117090 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:33:56.117090 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:33:56.117090 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:33:56.117090 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:33:56.117090 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 05:33:56.117090 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 05:33:56.117090 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 05:33:56.117090 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 05:33:56.123234 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:33:56.123234 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:33:56.123234 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:33:56.123234 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:33:56.123234 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:33:56.123234 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:33:56.123234 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:33:56.123234 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application with Lock( Aug 24 05:33:56.123234 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:33:56.123234 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:33:56.123234 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:33:56.123234 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:33:56.123234 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:33:56.123234 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:33:56.123234 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:33:56.123234 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:33:56.123234 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 05:33:56.124161 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 05:33:56.124161 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:33:56.124161 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Aug 24 05:33:56.124161 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 406/809] 10.222.0.26 () {56 vars in 1108 bytes} [Wed Aug 24 05:33:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:33:56.124161 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a6f802-17e3-467f-b4ad-52ee0f9bf986 None None] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:56.124161 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a6f802-17e3-467f-b4ad-52ee0f9bf986 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:56.124161 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a6f802-17e3-467f-b4ad-52ee0f9bf986 None None] PATH_INFO: `/` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:56.124161 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 407/810] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 24 05:33:56 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:33:56.124161 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a6f802-17e3-467f-b4ad-52ee0f9bf986 None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:56.136365 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f76ef2e-5bb4-45f5-a82a-fa61fbb2fc8d None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:56.172825 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c77f89-766a-4464-88a3-b5a1b6ab6d2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:56.173533 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c77f89-766a-4464-88a3-b5a1b6ab6d2c None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:56.173888 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c77f89-766a-4464-88a3-b5a1b6ab6d2c None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:56.174249 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c77f89-766a-4464-88a3-b5a1b6ab6d2c None admin] PATH_INFO: `/v3/users` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:56.175047 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c77f89-766a-4464-88a3-b5a1b6ab6d2c None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=88112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:33:56.175425 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c77f89-766a-4464-88a3-b5a1b6ab6d2c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:56.176912 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c77f89-766a-4464-88a3-b5a1b6ab6d2c None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:56.195538 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 404/811] 10.222.0.26 () {56 vars in 1149 bytes} [Wed Aug 24 05:33:56 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:33:56.196396 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c77f89-766a-4464-88a3-b5a1b6ab6d2c None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:56.237729 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a6f802-17e3-467f-b4ad-52ee0f9bf986 None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:56.272310 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57812ddc-5a5b-47c1-b604-2ce8ad152015 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:56.272831 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57812ddc-5a5b-47c1-b604-2ce8ad152015 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:56.273112 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57812ddc-5a5b-47c1-b604-2ce8ad152015 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:56.273385 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57812ddc-5a5b-47c1-b604-2ce8ad152015 None admin] PATH_INFO: `/v3/services` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:56.274033 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57812ddc-5a5b-47c1-b604-2ce8ad152015 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=88113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:33:56.274337 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57812ddc-5a5b-47c1-b604-2ce8ad152015 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:56.275724 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57812ddc-5a5b-47c1-b604-2ce8ad152015 None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:56.280560 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 408/812] 10.222.0.26 () {56 vars in 1124 bytes} [Wed Aug 24 05:33:56 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:33:56.282245 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a16e20-fbdb-4610-a965-458695a1f4ed None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:56.282530 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a16e20-fbdb-4610-a965-458695a1f4ed None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:56.282803 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a16e20-fbdb-4610-a965-458695a1f4ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:56.290141 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:56.303379 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-33a16e20-fbdb-4610-a965-458695a1f4ed None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:33:56.304588 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-33a16e20-fbdb-4610-a965-458695a1f4ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:33:56.316094 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c77f89-766a-4464-88a3-b5a1b6ab6d2c None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:56.333877 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:56.353659 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3579936e-2db4-4c7d-a769-2661a216fb8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:56.354335 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3579936e-2db4-4c7d-a769-2661a216fb8b None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:56.354613 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3579936e-2db4-4c7d-a769-2661a216fb8b None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:56.354881 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3579936e-2db4-4c7d-a769-2661a216fb8b None admin] PATH_INFO: `/v3/domains` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:56.355544 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3579936e-2db4-4c7d-a769-2661a216fb8b None admin] RBAC: Adding query filter params (name=Default) {{(pid=88112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:33:56.355845 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3579936e-2db4-4c7d-a769-2661a216fb8b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:56.357246 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3579936e-2db4-4c7d-a769-2661a216fb8b None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:56.375677 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 405/813] 10.222.0.26 () {56 vars in 1109 bytes} [Wed Aug 24 05:33:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:33:56.375677 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3579936e-2db4-4c7d-a769-2661a216fb8b None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:56.484246 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3579936e-2db4-4c7d-a769-2661a216fb8b None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:56.501264 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 409/814] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 24 05:33:56 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 05:33:56.501264 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a16e20-fbdb-4610-a965-458695a1f4ed None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:56.540390 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d977c646-fb9d-4d6d-b65f-5b65c4521ada None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:56.541032 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d977c646-fb9d-4d6d-b65f-5b65c4521ada None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:56.541314 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d977c646-fb9d-4d6d-b65f-5b65c4521ada None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:56.541587 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d977c646-fb9d-4d6d-b65f-5b65c4521ada None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:56.554137 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d977c646-fb9d-4d6d-b65f-5b65c4521ada None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:56.555678 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d977c646-fb9d-4d6d-b65f-5b65c4521ada None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:56.571285 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application [None req-d977c646-fb9d-4d6d-b65f-5b65c4521ada None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:33:56.571285 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:33:56.571285 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:33:56.571285 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:33:56.571285 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:33:56.571285 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:33:56.571285 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:33:56.571285 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:33:56.571285 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:33:56.571285 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:33:56.571285 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:33:56.571285 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:33:56.571285 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 05:33:56.571285 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 05:33:56.571285 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 05:33:56.571285 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 05:33:56.572287 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:33:56.572287 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:33:56.572287 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:33:56.572287 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:33:56.572287 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:33:56.572287 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:33:56.572287 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:33:56.572287 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application with Lock( Aug 24 05:33:56.572287 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:33:56.572287 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:33:56.572287 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:33:56.572287 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:33:56.572287 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:33:56.572287 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:33:56.572287 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:33:56.572287 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:33:56.572287 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 05:33:56.573196 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 05:33:56.573196 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:33:56.573196 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Aug 24 05:33:56.577384 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 406/815] 10.222.0.26 () {56 vars in 1108 bytes} [Wed Aug 24 05:33:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:33:56.578901 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d977c646-fb9d-4d6d-b65f-5b65c4521ada None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:56.630401 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a16e20-fbdb-4610-a965-458695a1f4ed None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:56.669114 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45528cf8-c656-43f5-bbdc-375adf9ba47e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:56.670192 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45528cf8-c656-43f5-bbdc-375adf9ba47e None admin] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:56.670703 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45528cf8-c656-43f5-bbdc-375adf9ba47e None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:56.671172 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45528cf8-c656-43f5-bbdc-375adf9ba47e None admin] PATH_INFO: `/v3/endpoints` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:56.672617 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45528cf8-c656-43f5-bbdc-375adf9ba47e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:56.674266 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45528cf8-c656-43f5-bbdc-375adf9ba47e None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:56.679789 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:56.703540 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 410/816] 10.222.0.26 () {60 vars in 1144 bytes} [Wed Aug 24 05:33:56 2022] POST /identity/v3/endpoints => generated 346 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:33:56.704903 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45528cf8-c656-43f5-bbdc-375adf9ba47e None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:56.759707 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:56.847709 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45528cf8-c656-43f5-bbdc-375adf9ba47e None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:56.865317 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d977c646-fb9d-4d6d-b65f-5b65c4521ada None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:56.886766 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f91566d-c995-4b77-9633-81ba2e192143 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:56.887760 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f91566d-c995-4b77-9633-81ba2e192143 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:56.888239 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f91566d-c995-4b77-9633-81ba2e192143 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:56.888708 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f91566d-c995-4b77-9633-81ba2e192143 None admin] PATH_INFO: `/v3/domains` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:56.889554 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f91566d-c995-4b77-9633-81ba2e192143 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:33:56.890079 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f91566d-c995-4b77-9633-81ba2e192143 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:56.891742 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f91566d-c995-4b77-9633-81ba2e192143 None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:56.903938 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6568c4e-b3ac-447a-9d77-7589a6d46d85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:56.904722 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 411/817] 10.222.0.26 () {56 vars in 1109 bytes} [Wed Aug 24 05:33:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:33:56.905371 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6568c4e-b3ac-447a-9d77-7589a6d46d85 None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:56.905652 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6568c4e-b3ac-447a-9d77-7589a6d46d85 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:56.905963 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6568c4e-b3ac-447a-9d77-7589a6d46d85 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:56.906329 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f91566d-c995-4b77-9633-81ba2e192143 None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:56.915803 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6568c4e-b3ac-447a-9d77-7589a6d46d85 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:56.917731 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6568c4e-b3ac-447a-9d77-7589a6d46d85 None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:56.933360 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application [None req-c6568c4e-b3ac-447a-9d77-7589a6d46d85 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 05:33:56.933360 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:33:56.933360 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:33:56.933360 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:33:56.933360 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:33:56.933360 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:33:56.933360 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:33:56.933360 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:33:56.933360 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:33:56.933360 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:33:56.933360 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:33:56.933360 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:33:56.933360 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 05:33:56.933360 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 05:33:56.933360 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 05:33:56.933360 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 05:33:56.934426 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:33:56.934426 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:33:56.934426 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 05:33:56.934426 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 05:33:56.934426 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 05:33:56.934426 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 05:33:56.934426 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:33:56.934426 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:33:56.934426 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:33:56.934426 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:33:56.934426 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:33:56.934426 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application with Lock( Aug 24 05:33:56.934426 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:33:56.934426 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:33:56.934426 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:33:56.934426 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:33:56.934426 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:33:56.934426 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:33:56.935773 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:33:56.935773 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:33:56.935773 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 05:33:56.935773 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 05:33:56.935773 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 05:33:56.935773 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 05:33:56.935773 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 05:33:56.935773 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 05:33:56.935773 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 05:33:56.935773 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Aug 24 05:33:56.938203 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 407/818] 10.222.0.26 () {56 vars in 1093 bytes} [Wed Aug 24 05:33:56 2022] GET /identity/v3/users/nova => generated 82 bytes in 357 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:33:56.939856 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6568c4e-b3ac-447a-9d77-7589a6d46d85 None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:56.970954 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:57.037419 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:57.047259 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f91566d-c995-4b77-9633-81ba2e192143 None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:57.051416 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6568c4e-b3ac-447a-9d77-7589a6d46d85 None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:57.088880 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f84b89-a09a-46a2-9b80-861cf7f2469d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:57.089817 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f84b89-a09a-46a2-9b80-861cf7f2469d None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:57.090353 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f84b89-a09a-46a2-9b80-861cf7f2469d None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:57.090959 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f84b89-a09a-46a2-9b80-861cf7f2469d None admin] PATH_INFO: `/v3/projects/service` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:57.092055 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b310941-5e72-49e9-93fe-53fc3ef93cfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:57.092696 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b310941-5e72-49e9-93fe-53fc3ef93cfb None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:57.092976 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b310941-5e72-49e9-93fe-53fc3ef93cfb None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:57.093247 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b310941-5e72-49e9-93fe-53fc3ef93cfb None admin] PATH_INFO: `/v3/services/network` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:57.094151 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b310941-5e72-49e9-93fe-53fc3ef93cfb None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:57.095940 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b310941-5e72-49e9-93fe-53fc3ef93cfb None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:57.099848 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f84b89-a09a-46a2-9b80-861cf7f2469d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:57.101492 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f84b89-a09a-46a2-9b80-861cf7f2469d None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:57.105781 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application [None req-9b310941-5e72-49e9-93fe-53fc3ef93cfb None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 05:33:57.105781 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:33:57.105781 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 05:33:57.105781 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 05:33:57.105781 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 05:33:57.105781 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 05:33:57.105781 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 05:33:57.105781 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 05:33:57.105781 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 05:33:57.105781 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Aug 24 05:33:57.105781 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 05:33:57.105781 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Aug 24 05:33:57.105781 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:33:57.105781 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:33:57.105781 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:33:57.105781 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:33:57.105781 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:33:57.106808 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:33:57.106808 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:33:57.106808 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:33:57.106808 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:33:57.106808 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:33:57.106808 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:33:57.106808 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 05:33:57.106808 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 05:33:57.106808 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 05:33:57.106808 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 05:33:57.106808 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:33:57.106808 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:33:57.106808 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:33:57.106808 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:33:57.106808 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:33:57.106808 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:33:57.107656 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:33:57.107656 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application with Lock( Aug 24 05:33:57.107656 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:33:57.107656 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:33:57.107656 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:33:57.107656 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:33:57.107656 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:33:57.107656 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:33:57.107656 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:33:57.107656 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:33:57.107656 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 05:33:57.107656 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 05:33:57.107656 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 05:33:57.107656 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Aug 24 05:33:57.107656 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 412/819] 10.222.0.26 () {56 vars in 1111 bytes} [Wed Aug 24 05:33:56 2022] GET /identity/v3/services/network => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:33:57.108446 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b310941-5e72-49e9-93fe-53fc3ef93cfb None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:57.117305 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application [None req-80f84b89-a09a-46a2-9b80-861cf7f2469d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 05:33:57.117305 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:33:57.117305 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:33:57.117305 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:33:57.117305 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:33:57.117305 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:33:57.117305 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:33:57.117305 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:33:57.117305 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:33:57.117305 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:33:57.117305 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:33:57.117305 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:33:57.117305 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 05:33:57.117305 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 05:33:57.117305 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 05:33:57.118291 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 05:33:57.118291 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:33:57.118291 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:33:57.118291 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:33:57.118291 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:33:57.118291 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:33:57.118291 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:33:57.118291 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:33:57.118291 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application with Lock( Aug 24 05:33:57.118291 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:33:57.118291 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:33:57.118291 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:33:57.118291 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:33:57.118291 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:33:57.118291 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:33:57.118291 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:33:57.118291 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:33:57.119237 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 05:33:57.119237 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 05:33:57.119237 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 05:33:57.119237 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 05:33:57.119237 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 05:33:57.119237 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 05:33:57.119237 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 05:33:57.119237 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Aug 24 05:33:57.121386 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 408/820] 10.222.0.26 () {56 vars in 1111 bytes} [Wed Aug 24 05:33:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:33:57.127039 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f84b89-a09a-46a2-9b80-861cf7f2469d None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:57.242424 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f84b89-a09a-46a2-9b80-861cf7f2469d None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:57.244609 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b310941-5e72-49e9-93fe-53fc3ef93cfb None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:57.259563 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:57.282639 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e364346e-99ed-406d-a335-9cfcc88219b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:57.283535 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e364346e-99ed-406d-a335-9cfcc88219b6 None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:57.283978 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e364346e-99ed-406d-a335-9cfcc88219b6 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:57.284497 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e364346e-99ed-406d-a335-9cfcc88219b6 None admin] PATH_INFO: `/v3/services` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:57.285407 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e364346e-99ed-406d-a335-9cfcc88219b6 None admin] RBAC: Adding query filter params (name=network) {{(pid=88112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:33:57.286041 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e364346e-99ed-406d-a335-9cfcc88219b6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:57.287681 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e364346e-99ed-406d-a335-9cfcc88219b6 None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:57.289220 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611068e4-cce1-4a42-95e9-45a4b2979926 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:57.290201 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611068e4-cce1-4a42-95e9-45a4b2979926 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:57.290553 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611068e4-cce1-4a42-95e9-45a4b2979926 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:57.290892 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611068e4-cce1-4a42-95e9-45a4b2979926 None admin] PATH_INFO: `/v3/users` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:57.291783 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611068e4-cce1-4a42-95e9-45a4b2979926 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:33:57.292195 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611068e4-cce1-4a42-95e9-45a4b2979926 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:57.293622 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611068e4-cce1-4a42-95e9-45a4b2979926 None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:57.294317 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 409/821] 10.222.0.26 () {56 vars in 1112 bytes} [Wed Aug 24 05:33:57 2022] GET /identity/v3/services?name=network => generated 124 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:33:57.295399 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e364346e-99ed-406d-a335-9cfcc88219b6 None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:57.311869 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:57.324669 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 413/822] 10.222.0.26 () {56 vars in 1133 bytes} [Wed Aug 24 05:33:57 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:33:57.324669 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611068e4-cce1-4a42-95e9-45a4b2979926 None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:57.412187 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e364346e-99ed-406d-a335-9cfcc88219b6 None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:57.449849 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507862f3-60cd-479c-8c8f-b0dccfaee2f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:57.450889 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507862f3-60cd-479c-8c8f-b0dccfaee2f1 None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:57.451377 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507862f3-60cd-479c-8c8f-b0dccfaee2f1 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:57.451854 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507862f3-60cd-479c-8c8f-b0dccfaee2f1 None admin] PATH_INFO: `/v3/projects` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:57.452791 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507862f3-60cd-479c-8c8f-b0dccfaee2f1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:33:57.453302 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507862f3-60cd-479c-8c8f-b0dccfaee2f1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:57.454981 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507862f3-60cd-479c-8c8f-b0dccfaee2f1 None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:57.455794 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611068e4-cce1-4a42-95e9-45a4b2979926 None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:57.473099 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 410/823] 10.222.0.26 () {56 vars in 1148 bytes} [Wed Aug 24 05:33:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:33:57.474371 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507862f3-60cd-479c-8c8f-b0dccfaee2f1 None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:57.504778 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b8b308-9dc4-4a7a-9e27-fec134836c06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:57.505826 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b8b308-9dc4-4a7a-9e27-fec134836c06 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:57.506145 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b8b308-9dc4-4a7a-9e27-fec134836c06 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:57.506432 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b8b308-9dc4-4a7a-9e27-fec134836c06 None admin] PATH_INFO: `/v3/services` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:57.507328 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b8b308-9dc4-4a7a-9e27-fec134836c06 None admin] RBAC: Adding query filter params (type=network) {{(pid=88113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:33:57.507643 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b8b308-9dc4-4a7a-9e27-fec134836c06 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:57.509423 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b8b308-9dc4-4a7a-9e27-fec134836c06 None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:57.516187 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 414/824] 10.222.0.26 () {56 vars in 1112 bytes} [Wed Aug 24 05:33:57 2022] GET /identity/v3/services?type=network => generated 350 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:33:57.517291 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b8b308-9dc4-4a7a-9e27-fec134836c06 None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:57.561132 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:57.565381 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:57.602690 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507862f3-60cd-479c-8c8f-b0dccfaee2f1 None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:57.639040 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1ffa0f-0393-4d9c-929a-ad71c4afcf1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:57.639792 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1ffa0f-0393-4d9c-929a-ad71c4afcf1d None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:57.640265 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1ffa0f-0393-4d9c-929a-ad71c4afcf1d None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:57.640570 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1ffa0f-0393-4d9c-929a-ad71c4afcf1d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:57.657883 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b8b308-9dc4-4a7a-9e27-fec134836c06 None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:57.699655 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cb075f-a843-4045-b307-119c02d5a842 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:57.700354 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cb075f-a843-4045-b307-119c02d5a842 None admin] REQUEST_METHOD: `PUT` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:57.700912 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cb075f-a843-4045-b307-119c02d5a842 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:57.701049 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cb075f-a843-4045-b307-119c02d5a842 None admin] PATH_INFO: `/v3/projects/ded4fe81d4dc43188dd84e53025ee783/users/6c2c08b27a0f4943b5da908eb7b1cd96/roles/59fa3749ca7f47e2ba1127945e13336c` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:57.711304 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1ffa0f-0393-4d9c-929a-ad71c4afcf1d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:57.712833 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1ffa0f-0393-4d9c-929a-ad71c4afcf1d None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:57.716152 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cb075f-a843-4045-b307-119c02d5a842 None admin] RBAC: Authorizing `identity:create_grant(project_id=ded4fe81d4dc43188dd84e53025ee783, user_id=6c2c08b27a0f4943b5da908eb7b1cd96, role_id=59fa3749ca7f47e2ba1127945e13336c)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:57.717419 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cb075f-a843-4045-b307-119c02d5a842 None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:57.741977 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 415/825] 10.222.0.26 () {58 vars in 1439 bytes} [Wed Aug 24 05:33:57 2022] PUT /identity/v3/projects/ded4fe81d4dc43188dd84e53025ee783/users/6c2c08b27a0f4943b5da908eb7b1cd96/roles/59fa3749ca7f47e2ba1127945e13336c => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:33:57.741977 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cb075f-a843-4045-b307-119c02d5a842 None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:57.793742 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:57.839122 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 411/826] 10.222.0.26 () {58 vars in 1282 bytes} [Wed Aug 24 05:33:57 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 05:33:57.840633 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be27c78-f825-443d-9511-f1f4209fcae3 None None] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:57.840923 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be27c78-f825-443d-9511-f1f4209fcae3 None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:57.841189 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be27c78-f825-443d-9511-f1f4209fcae3 None None] PATH_INFO: `/` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:57.843862 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 412/827] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 24 05:33:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:33:57.844750 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be27c78-f825-443d-9511-f1f4209fcae3 None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:57.864527 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:57.893536 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cb075f-a843-4045-b307-119c02d5a842 None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:57.940272 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5100a9be-7fe3-4a5c-bb29-f68a6d1d86ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:57.941056 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5100a9be-7fe3-4a5c-bb29-f68a6d1d86ff None admin] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:57.941482 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5100a9be-7fe3-4a5c-bb29-f68a6d1d86ff None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:57.942146 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5100a9be-7fe3-4a5c-bb29-f68a6d1d86ff None admin] PATH_INFO: `/v3/endpoints` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:57.943020 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5100a9be-7fe3-4a5c-bb29-f68a6d1d86ff None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:57.944613 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5100a9be-7fe3-4a5c-bb29-f68a6d1d86ff None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:57.966589 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 416/828] 10.222.0.26 () {60 vars in 1144 bytes} [Wed Aug 24 05:33:57 2022] POST /identity/v3/endpoints => generated 337 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:33:57.967975 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc063d5-59b4-46d2-90a2-9932d945740c None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:57.969285 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc063d5-59b4-46d2-90a2-9932d945740c None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:57.969285 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc063d5-59b4-46d2-90a2-9932d945740c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:57.991757 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-ccc063d5-59b4-46d2-90a2-9932d945740c None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:33:57.992615 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be27c78-f825-443d-9511-f1f4209fcae3 None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:57.995309 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-ccc063d5-59b4-46d2-90a2-9932d945740c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:33:58.037826 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af2297f-210b-4db1-bd79-1f14a410bdb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:58.038809 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af2297f-210b-4db1-bd79-1f14a410bdb5 None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:58.039184 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af2297f-210b-4db1-bd79-1f14a410bdb5 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:58.039557 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af2297f-210b-4db1-bd79-1f14a410bdb5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:58.054275 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af2297f-210b-4db1-bd79-1f14a410bdb5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:58.056446 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af2297f-210b-4db1-bd79-1f14a410bdb5 None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:58.078045 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application [None req-3af2297f-210b-4db1-bd79-1f14a410bdb5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:33:58.078045 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:33:58.078045 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:33:58.078045 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:33:58.078045 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:33:58.078045 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:33:58.078045 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:33:58.078045 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:33:58.078045 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:33:58.078045 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:33:58.078045 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:33:58.078045 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:33:58.078045 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 05:33:58.078045 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 05:33:58.078045 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 05:33:58.078045 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 05:33:58.079260 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:33:58.079260 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:33:58.079260 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:33:58.079260 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:33:58.079260 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:33:58.079260 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:33:58.079260 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:33:58.079260 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application with Lock( Aug 24 05:33:58.079260 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:33:58.079260 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:33:58.079260 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:33:58.079260 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:33:58.079260 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:33:58.079260 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:33:58.079260 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:33:58.079260 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:33:58.079260 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 05:33:58.080353 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 05:33:58.080353 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:33:58.080353 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Aug 24 05:33:58.081919 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 413/829] 10.222.0.26 () {56 vars in 1108 bytes} [Wed Aug 24 05:33:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 05:33:58.083252 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 417/830] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 24 05:33:57 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 05:33:58.087577 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af2297f-210b-4db1-bd79-1f14a410bdb5 None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:58.134398 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:58.224671 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af2297f-210b-4db1-bd79-1f14a410bdb5 None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:58.260050 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a547551-45ee-43d1-8058-6b1b72b57884 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:58.260664 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a547551-45ee-43d1-8058-6b1b72b57884 None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:58.261004 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a547551-45ee-43d1-8058-6b1b72b57884 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:58.261281 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a547551-45ee-43d1-8058-6b1b72b57884 None admin] PATH_INFO: `/v3/domains` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:58.261928 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a547551-45ee-43d1-8058-6b1b72b57884 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:33:58.262258 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a547551-45ee-43d1-8058-6b1b72b57884 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:58.263618 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a547551-45ee-43d1-8058-6b1b72b57884 None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:58.277052 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 414/831] 10.222.0.26 () {56 vars in 1109 bytes} [Wed Aug 24 05:33:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:33:58.282475 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc063d5-59b4-46d2-90a2-9932d945740c None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:58.352992 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:58.394611 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc063d5-59b4-46d2-90a2-9932d945740c None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:58.406725 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a547551-45ee-43d1-8058-6b1b72b57884 None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:58.432277 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4970c8ac-3faa-4a2e-9d3d-f389c9a8ed90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:58.432969 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4970c8ac-3faa-4a2e-9d3d-f389c9a8ed90 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:58.433250 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4970c8ac-3faa-4a2e-9d3d-f389c9a8ed90 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:58.433520 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4970c8ac-3faa-4a2e-9d3d-f389c9a8ed90 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:58.441233 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4970c8ac-3faa-4a2e-9d3d-f389c9a8ed90 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:58.443052 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4970c8ac-3faa-4a2e-9d3d-f389c9a8ed90 None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:58.455102 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application [None req-4970c8ac-3faa-4a2e-9d3d-f389c9a8ed90 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 05:33:58.455102 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:33:58.455102 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:33:58.455102 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:33:58.455102 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:33:58.455102 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:33:58.455102 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:33:58.455102 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:33:58.455102 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:33:58.455102 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:33:58.455102 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:33:58.455102 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:33:58.455102 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 05:33:58.455102 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 05:33:58.455102 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 05:33:58.456036 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 05:33:58.456036 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:33:58.456036 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:33:58.456036 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:33:58.456036 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:33:58.456036 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:33:58.456036 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:33:58.456036 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:33:58.456036 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application with Lock( Aug 24 05:33:58.456036 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:33:58.456036 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:33:58.456036 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:33:58.456036 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:33:58.456036 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:33:58.456036 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:33:58.456036 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:33:58.456036 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:33:58.456930 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 05:33:58.456930 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 05:33:58.456930 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 05:33:58.456930 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 05:33:58.456930 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 05:33:58.456930 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 05:33:58.456930 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 05:33:58.456930 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Aug 24 05:33:58.456930 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 418/832] 10.222.0.26 () {56 vars in 1111 bytes} [Wed Aug 24 05:33:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:33:58.464924 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4970c8ac-3faa-4a2e-9d3d-f389c9a8ed90 None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:58.522838 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:58.546277 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a547551-45ee-43d1-8058-6b1b72b57884 None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:58.588122 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba0ab32-2c29-4b43-995c-980622449c2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:58.588750 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba0ab32-2c29-4b43-995c-980622449c2b None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:58.589029 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba0ab32-2c29-4b43-995c-980622449c2b None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:58.589296 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba0ab32-2c29-4b43-995c-980622449c2b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:58.600082 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba0ab32-2c29-4b43-995c-980622449c2b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:33:58.602055 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4970c8ac-3faa-4a2e-9d3d-f389c9a8ed90 None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:58.605231 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application [None req-4ba0ab32-2c29-4b43-995c-980622449c2b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 05:33:58.605231 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:33:58.605231 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:33:58.605231 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:33:58.605231 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:33:58.605231 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:33:58.605231 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:33:58.605231 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:33:58.605231 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:33:58.605231 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:33:58.605231 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:33:58.605231 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:33:58.605231 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:33:58.605231 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:33:58.605231 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:33:58.605231 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:33:58.606376 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:33:58.606376 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:33:58.606376 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:33:58.606376 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:33:58.606376 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:33:58.606376 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:33:58.606376 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:33:58.606376 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:33:58.606376 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:33:58.606376 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:33:58.606376 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:33:58.606376 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application with Lock( Aug 24 05:33:58.606376 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:33:58.606376 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:33:58.606376 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:33:58.606376 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:33:58.607494 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:33:58.607494 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:33:58.607494 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:33:58.607494 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:33:58.607494 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:33:58.607494 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:33:58.607494 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:33:58.607494 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:33:58.607494 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:33:58.607494 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:33:58.607494 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 05:33:58.607494 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Aug 24 05:33:58.607494 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 415/833] 10.222.0.26 () {56 vars in 1096 bytes} [Wed Aug 24 05:33:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 05:33:58.615128 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba0ab32-2c29-4b43-995c-980622449c2b None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:58.637010 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:58.647183 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a79547-8655-4fa8-95b0-6ca0f1cf4cb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:58.647871 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a79547-8655-4fa8-95b0-6ca0f1cf4cb1 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:58.648171 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a79547-8655-4fa8-95b0-6ca0f1cf4cb1 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:58.648716 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a79547-8655-4fa8-95b0-6ca0f1cf4cb1 None admin] PATH_INFO: `/v3/projects` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:58.649829 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a79547-8655-4fa8-95b0-6ca0f1cf4cb1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:33:58.650161 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a79547-8655-4fa8-95b0-6ca0f1cf4cb1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:58.652083 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a79547-8655-4fa8-95b0-6ca0f1cf4cb1 None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:58.674029 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 419/834] 10.222.0.26 () {56 vars in 1148 bytes} [Wed Aug 24 05:33:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:33:58.679182 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a79547-8655-4fa8-95b0-6ca0f1cf4cb1 None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:58.740613 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba0ab32-2c29-4b43-995c-980622449c2b None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:58.788497 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1f5fa9-5b35-4675-aa87-e1ae63840242 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:58.789054 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1f5fa9-5b35-4675-aa87-e1ae63840242 None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:58.789330 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1f5fa9-5b35-4675-aa87-e1ae63840242 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:58.789599 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1f5fa9-5b35-4675-aa87-e1ae63840242 None admin] PATH_INFO: `/v3/roles` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:58.790539 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1f5fa9-5b35-4675-aa87-e1ae63840242 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:33:58.790838 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1f5fa9-5b35-4675-aa87-e1ae63840242 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:58.792916 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1f5fa9-5b35-4675-aa87-e1ae63840242 None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:58.797363 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a79547-8655-4fa8-95b0-6ca0f1cf4cb1 None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:58.805978 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 416/835] 10.222.0.26 () {56 vars in 1099 bytes} [Wed Aug 24 05:33:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:33:58.810422 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1f5fa9-5b35-4675-aa87-e1ae63840242 None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:58.814278 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:58.839976 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2359114c-5e90-4ede-b294-9ddc4fad10d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:58.840884 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2359114c-5e90-4ede-b294-9ddc4fad10d5 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:58.841105 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2359114c-5e90-4ede-b294-9ddc4fad10d5 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:58.841469 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2359114c-5e90-4ede-b294-9ddc4fad10d5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:58.842366 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2359114c-5e90-4ede-b294-9ddc4fad10d5 None admin] RBAC: Adding query filter params (role.id=640bda0879494e60b72680ee505285f0, scope.project.id=ded4fe81d4dc43188dd84e53025ee783, user.id=7b633e1aec6c4269bce13aa9c89e911a) {{(pid=88113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:33:58.842731 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2359114c-5e90-4ede-b294-9ddc4fad10d5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:58.844805 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2359114c-5e90-4ede-b294-9ddc4fad10d5 None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:58.857980 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 420/836] 10.222.0.26 () {56 vars in 1374 bytes} [Wed Aug 24 05:33:58 2022] GET /identity/v3/role_assignments?user.id=7b633e1aec6c4269bce13aa9c89e911a&scope.project.id=ded4fe81d4dc43188dd84e53025ee783&role.id=640bda0879494e60b72680ee505285f0 => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:33:58.899545 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485c5ebb-fe51-4f7c-8f6a-d445c204e8f0 None None] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:58.900174 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485c5ebb-fe51-4f7c-8f6a-d445c204e8f0 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:58.900174 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485c5ebb-fe51-4f7c-8f6a-d445c204e8f0 None None] PATH_INFO: `/` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:58.901647 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 421/837] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 24 05:33:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 05:33:58.907509 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3363f8cd-b2bd-4607-b1af-43234bbfecae None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:58.907785 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3363f8cd-b2bd-4607-b1af-43234bbfecae None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:58.908052 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3363f8cd-b2bd-4607-b1af-43234bbfecae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:58.928247 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-3363f8cd-b2bd-4607-b1af-43234bbfecae None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:33:58.929613 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-3363f8cd-b2bd-4607-b1af-43234bbfecae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:33:58.941365 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1f5fa9-5b35-4675-aa87-e1ae63840242 None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:58.984919 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:58.991306 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e229dfd-24dc-4f1c-a964-efb41eca8391 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:58.991955 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e229dfd-24dc-4f1c-a964-efb41eca8391 None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:58.992306 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e229dfd-24dc-4f1c-a964-efb41eca8391 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:58.992582 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e229dfd-24dc-4f1c-a964-efb41eca8391 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:59.008980 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e229dfd-24dc-4f1c-a964-efb41eca8391 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:59.010611 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e229dfd-24dc-4f1c-a964-efb41eca8391 None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:59.014480 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 422/838] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 24 05:33:58 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 05:33:59.026925 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application [None req-8e229dfd-24dc-4f1c-a964-efb41eca8391 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:33:59.026925 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:33:59.026925 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:33:59.026925 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:33:59.026925 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:33:59.026925 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:33:59.026925 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:33:59.026925 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:33:59.026925 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:33:59.026925 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:33:59.026925 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:33:59.026925 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:33:59.026925 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 05:33:59.026925 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 05:33:59.026925 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 05:33:59.026925 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 05:33:59.027888 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:33:59.027888 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:33:59.027888 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:33:59.027888 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:33:59.027888 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:33:59.027888 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:33:59.027888 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:33:59.027888 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application with Lock( Aug 24 05:33:59.027888 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:33:59.027888 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:33:59.027888 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:33:59.027888 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:33:59.027888 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:33:59.027888 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:33:59.027888 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:33:59.027888 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:33:59.027888 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 05:33:59.029036 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 05:33:59.029036 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:33:59.029036 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Aug 24 05:33:59.029036 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 417/839] 10.222.0.26 () {56 vars in 1108 bytes} [Wed Aug 24 05:33:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 05:33:59.034601 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3363f8cd-b2bd-4607-b1af-43234bbfecae None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:59.135885 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3363f8cd-b2bd-4607-b1af-43234bbfecae None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:59.171009 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2300ea41-6d9a-4fc2-839d-7149d290ff46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:59.171646 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2300ea41-6d9a-4fc2-839d-7149d290ff46 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:59.171922 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2300ea41-6d9a-4fc2-839d-7149d290ff46 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:59.172192 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2300ea41-6d9a-4fc2-839d-7149d290ff46 None admin] PATH_INFO: `/v3/domains` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:59.172839 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2300ea41-6d9a-4fc2-839d-7149d290ff46 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:33:59.173136 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2300ea41-6d9a-4fc2-839d-7149d290ff46 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:59.174537 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2300ea41-6d9a-4fc2-839d-7149d290ff46 None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:59.186266 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 423/840] 10.222.0.26 () {56 vars in 1109 bytes} [Wed Aug 24 05:33:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:33:59.195055 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e229dfd-24dc-4f1c-a964-efb41eca8391 None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:59.251935 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:59.286985 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2300ea41-6d9a-4fc2-839d-7149d290ff46 None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:59.302344 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e229dfd-24dc-4f1c-a964-efb41eca8391 None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:59.341408 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:59.341906 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502a3580-b5ec-41f5-b451-dc13c52bad76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:59.342568 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502a3580-b5ec-41f5-b451-dc13c52bad76 None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:59.342856 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502a3580-b5ec-41f5-b451-dc13c52bad76 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:59.343457 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502a3580-b5ec-41f5-b451-dc13c52bad76 None admin] PATH_INFO: `/v3/users/swift` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:59.353060 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502a3580-b5ec-41f5-b451-dc13c52bad76 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:59.354546 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502a3580-b5ec-41f5-b451-dc13c52bad76 None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:59.368845 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application [None req-502a3580-b5ec-41f5-b451-dc13c52bad76 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 24 05:33:59.368845 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:33:59.368845 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:33:59.368845 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:33:59.368845 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:33:59.368845 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:33:59.368845 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:33:59.368845 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:33:59.368845 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:33:59.368845 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:33:59.368845 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:33:59.368845 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:33:59.368845 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 05:33:59.368845 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 05:33:59.368845 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 05:33:59.368845 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 05:33:59.369917 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:33:59.369917 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:33:59.369917 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 05:33:59.369917 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 05:33:59.369917 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 05:33:59.369917 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 05:33:59.369917 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:33:59.369917 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:33:59.369917 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:33:59.369917 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:33:59.369917 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:33:59.369917 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application with Lock( Aug 24 05:33:59.369917 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:33:59.369917 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:33:59.369917 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:33:59.369917 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:33:59.369917 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:33:59.369917 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:33:59.370915 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:33:59.370915 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:33:59.370915 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 05:33:59.370915 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 05:33:59.370915 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 05:33:59.370915 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 05:33:59.370915 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 05:33:59.370915 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 05:33:59.370915 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 24 05:33:59.370915 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Aug 24 05:33:59.370915 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 418/841] 10.222.0.26 () {56 vars in 1096 bytes} [Wed Aug 24 05:33:59 2022] GET /identity/v3/users/swift => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:33:59.375976 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502a3580-b5ec-41f5-b451-dc13c52bad76 None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:59.412479 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2300ea41-6d9a-4fc2-839d-7149d290ff46 None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:59.448389 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d5da7c-0adc-4a88-a1cf-029797089200 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:59.449370 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d5da7c-0adc-4a88-a1cf-029797089200 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:59.449836 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d5da7c-0adc-4a88-a1cf-029797089200 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:59.450305 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d5da7c-0adc-4a88-a1cf-029797089200 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:59.451097 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d5da7c-0adc-4a88-a1cf-029797089200 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:59.453200 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d5da7c-0adc-4a88-a1cf-029797089200 None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:59.462395 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application [None req-17d5da7c-0adc-4a88-a1cf-029797089200 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 05:33:59.462395 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:33:59.462395 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 05:33:59.462395 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 05:33:59.462395 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 05:33:59.462395 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 05:33:59.462395 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 05:33:59.462395 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 05:33:59.462395 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 05:33:59.462395 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Aug 24 05:33:59.462395 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 05:33:59.462395 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Aug 24 05:33:59.462395 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:33:59.462395 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:33:59.462395 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:33:59.462395 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:33:59.462395 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:33:59.463383 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:33:59.463383 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:33:59.463383 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:33:59.463383 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:33:59.463383 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:33:59.463383 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:33:59.463383 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 05:33:59.463383 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 05:33:59.463383 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 05:33:59.463383 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 05:33:59.463383 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:33:59.463383 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:33:59.463383 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:33:59.463383 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:33:59.463383 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:33:59.463383 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:33:59.464220 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:33:59.464220 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application with Lock( Aug 24 05:33:59.464220 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:33:59.464220 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:33:59.464220 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:33:59.464220 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:33:59.464220 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:33:59.464220 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:33:59.464220 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:33:59.464220 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:33:59.464220 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 05:33:59.464220 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 05:33:59.464220 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 05:33:59.464220 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Aug 24 05:33:59.467129 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 424/842] 10.222.0.26 () {56 vars in 1114 bytes} [Wed Aug 24 05:33:59 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:33:59.472423 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d5da7c-0adc-4a88-a1cf-029797089200 None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:59.485516 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502a3580-b5ec-41f5-b451-dc13c52bad76 None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:59.504460 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:59.526405 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817f1966-f709-4866-b4e9-9f39028652e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:59.527376 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817f1966-f709-4866-b4e9-9f39028652e5 None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:59.527900 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817f1966-f709-4866-b4e9-9f39028652e5 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:59.528394 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817f1966-f709-4866-b4e9-9f39028652e5 None admin] PATH_INFO: `/v3/users` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:59.529332 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817f1966-f709-4866-b4e9-9f39028652e5 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=88112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:33:59.529913 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817f1966-f709-4866-b4e9-9f39028652e5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:59.531983 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817f1966-f709-4866-b4e9-9f39028652e5 None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:59.555925 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 419/843] 10.222.0.26 () {56 vars in 1135 bytes} [Wed Aug 24 05:33:59 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:33:59.565971 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817f1966-f709-4866-b4e9-9f39028652e5 None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:59.595080 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d5da7c-0adc-4a88-a1cf-029797089200 None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:59.603927 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:59.641770 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd01f6a4-0df4-4de0-bcd0-2a5c537bf009 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:59.642728 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd01f6a4-0df4-4de0-bcd0-2a5c537bf009 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:59.643286 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd01f6a4-0df4-4de0-bcd0-2a5c537bf009 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:59.643564 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd01f6a4-0df4-4de0-bcd0-2a5c537bf009 None admin] PATH_INFO: `/v3/services` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:59.644191 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd01f6a4-0df4-4de0-bcd0-2a5c537bf009 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=88113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:33:59.644644 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd01f6a4-0df4-4de0-bcd0-2a5c537bf009 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:59.646666 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd01f6a4-0df4-4de0-bcd0-2a5c537bf009 None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:59.654062 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 425/844] 10.222.0.26 () {56 vars in 1114 bytes} [Wed Aug 24 05:33:59 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:33:59.657610 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd01f6a4-0df4-4de0-bcd0-2a5c537bf009 None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:59.669686 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817f1966-f709-4866-b4e9-9f39028652e5 None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:59.705804 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb356ee-1121-4f3a-85c7-55c436143642 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:59.706825 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb356ee-1121-4f3a-85c7-55c436143642 None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:59.707308 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb356ee-1121-4f3a-85c7-55c436143642 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:59.707806 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb356ee-1121-4f3a-85c7-55c436143642 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:59.765219 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:59.774960 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd01f6a4-0df4-4de0-bcd0-2a5c537bf009 None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:33:59.797338 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb356ee-1121-4f3a-85c7-55c436143642 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:59.799096 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb356ee-1121-4f3a-85c7-55c436143642 None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:59.812650 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93640c7b-b9e2-48ec-9d22-e30218836cd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:33:59.813642 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93640c7b-b9e2-48ec-9d22-e30218836cd5 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:59.814248 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93640c7b-b9e2-48ec-9d22-e30218836cd5 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:59.814746 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93640c7b-b9e2-48ec-9d22-e30218836cd5 None admin] PATH_INFO: `/v3/services` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:59.815680 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93640c7b-b9e2-48ec-9d22-e30218836cd5 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=88113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:33:59.816223 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93640c7b-b9e2-48ec-9d22-e30218836cd5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:33:59.818127 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93640c7b-b9e2-48ec-9d22-e30218836cd5 None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:33:59.823651 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 426/845] 10.222.0.26 () {56 vars in 1114 bytes} [Wed Aug 24 05:33:59 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:33:59.849319 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145a09e6-36c5-40d2-9b84-2a931c90a343 None None] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:59.850037 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145a09e6-36c5-40d2-9b84-2a931c90a343 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:59.850519 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145a09e6-36c5-40d2-9b84-2a931c90a343 None None] PATH_INFO: `/` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:59.852436 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 427/846] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 24 05:33:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 05:33:59.858383 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99efdfe2-f5dd-4771-8774-4f06cfa5c1b9 None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:33:59.859534 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99efdfe2-f5dd-4771-8774-4f06cfa5c1b9 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:33:59.860043 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99efdfe2-f5dd-4771-8774-4f06cfa5c1b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:33:59.880065 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-99efdfe2-f5dd-4771-8774-4f06cfa5c1b9 None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:33:59.881697 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-99efdfe2-f5dd-4771-8774-4f06cfa5c1b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:33:59.919580 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:59.932207 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 420/847] 10.222.0.26 () {58 vars in 1282 bytes} [Wed Aug 24 05:33:59 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 05:33:59.934105 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb356ee-1121-4f3a-85c7-55c436143642 None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:33:59.966463 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 428/848] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 24 05:33:59 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 05:34:00.030276 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:34:00.053000 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb356ee-1121-4f3a-85c7-55c436143642 None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:34:00.093037 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8cfe80-f345-412d-897a-90ed9a7358e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:34:00.093707 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8cfe80-f345-412d-897a-90ed9a7358e7 None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:00.094003 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8cfe80-f345-412d-897a-90ed9a7358e7 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:00.094333 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8cfe80-f345-412d-897a-90ed9a7358e7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:00.104871 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8cfe80-f345-412d-897a-90ed9a7358e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:34:00.106325 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8cfe80-f345-412d-897a-90ed9a7358e7 None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:34:00.121109 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application [None req-1b8cfe80-f345-412d-897a-90ed9a7358e7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:34:00.121109 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:34:00.121109 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:34:00.121109 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:34:00.121109 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:34:00.121109 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:34:00.121109 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:34:00.121109 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:34:00.121109 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:34:00.121109 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:34:00.121109 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:34:00.121109 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:34:00.121109 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 05:34:00.121109 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 05:34:00.121109 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 05:34:00.121109 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 05:34:00.122115 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:34:00.122115 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:34:00.122115 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:34:00.122115 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:34:00.122115 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:34:00.122115 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:34:00.122115 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:34:00.122115 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application with Lock( Aug 24 05:34:00.122115 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:34:00.122115 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:34:00.122115 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:34:00.122115 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:34:00.122115 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:34:00.122115 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:34:00.122115 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:34:00.122115 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:34:00.122115 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 05:34:00.123044 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 05:34:00.123044 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:34:00.123044 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Aug 24 05:34:00.123044 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 421/849] 10.222.0.26 () {56 vars in 1108 bytes} [Wed Aug 24 05:33:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 05:34:00.129866 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99efdfe2-f5dd-4771-8774-4f06cfa5c1b9 None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:34:00.232908 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8cfe80-f345-412d-897a-90ed9a7358e7 None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:34:00.233262 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99efdfe2-f5dd-4771-8774-4f06cfa5c1b9 None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:34:00.279096 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05567a7-9b96-409e-9b5e-aa251f8ae6e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:34:00.279968 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05567a7-9b96-409e-9b5e-aa251f8ae6e5 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:00.280246 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05567a7-9b96-409e-9b5e-aa251f8ae6e5 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:00.280512 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05567a7-9b96-409e-9b5e-aa251f8ae6e5 None admin] PATH_INFO: `/v3/domains` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:00.281187 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05567a7-9b96-409e-9b5e-aa251f8ae6e5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:34:00.281635 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05567a7-9b96-409e-9b5e-aa251f8ae6e5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:34:00.283685 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05567a7-9b96-409e-9b5e-aa251f8ae6e5 None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:34:00.298821 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 429/850] 10.222.0.26 () {56 vars in 1109 bytes} [Wed Aug 24 05:34:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:34:00.306923 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05567a7-9b96-409e-9b5e-aa251f8ae6e5 None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:34:00.338150 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:34:00.345438 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8cfe80-f345-412d-897a-90ed9a7358e7 None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:34:00.375764 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:34:00.389746 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adf9a76-c999-4564-ab9e-2e5334cf4fc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:34:00.390444 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adf9a76-c999-4564-ab9e-2e5334cf4fc8 None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:00.390723 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adf9a76-c999-4564-ab9e-2e5334cf4fc8 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:00.390991 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adf9a76-c999-4564-ab9e-2e5334cf4fc8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:00.404591 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adf9a76-c999-4564-ab9e-2e5334cf4fc8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:34:00.411029 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application [None req-6adf9a76-c999-4564-ab9e-2e5334cf4fc8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 05:34:00.411029 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:34:00.411029 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:34:00.411029 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:34:00.411029 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:34:00.411029 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:34:00.411029 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:34:00.411029 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:34:00.411029 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:34:00.411029 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:34:00.411029 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:34:00.411029 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:34:00.411029 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:34:00.411029 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:34:00.411029 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:34:00.411029 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:34:00.412280 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:34:00.412280 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:34:00.412280 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:34:00.412280 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:34:00.412280 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:34:00.412280 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:34:00.412280 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:34:00.412280 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:34:00.412280 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:34:00.412280 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:34:00.412280 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:34:00.412280 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application with Lock( Aug 24 05:34:00.412280 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:34:00.412280 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:34:00.412280 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:34:00.412280 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:34:00.413251 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:34:00.413251 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:34:00.413251 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:34:00.413251 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:34:00.413251 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:34:00.413251 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:34:00.413251 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:34:00.413251 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:34:00.413251 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:34:00.413251 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:34:00.413251 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 05:34:00.413251 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Aug 24 05:34:00.413925 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 422/851] 10.222.0.26 () {56 vars in 1102 bytes} [Wed Aug 24 05:34:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 05:34:00.418766 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adf9a76-c999-4564-ab9e-2e5334cf4fc8 None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:34:00.429614 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05567a7-9b96-409e-9b5e-aa251f8ae6e5 None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:34:00.484776 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9c8abc-1df8-40d1-92fd-75ffd6187cf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:34:00.485323 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9c8abc-1df8-40d1-92fd-75ffd6187cf6 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:00.485606 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9c8abc-1df8-40d1-92fd-75ffd6187cf6 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:00.485878 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9c8abc-1df8-40d1-92fd-75ffd6187cf6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:00.500836 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9c8abc-1df8-40d1-92fd-75ffd6187cf6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:34:00.502339 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9c8abc-1df8-40d1-92fd-75ffd6187cf6 None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:34:00.514712 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application [None req-aa9c8abc-1df8-40d1-92fd-75ffd6187cf6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 05:34:00.514712 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:34:00.514712 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:34:00.514712 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:34:00.514712 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:34:00.514712 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:34:00.514712 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:34:00.514712 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:34:00.514712 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:34:00.514712 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:34:00.514712 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:34:00.514712 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:34:00.514712 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 05:34:00.514712 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 05:34:00.514712 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 05:34:00.515698 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 05:34:00.515698 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:34:00.515698 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:34:00.515698 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:34:00.515698 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:34:00.515698 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:34:00.515698 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:34:00.515698 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:34:00.515698 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application with Lock( Aug 24 05:34:00.515698 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:34:00.515698 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:34:00.515698 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:34:00.515698 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:34:00.515698 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:34:00.515698 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:34:00.515698 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:34:00.515698 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:34:00.516588 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 05:34:00.516588 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 05:34:00.516588 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 05:34:00.516588 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 05:34:00.516588 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 05:34:00.516588 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 05:34:00.516588 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 05:34:00.516588 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Aug 24 05:34:00.520830 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 430/852] 10.222.0.26 () {56 vars in 1111 bytes} [Wed Aug 24 05:34:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:34:00.521797 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9c8abc-1df8-40d1-92fd-75ffd6187cf6 None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:34:00.555582 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adf9a76-c999-4564-ab9e-2e5334cf4fc8 None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:34:00.591586 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edb0b4e-077b-47fd-9d31-8ae2ec12d2ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:34:00.592480 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edb0b4e-077b-47fd-9d31-8ae2ec12d2ff None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:00.592940 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edb0b4e-077b-47fd-9d31-8ae2ec12d2ff None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:00.593431 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edb0b4e-077b-47fd-9d31-8ae2ec12d2ff None admin] PATH_INFO: `/v3/roles` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:00.594286 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edb0b4e-077b-47fd-9d31-8ae2ec12d2ff None admin] RBAC: Adding query filter params (name=service) {{(pid=88112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:34:00.594761 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edb0b4e-077b-47fd-9d31-8ae2ec12d2ff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:34:00.596289 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edb0b4e-077b-47fd-9d31-8ae2ec12d2ff None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:34:00.605078 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 423/853] 10.222.0.26 () {56 vars in 1103 bytes} [Wed Aug 24 05:34:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:34:00.614089 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edb0b4e-077b-47fd-9d31-8ae2ec12d2ff None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:34:00.620204 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:34:00.639155 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9c8abc-1df8-40d1-92fd-75ffd6187cf6 None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:34:00.676709 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:34:00.678122 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb621656-354e-4423-b5c3-141331b9bd4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:34:00.678902 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb621656-354e-4423-b5c3-141331b9bd4e None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:00.679249 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb621656-354e-4423-b5c3-141331b9bd4e None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:00.679525 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb621656-354e-4423-b5c3-141331b9bd4e None admin] PATH_INFO: `/v3/projects` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:00.680331 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb621656-354e-4423-b5c3-141331b9bd4e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:34:00.680682 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb621656-354e-4423-b5c3-141331b9bd4e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:34:00.682580 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb621656-354e-4423-b5c3-141331b9bd4e None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:34:00.704301 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 431/854] 10.222.0.26 () {56 vars in 1148 bytes} [Wed Aug 24 05:34:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:34:00.705171 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb621656-354e-4423-b5c3-141331b9bd4e None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:34:00.745544 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edb0b4e-077b-47fd-9d31-8ae2ec12d2ff None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:34:00.789327 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8c958f-2664-4c8f-a695-63beafc7d94e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:34:00.790671 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8c958f-2664-4c8f-a695-63beafc7d94e None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:00.791126 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8c958f-2664-4c8f-a695-63beafc7d94e None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:00.791549 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8c958f-2664-4c8f-a695-63beafc7d94e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:00.806994 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8c958f-2664-4c8f-a695-63beafc7d94e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:34:00.810574 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8c958f-2664-4c8f-a695-63beafc7d94e None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:34:00.821727 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb621656-354e-4423-b5c3-141331b9bd4e None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:34:00.827774 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application [None req-1a8c958f-2664-4c8f-a695-63beafc7d94e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:34:00.827774 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:34:00.827774 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:34:00.827774 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:34:00.827774 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:34:00.827774 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:34:00.827774 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:34:00.827774 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:34:00.827774 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:34:00.827774 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:34:00.827774 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:34:00.827774 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:34:00.827774 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 05:34:00.827774 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 05:34:00.827774 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 05:34:00.827774 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 05:34:00.828701 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:34:00.828701 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:34:00.828701 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:34:00.828701 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:34:00.828701 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:34:00.828701 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:34:00.828701 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:34:00.828701 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application with Lock( Aug 24 05:34:00.828701 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:34:00.828701 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:34:00.828701 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:34:00.828701 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:34:00.828701 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:34:00.828701 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:34:00.828701 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:34:00.828701 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:34:00.828701 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 05:34:00.829580 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 05:34:00.829580 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:34:00.829580 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Aug 24 05:34:00.834014 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 424/855] 10.222.0.26 () {56 vars in 1108 bytes} [Wed Aug 24 05:34:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:34:00.834713 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8c958f-2664-4c8f-a695-63beafc7d94e None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:34:00.870688 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf287ef7-cdbc-489b-83ab-70971ba3154a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:34:00.872701 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf287ef7-cdbc-489b-83ab-70971ba3154a None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:00.873198 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf287ef7-cdbc-489b-83ab-70971ba3154a None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:00.873664 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf287ef7-cdbc-489b-83ab-70971ba3154a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:00.874653 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf287ef7-cdbc-489b-83ab-70971ba3154a None admin] RBAC: Adding query filter params (role.id=640bda0879494e60b72680ee505285f0, scope.project.id=ded4fe81d4dc43188dd84e53025ee783, user.id=87ff96222a7c4baea31fc1bebf4d89a9) {{(pid=88113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:34:00.875186 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf287ef7-cdbc-489b-83ab-70971ba3154a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:34:00.876836 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf287ef7-cdbc-489b-83ab-70971ba3154a None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:34:00.886192 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 432/856] 10.222.0.26 () {56 vars in 1374 bytes} [Wed Aug 24 05:34:00 2022] GET /identity/v3/role_assignments?user.id=87ff96222a7c4baea31fc1bebf4d89a9&scope.project.id=ded4fe81d4dc43188dd84e53025ee783&role.id=640bda0879494e60b72680ee505285f0 => generated 608 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:34:00.890708 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55157f8-cd1f-4721-8a95-3ed6403f69ef None None] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:00.891111 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55157f8-cd1f-4721-8a95-3ed6403f69ef None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:00.891614 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55157f8-cd1f-4721-8a95-3ed6403f69ef None None] PATH_INFO: `/` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:00.893223 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 433/857] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 24 05:34:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 05:34:00.899277 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c64337-6d26-4209-8e45-4930225720a0 None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:00.899710 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c64337-6d26-4209-8e45-4930225720a0 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:00.900128 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c64337-6d26-4209-8e45-4930225720a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:00.922609 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-f1c64337-6d26-4209-8e45-4930225720a0 None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:34:00.923626 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-f1c64337-6d26-4209-8e45-4930225720a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:34:00.926244 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:34:00.963160 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:34:00.970790 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8c958f-2664-4c8f-a695-63beafc7d94e None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:34:01.012348 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac19d7a-3ab3-484a-b1bc-1adf90209285 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:34:01.013074 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac19d7a-3ab3-484a-b1bc-1adf90209285 None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:01.013448 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac19d7a-3ab3-484a-b1bc-1adf90209285 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:01.013859 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac19d7a-3ab3-484a-b1bc-1adf90209285 None admin] PATH_INFO: `/v3/domains` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:01.014742 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac19d7a-3ab3-484a-b1bc-1adf90209285 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:34:01.015184 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac19d7a-3ab3-484a-b1bc-1adf90209285 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:34:01.016488 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 434/858] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 24 05:34:00 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 05:34:01.018564 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac19d7a-3ab3-484a-b1bc-1adf90209285 None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:34:01.032785 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 425/859] 10.222.0.26 () {56 vars in 1109 bytes} [Wed Aug 24 05:34:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:34:01.040102 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c64337-6d26-4209-8e45-4930225720a0 None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:34:01.141338 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c64337-6d26-4209-8e45-4930225720a0 None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:34:01.176347 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13ab65a-fdda-417f-9c63-2d9a1c3dabf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:34:01.177195 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13ab65a-fdda-417f-9c63-2d9a1c3dabf9 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:01.177617 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13ab65a-fdda-417f-9c63-2d9a1c3dabf9 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:01.178087 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13ab65a-fdda-417f-9c63-2d9a1c3dabf9 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:01.185529 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13ab65a-fdda-417f-9c63-2d9a1c3dabf9 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:34:01.187160 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13ab65a-fdda-417f-9c63-2d9a1c3dabf9 None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:34:01.189070 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:34:01.200955 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application [None req-d13ab65a-fdda-417f-9c63-2d9a1c3dabf9 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 05:34:01.200955 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:34:01.200955 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:34:01.200955 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:34:01.200955 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:34:01.200955 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:34:01.200955 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:34:01.200955 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:34:01.200955 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:34:01.200955 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:34:01.200955 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:34:01.200955 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:34:01.200955 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 05:34:01.200955 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 05:34:01.200955 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 05:34:01.200955 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 05:34:01.201924 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:34:01.201924 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:34:01.201924 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 05:34:01.201924 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 05:34:01.201924 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 05:34:01.201924 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 05:34:01.201924 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:34:01.201924 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:34:01.201924 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:34:01.201924 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:34:01.201924 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:34:01.201924 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application with Lock( Aug 24 05:34:01.201924 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:34:01.201924 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:34:01.201924 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:34:01.201924 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:34:01.201924 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:34:01.201924 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:34:01.203397 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:34:01.203397 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:34:01.203397 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 05:34:01.203397 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 05:34:01.203397 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 05:34:01.203397 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 05:34:01.203397 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 05:34:01.203397 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 05:34:01.203397 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 05:34:01.203397 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Aug 24 05:34:01.203397 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 435/860] 10.222.0.26 () {56 vars in 1117 bytes} [Wed Aug 24 05:34:01 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:34:01.210447 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac19d7a-3ab3-484a-b1bc-1adf90209285 None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:34:01.294102 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13ab65a-fdda-417f-9c63-2d9a1c3dabf9 None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:34:01.317528 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac19d7a-3ab3-484a-b1bc-1adf90209285 None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:34:01.353407 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118c7b6e-c4f8-4797-9080-e3e63a12fd0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:34:01.353768 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118c7b6e-c4f8-4797-9080-e3e63a12fd0a None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:01.353988 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118c7b6e-c4f8-4797-9080-e3e63a12fd0a None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:01.354222 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118c7b6e-c4f8-4797-9080-e3e63a12fd0a None admin] PATH_INFO: `/v3/users` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:01.354947 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118c7b6e-c4f8-4797-9080-e3e63a12fd0a None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=88112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:34:01.355249 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118c7b6e-c4f8-4797-9080-e3e63a12fd0a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:34:01.356740 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118c7b6e-c4f8-4797-9080-e3e63a12fd0a None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:34:01.379109 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 426/861] 10.222.0.26 () {56 vars in 1149 bytes} [Wed Aug 24 05:34:01 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:34:01.380958 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118c7b6e-c4f8-4797-9080-e3e63a12fd0a None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:34:01.406370 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:34:01.415678 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13ab65a-fdda-417f-9c63-2d9a1c3dabf9 None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:34:01.465678 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daa573d-215a-4500-82eb-307108370bab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:34:01.466332 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daa573d-215a-4500-82eb-307108370bab None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:01.466606 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daa573d-215a-4500-82eb-307108370bab None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:01.466873 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daa573d-215a-4500-82eb-307108370bab None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:01.467450 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3daa573d-215a-4500-82eb-307108370bab None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:34:01.469375 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3daa573d-215a-4500-82eb-307108370bab None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:34:01.482437 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application [None req-3daa573d-215a-4500-82eb-307108370bab None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 05:34:01.482437 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:34:01.482437 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 05:34:01.482437 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 05:34:01.482437 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 05:34:01.482437 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 05:34:01.482437 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 05:34:01.482437 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 05:34:01.482437 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 05:34:01.482437 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Aug 24 05:34:01.482437 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 05:34:01.482437 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Aug 24 05:34:01.482437 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:34:01.482437 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:34:01.482437 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:34:01.482437 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:34:01.483455 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:34:01.483455 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:34:01.483455 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:34:01.483455 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:34:01.483455 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:34:01.483455 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:34:01.483455 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:34:01.483455 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 05:34:01.483455 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 05:34:01.483455 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 05:34:01.483455 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 05:34:01.483455 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:34:01.483455 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:34:01.483455 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:34:01.483455 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:34:01.483455 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:34:01.483455 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:34:01.484408 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:34:01.484408 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application with Lock( Aug 24 05:34:01.484408 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:34:01.484408 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:34:01.484408 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:34:01.484408 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:34:01.484408 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:34:01.484408 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:34:01.484408 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:34:01.484408 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:34:01.484408 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 05:34:01.484408 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 05:34:01.484408 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 05:34:01.484408 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Aug 24 05:34:01.487752 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 436/862] 10.222.0.26 () {56 vars in 1132 bytes} [Wed Aug 24 05:34:01 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:34:01.493111 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daa573d-215a-4500-82eb-307108370bab None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:34:01.520659 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118c7b6e-c4f8-4797-9080-e3e63a12fd0a None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:34:01.557665 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10fabca-7490-4a9d-b9e8-c6809d352572 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:34:01.558656 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10fabca-7490-4a9d-b9e8-c6809d352572 None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:01.559138 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10fabca-7490-4a9d-b9e8-c6809d352572 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:01.559622 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10fabca-7490-4a9d-b9e8-c6809d352572 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:01.575284 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:34:01.628112 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daa573d-215a-4500-82eb-307108370bab None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:34:01.641243 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10fabca-7490-4a9d-b9e8-c6809d352572 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:34:01.643031 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10fabca-7490-4a9d-b9e8-c6809d352572 None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:34:01.664067 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee1c4bf-2ffa-4a9b-9496-98809c7a447a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:34:01.665040 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee1c4bf-2ffa-4a9b-9496-98809c7a447a None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:01.665149 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:34:01.665610 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee1c4bf-2ffa-4a9b-9496-98809c7a447a None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:01.666128 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee1c4bf-2ffa-4a9b-9496-98809c7a447a None admin] PATH_INFO: `/v3/services` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:01.667218 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee1c4bf-2ffa-4a9b-9496-98809c7a447a None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=88113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:34:01.667813 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee1c4bf-2ffa-4a9b-9496-98809c7a447a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:34:01.669746 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee1c4bf-2ffa-4a9b-9496-98809c7a447a None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:34:01.675212 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 437/863] 10.222.0.26 () {56 vars in 1126 bytes} [Wed Aug 24 05:34:01 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:34:01.680449 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee1c4bf-2ffa-4a9b-9496-98809c7a447a None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:34:01.766233 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 427/864] 10.222.0.26 () {58 vars in 1282 bytes} [Wed Aug 24 05:34:01 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 05:34:01.778965 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10fabca-7490-4a9d-b9e8-c6809d352572 None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:34:01.814979 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee1c4bf-2ffa-4a9b-9496-98809c7a447a None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:34:01.846654 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:34:01.856374 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e68049c-a66a-4fc9-aaf7-faaecfe70895 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:34:01.857046 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e68049c-a66a-4fc9-aaf7-faaecfe70895 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:01.857330 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e68049c-a66a-4fc9-aaf7-faaecfe70895 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:01.857607 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e68049c-a66a-4fc9-aaf7-faaecfe70895 None admin] PATH_INFO: `/v3/services` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:01.858343 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e68049c-a66a-4fc9-aaf7-faaecfe70895 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=88113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:34:01.858647 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e68049c-a66a-4fc9-aaf7-faaecfe70895 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:34:01.860549 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e68049c-a66a-4fc9-aaf7-faaecfe70895 None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:34:01.865226 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 438/865] 10.222.0.26 () {56 vars in 1126 bytes} [Wed Aug 24 05:34:01 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:34:01.866408 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cde490b-a7e4-41f9-85dc-9ecae800eea4 None None] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:01.866694 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cde490b-a7e4-41f9-85dc-9ecae800eea4 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:01.866966 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cde490b-a7e4-41f9-85dc-9ecae800eea4 None None] PATH_INFO: `/` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:01.870003 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 439/866] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 24 05:34:01 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:34:01.874070 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbc6f83-4e3f-4ad1-b2dc-829c047efedb None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:01.875146 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbc6f83-4e3f-4ad1-b2dc-829c047efedb None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:01.875574 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbc6f83-4e3f-4ad1-b2dc-829c047efedb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:01.896437 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-3fbc6f83-4e3f-4ad1-b2dc-829c047efedb None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:34:01.897911 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-3fbc6f83-4e3f-4ad1-b2dc-829c047efedb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:34:01.918258 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10fabca-7490-4a9d-b9e8-c6809d352572 None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:34:01.944981 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:34:01.969581 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d459eb-6192-4620-a999-2f1013b4d4a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:34:01.970428 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d459eb-6192-4620-a999-2f1013b4d4a7 None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:01.970800 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d459eb-6192-4620-a999-2f1013b4d4a7 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:01.971184 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d459eb-6192-4620-a999-2f1013b4d4a7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:01.984514 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 440/867] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 24 05:34:01 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 05:34:01.991327 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d459eb-6192-4620-a999-2f1013b4d4a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:34:01.993125 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d459eb-6192-4620-a999-2f1013b4d4a7 None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:34:02.010426 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application [None req-b3d459eb-6192-4620-a999-2f1013b4d4a7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:34:02.010426 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:34:02.010426 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:34:02.010426 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:34:02.010426 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:34:02.010426 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:34:02.010426 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:34:02.010426 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:34:02.010426 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:34:02.010426 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:34:02.010426 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:34:02.010426 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:34:02.010426 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 05:34:02.010426 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 05:34:02.010426 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 05:34:02.010426 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 05:34:02.011448 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:34:02.011448 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:34:02.011448 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:34:02.011448 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:34:02.011448 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:34:02.011448 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:34:02.011448 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:34:02.011448 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application with Lock( Aug 24 05:34:02.011448 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:34:02.011448 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:34:02.011448 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:34:02.011448 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:34:02.011448 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:34:02.011448 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:34:02.011448 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:34:02.011448 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:34:02.011448 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 05:34:02.012334 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 05:34:02.012334 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:34:02.012334 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Aug 24 05:34:02.014155 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 428/868] 10.222.0.26 () {56 vars in 1108 bytes} [Wed Aug 24 05:34:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:34:02.020004 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbc6f83-4e3f-4ad1-b2dc-829c047efedb None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:34:02.132763 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbc6f83-4e3f-4ad1-b2dc-829c047efedb None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:34:02.153851 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:34:02.168985 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53310ac7-0245-49c5-991f-e9cba07628b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:34:02.169911 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53310ac7-0245-49c5-991f-e9cba07628b6 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:02.170428 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53310ac7-0245-49c5-991f-e9cba07628b6 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:02.170899 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53310ac7-0245-49c5-991f-e9cba07628b6 None admin] PATH_INFO: `/v3/domains` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:02.172312 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53310ac7-0245-49c5-991f-e9cba07628b6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:34:02.172857 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53310ac7-0245-49c5-991f-e9cba07628b6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:34:02.174463 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53310ac7-0245-49c5-991f-e9cba07628b6 None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:34:02.186796 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 441/869] 10.222.0.26 () {56 vars in 1109 bytes} [Wed Aug 24 05:34:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:34:02.195381 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d459eb-6192-4620-a999-2f1013b4d4a7 None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:34:02.254489 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53310ac7-0245-49c5-991f-e9cba07628b6 None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:34:02.304939 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d459eb-6192-4620-a999-2f1013b4d4a7 None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:34:02.348726 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdec9f7b-eaf9-4aae-b0fa-d989886539eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:34:02.349738 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdec9f7b-eaf9-4aae-b0fa-d989886539eb None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:02.350050 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdec9f7b-eaf9-4aae-b0fa-d989886539eb None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:02.350325 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdec9f7b-eaf9-4aae-b0fa-d989886539eb None admin] PATH_INFO: `/v3/projects/service` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:02.358519 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdec9f7b-eaf9-4aae-b0fa-d989886539eb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:34:02.361014 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdec9f7b-eaf9-4aae-b0fa-d989886539eb None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:34:02.370154 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53310ac7-0245-49c5-991f-e9cba07628b6 None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:34:02.375312 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application [None req-bdec9f7b-eaf9-4aae-b0fa-d989886539eb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 05:34:02.375312 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:34:02.375312 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:34:02.375312 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:34:02.375312 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:34:02.375312 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:34:02.375312 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:34:02.375312 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:34:02.375312 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:34:02.375312 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:34:02.375312 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:34:02.375312 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:34:02.375312 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 05:34:02.375312 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 05:34:02.375312 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 05:34:02.376211 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 05:34:02.376211 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:34:02.376211 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:34:02.376211 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:34:02.376211 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:34:02.376211 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:34:02.376211 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:34:02.376211 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:34:02.376211 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application with Lock( Aug 24 05:34:02.376211 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:34:02.376211 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:34:02.376211 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:34:02.376211 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:34:02.376211 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:34:02.376211 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:34:02.376211 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:34:02.376211 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:34:02.377159 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 05:34:02.377159 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 05:34:02.377159 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 05:34:02.377159 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 05:34:02.377159 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 05:34:02.377159 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 05:34:02.377159 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 05:34:02.377159 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Aug 24 05:34:02.381656 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 429/870] 10.222.0.26 () {56 vars in 1111 bytes} [Wed Aug 24 05:34:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:34:02.382560 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdec9f7b-eaf9-4aae-b0fa-d989886539eb None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:34:02.411021 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d09c9ac-595e-476c-8532-99c0b892dc9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:34:02.411956 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d09c9ac-595e-476c-8532-99c0b892dc9d None admin] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:02.412492 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d09c9ac-595e-476c-8532-99c0b892dc9d None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:02.413019 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d09c9ac-595e-476c-8532-99c0b892dc9d None admin] PATH_INFO: `/v3/services` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:02.414092 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d09c9ac-595e-476c-8532-99c0b892dc9d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:34:02.415910 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d09c9ac-595e-476c-8532-99c0b892dc9d None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:34:02.416723 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:34:02.435751 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 442/871] 10.222.0.26 () {60 vars in 1141 bytes} [Wed Aug 24 05:34:02 2022] POST /identity/v3/services => generated 251 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 05:34:02.505100 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdec9f7b-eaf9-4aae-b0fa-d989886539eb None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:34:02.552265 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944420e9-be14-4ee1-a2a7-32fe9f9a45d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:34:02.552954 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944420e9-be14-4ee1-a2a7-32fe9f9a45d7 None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:02.553233 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944420e9-be14-4ee1-a2a7-32fe9f9a45d7 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:02.553502 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944420e9-be14-4ee1-a2a7-32fe9f9a45d7 None admin] PATH_INFO: `/v3/projects` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:02.554390 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944420e9-be14-4ee1-a2a7-32fe9f9a45d7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:34:02.554703 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944420e9-be14-4ee1-a2a7-32fe9f9a45d7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:34:02.556236 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944420e9-be14-4ee1-a2a7-32fe9f9a45d7 None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:34:02.570973 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 430/872] 10.222.0.26 () {56 vars in 1148 bytes} [Wed Aug 24 05:34:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:34:02.579176 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d09c9ac-595e-476c-8532-99c0b892dc9d None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:34:02.625921 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:34:02.688383 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d09c9ac-595e-476c-8532-99c0b892dc9d None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:34:02.724390 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd732bb1-c41c-4fc3-b5f6-a719414fd01e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:34:02.725001 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd732bb1-c41c-4fc3-b5f6-a719414fd01e None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:02.725279 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd732bb1-c41c-4fc3-b5f6-a719414fd01e None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:02.725554 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd732bb1-c41c-4fc3-b5f6-a719414fd01e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:02.726312 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd732bb1-c41c-4fc3-b5f6-a719414fd01e None admin] RBAC: Adding query filter params (role.id=59fa3749ca7f47e2ba1127945e13336c, scope.project.id=ded4fe81d4dc43188dd84e53025ee783, user.id=6c2c08b27a0f4943b5da908eb7b1cd96) {{(pid=88113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:34:02.726619 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd732bb1-c41c-4fc3-b5f6-a719414fd01e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:34:02.728123 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd732bb1-c41c-4fc3-b5f6-a719414fd01e None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:34:02.734362 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 443/873] 10.222.0.26 () {56 vars in 1374 bytes} [Wed Aug 24 05:34:02 2022] GET /identity/v3/role_assignments?user.id=6c2c08b27a0f4943b5da908eb7b1cd96&scope.project.id=ded4fe81d4dc43188dd84e53025ee783&role.id=59fa3749ca7f47e2ba1127945e13336c => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:34:02.948207 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e1e873-4f71-4f3f-8d1d-485232ef2011 None None] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:02.948609 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e1e873-4f71-4f3f-8d1d-485232ef2011 None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:02.948823 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e1e873-4f71-4f3f-8d1d-485232ef2011 None None] PATH_INFO: `/` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:02.950481 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 431/874] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 24 05:34:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:34:02.956724 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c9d649-0413-4c62-8d1d-6909384b9498 None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:02.957015 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c9d649-0413-4c62-8d1d-6909384b9498 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:02.957289 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c9d649-0413-4c62-8d1d-6909384b9498 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:02.977316 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-b2c9d649-0413-4c62-8d1d-6909384b9498 None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:34:02.978566 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-b2c9d649-0413-4c62-8d1d-6909384b9498 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:34:03.051291 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 444/875] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 24 05:34:02 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 05:34:03.315621 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e1e873-4f71-4f3f-8d1d-485232ef2011 None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:34:03.405232 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:34:03.424073 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e1e873-4f71-4f3f-8d1d-485232ef2011 None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:34:03.459788 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b159c5fc-6047-4a02-9a5e-03d30bbc2f5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:34:03.460425 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b159c5fc-6047-4a02-9a5e-03d30bbc2f5e None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:03.460702 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b159c5fc-6047-4a02-9a5e-03d30bbc2f5e None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:03.460971 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b159c5fc-6047-4a02-9a5e-03d30bbc2f5e None admin] PATH_INFO: `/v3/services/object-store` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:03.461555 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b159c5fc-6047-4a02-9a5e-03d30bbc2f5e None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:34:03.462936 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b159c5fc-6047-4a02-9a5e-03d30bbc2f5e None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:34:03.471678 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application [None req-b159c5fc-6047-4a02-9a5e-03d30bbc2f5e None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 05:34:03.471678 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:34:03.471678 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 05:34:03.471678 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 05:34:03.471678 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 05:34:03.471678 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 05:34:03.471678 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 05:34:03.471678 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 05:34:03.471678 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 05:34:03.471678 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Aug 24 05:34:03.471678 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 05:34:03.471678 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Aug 24 05:34:03.471678 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:34:03.471678 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:34:03.471678 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:34:03.471678 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:34:03.471678 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:34:03.472660 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:34:03.472660 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:34:03.472660 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:34:03.472660 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:34:03.472660 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:34:03.472660 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:34:03.472660 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 05:34:03.472660 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 05:34:03.472660 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 05:34:03.472660 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 05:34:03.472660 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:34:03.472660 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:34:03.472660 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:34:03.472660 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:34:03.472660 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:34:03.472660 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:34:03.473485 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:34:03.473485 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application with Lock( Aug 24 05:34:03.473485 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:34:03.473485 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:34:03.473485 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:34:03.473485 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:34:03.473485 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:34:03.473485 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:34:03.473485 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:34:03.473485 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:34:03.473485 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 05:34:03.473485 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 05:34:03.473485 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 05:34:03.473485 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Aug 24 05:34:03.473485 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 432/876] 10.222.0.26 () {56 vars in 1126 bytes} [Wed Aug 24 05:34:03 2022] GET /identity/v3/services/object-store => generated 93 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:34:03.478926 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c9d649-0413-4c62-8d1d-6909384b9498 None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:34:03.515104 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:34:03.587731 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c9d649-0413-4c62-8d1d-6909384b9498 None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:34:03.623558 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e29878-da52-4960-8b6c-46e90ec061ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:34:03.625041 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e29878-da52-4960-8b6c-46e90ec061ac None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:03.625509 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e29878-da52-4960-8b6c-46e90ec061ac None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:03.625973 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e29878-da52-4960-8b6c-46e90ec061ac None admin] PATH_INFO: `/v3/services` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:03.626776 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e29878-da52-4960-8b6c-46e90ec061ac None admin] RBAC: Adding query filter params (name=object-store) {{(pid=88113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:34:03.627252 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e29878-da52-4960-8b6c-46e90ec061ac None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:34:03.628808 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e29878-da52-4960-8b6c-46e90ec061ac None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:34:03.634243 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 445/877] 10.222.0.26 () {56 vars in 1122 bytes} [Wed Aug 24 05:34:03 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:34:03.640164 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b159c5fc-6047-4a02-9a5e-03d30bbc2f5e None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:34:03.745604 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b159c5fc-6047-4a02-9a5e-03d30bbc2f5e None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:34:03.780186 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c734e31-e33f-4015-9842-3467817f1a13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:34:03.781683 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c734e31-e33f-4015-9842-3467817f1a13 None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:03.782171 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c734e31-e33f-4015-9842-3467817f1a13 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:03.782615 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c734e31-e33f-4015-9842-3467817f1a13 None admin] PATH_INFO: `/v3/services` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:03.783417 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c734e31-e33f-4015-9842-3467817f1a13 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=88112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:34:03.783914 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c734e31-e33f-4015-9842-3467817f1a13 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:34:03.785443 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c734e31-e33f-4015-9842-3467817f1a13 None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:34:03.790635 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 433/878] 10.222.0.26 () {56 vars in 1122 bytes} [Wed Aug 24 05:34:03 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:34:03.883586 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01440a7-2456-4aeb-9008-12857623e874 None None] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:03.883836 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01440a7-2456-4aeb-9008-12857623e874 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:03.884060 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01440a7-2456-4aeb-9008-12857623e874 None None] PATH_INFO: `/` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:03.885758 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 446/879] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 24 05:34:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:34:03.891838 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b60a40e-4cfd-4349-b119-c5e40cd3110a None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:03.892108 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b60a40e-4cfd-4349-b119-c5e40cd3110a None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:03.892379 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b60a40e-4cfd-4349-b119-c5e40cd3110a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:03.912583 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-0b60a40e-4cfd-4349-b119-c5e40cd3110a None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:34:03.913784 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-0b60a40e-4cfd-4349-b119-c5e40cd3110a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:34:03.923285 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:34:03.994093 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 434/880] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 24 05:34:03 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 05:34:04.258198 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01440a7-2456-4aeb-9008-12857623e874 None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:34:04.358170 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:34:04.362835 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01440a7-2456-4aeb-9008-12857623e874 None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:34:04.402123 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada7c5bd-4cd3-4fdc-9edf-5c0a7ec97bb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:34:04.402731 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada7c5bd-4cd3-4fdc-9edf-5c0a7ec97bb9 None admin] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:04.403012 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada7c5bd-4cd3-4fdc-9edf-5c0a7ec97bb9 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:04.403284 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada7c5bd-4cd3-4fdc-9edf-5c0a7ec97bb9 None admin] PATH_INFO: `/v3/services` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:04.403994 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada7c5bd-4cd3-4fdc-9edf-5c0a7ec97bb9 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:34:04.405361 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada7c5bd-4cd3-4fdc-9edf-5c0a7ec97bb9 None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:34:04.426412 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 447/881] 10.222.0.26 () {60 vars in 1141 bytes} [Wed Aug 24 05:34:04 2022] POST /identity/v3/services => generated 269 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:34:04.593527 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d9ecda-614c-4c38-9039-a48aadef13da None None] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:04.594082 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d9ecda-614c-4c38-9039-a48aadef13da None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:04.594178 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d9ecda-614c-4c38-9039-a48aadef13da None None] PATH_INFO: `/` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:04.595745 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 435/882] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 24 05:34:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:34:04.601046 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069385e5-55de-4559-9844-9498dce8cefe None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:04.601337 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069385e5-55de-4559-9844-9498dce8cefe None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:04.601608 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069385e5-55de-4559-9844-9498dce8cefe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:04.620727 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-069385e5-55de-4559-9844-9498dce8cefe None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:34:04.622254 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-069385e5-55de-4559-9844-9498dce8cefe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:34:04.701732 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 448/883] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 24 05:34:04 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 05:34:04.737034 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cae3bd-e7d5-478d-8494-f1d92681f527 None None] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:04.737338 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cae3bd-e7d5-478d-8494-f1d92681f527 None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:04.737583 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cae3bd-e7d5-478d-8494-f1d92681f527 None None] PATH_INFO: `/` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:04.739198 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 436/884] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 24 05:34:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:34:04.744319 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c773c3-0298-40bb-9a37-46b4226024ea None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:04.744616 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c773c3-0298-40bb-9a37-46b4226024ea None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:04.744891 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c773c3-0298-40bb-9a37-46b4226024ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:04.763351 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-e6c773c3-0298-40bb-9a37-46b4226024ea None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:34:04.764541 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-e6c773c3-0298-40bb-9a37-46b4226024ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:34:04.833369 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 449/885] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 24 05:34:04 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 05:34:04.982755 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cae3bd-e7d5-478d-8494-f1d92681f527 None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:34:05.091024 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cae3bd-e7d5-478d-8494-f1d92681f527 None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:34:05.102593 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c773c3-0298-40bb-9a37-46b4226024ea None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:34:05.118949 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:34:05.133428 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a708b1c-7316-48e7-82f4-9f3fa478ece2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:34:05.134345 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a708b1c-7316-48e7-82f4-9f3fa478ece2 None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:05.134626 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a708b1c-7316-48e7-82f4-9f3fa478ece2 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:05.134896 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a708b1c-7316-48e7-82f4-9f3fa478ece2 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:05.135735 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a708b1c-7316-48e7-82f4-9f3fa478ece2 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:34:05.137794 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a708b1c-7316-48e7-82f4-9f3fa478ece2 None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:34:05.148053 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application [None req-6a708b1c-7316-48e7-82f4-9f3fa478ece2 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 05:34:05.148053 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:34:05.148053 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 05:34:05.148053 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 05:34:05.148053 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 05:34:05.148053 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 05:34:05.148053 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 05:34:05.148053 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 05:34:05.148053 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 05:34:05.148053 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Aug 24 05:34:05.148053 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 05:34:05.148053 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Aug 24 05:34:05.148053 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:34:05.148053 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:34:05.148053 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:34:05.148053 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:34:05.148053 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:34:05.149265 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:34:05.149265 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:34:05.149265 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:34:05.149265 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:34:05.149265 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:34:05.149265 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:34:05.149265 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 05:34:05.149265 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 05:34:05.149265 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 05:34:05.149265 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 05:34:05.149265 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:34:05.149265 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:34:05.149265 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:34:05.149265 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:34:05.149265 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:34:05.149265 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:34:05.150213 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:34:05.150213 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application with Lock( Aug 24 05:34:05.150213 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:34:05.150213 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:34:05.150213 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:34:05.150213 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:34:05.150213 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:34:05.150213 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:34:05.150213 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:34:05.150213 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:34:05.150213 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 05:34:05.150213 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 05:34:05.150213 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 05:34:05.150213 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Aug 24 05:34:05.150213 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 437/886] 10.222.0.26 () {56 vars in 1114 bytes} [Wed Aug 24 05:34:04 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:34:05.157033 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a708b1c-7316-48e7-82f4-9f3fa478ece2 None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:34:05.169004 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:34:05.219269 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c773c3-0298-40bb-9a37-46b4226024ea None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:34:05.257429 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de7c197-a95a-4cf6-a7b8-5f61ad7411ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:34:05.258160 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de7c197-a95a-4cf6-a7b8-5f61ad7411ac None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:05.258444 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de7c197-a95a-4cf6-a7b8-5f61ad7411ac None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:05.259043 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de7c197-a95a-4cf6-a7b8-5f61ad7411ac None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:05.269963 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de7c197-a95a-4cf6-a7b8-5f61ad7411ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:34:05.272074 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a708b1c-7316-48e7-82f4-9f3fa478ece2 None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:34:05.274826 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application [None req-2de7c197-a95a-4cf6-a7b8-5f61ad7411ac None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 05:34:05.274826 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:34:05.274826 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:34:05.274826 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:34:05.274826 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:34:05.274826 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:34:05.274826 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:34:05.274826 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:34:05.274826 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:34:05.274826 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:34:05.274826 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:34:05.274826 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:34:05.274826 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:34:05.274826 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:34:05.274826 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:34:05.274826 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:34:05.276931 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:34:05.276931 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:34:05.276931 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:34:05.276931 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:34:05.276931 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:34:05.276931 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:34:05.276931 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:34:05.276931 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:34:05.276931 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:34:05.276931 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:34:05.276931 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:34:05.276931 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application with Lock( Aug 24 05:34:05.276931 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:34:05.276931 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:34:05.276931 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:34:05.276931 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:34:05.278979 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:34:05.278979 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:34:05.278979 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:34:05.278979 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:34:05.278979 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:34:05.278979 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:34:05.278979 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:34:05.278979 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:34:05.278979 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:34:05.278979 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:34:05.278979 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 05:34:05.278979 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Aug 24 05:34:05.278979 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 450/887] 10.222.0.26 () {56 vars in 1120 bytes} [Wed Aug 24 05:34:05 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:34:05.287945 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de7c197-a95a-4cf6-a7b8-5f61ad7411ac None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:34:05.312914 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5075c3a3-ca56-4d48-8069-3d7a9f284f26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:34:05.313529 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5075c3a3-ca56-4d48-8069-3d7a9f284f26 None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:05.313812 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5075c3a3-ca56-4d48-8069-3d7a9f284f26 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:05.314117 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5075c3a3-ca56-4d48-8069-3d7a9f284f26 None admin] PATH_INFO: `/v3/services` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:05.314753 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5075c3a3-ca56-4d48-8069-3d7a9f284f26 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=88112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:34:05.315055 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5075c3a3-ca56-4d48-8069-3d7a9f284f26 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:34:05.316420 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5075c3a3-ca56-4d48-8069-3d7a9f284f26 None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:34:05.325995 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 438/888] 10.222.0.26 () {56 vars in 1114 bytes} [Wed Aug 24 05:34:05 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:34:05.327425 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5075c3a3-ca56-4d48-8069-3d7a9f284f26 None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:34:05.384187 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:34:05.400948 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:34:05.419522 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de7c197-a95a-4cf6-a7b8-5f61ad7411ac None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:34:05.439061 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5075c3a3-ca56-4d48-8069-3d7a9f284f26 None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:34:05.463175 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bada5779-7223-49d7-8b22-20ee3506d39e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:34:05.464295 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bada5779-7223-49d7-8b22-20ee3506d39e None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:05.464983 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bada5779-7223-49d7-8b22-20ee3506d39e None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:05.465405 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bada5779-7223-49d7-8b22-20ee3506d39e None admin] PATH_INFO: `/v3/roles` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:05.467016 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bada5779-7223-49d7-8b22-20ee3506d39e None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=88113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:34:05.467470 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bada5779-7223-49d7-8b22-20ee3506d39e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:34:05.470481 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bada5779-7223-49d7-8b22-20ee3506d39e None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:34:05.477609 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24520297-1de9-4582-a482-ea9537949e2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:34:05.478545 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24520297-1de9-4582-a482-ea9537949e2c None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:05.479010 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24520297-1de9-4582-a482-ea9537949e2c None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:05.479431 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24520297-1de9-4582-a482-ea9537949e2c None admin] PATH_INFO: `/v3/services` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:05.480207 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24520297-1de9-4582-a482-ea9537949e2c None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=88112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:34:05.480655 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24520297-1de9-4582-a482-ea9537949e2c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:34:05.481065 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 451/889] 10.222.0.26 () {56 vars in 1115 bytes} [Wed Aug 24 05:34:05 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:34:05.482412 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24520297-1de9-4582-a482-ea9537949e2c None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:34:05.487728 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bada5779-7223-49d7-8b22-20ee3506d39e None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:34:05.490573 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 439/890] 10.222.0.26 () {56 vars in 1114 bytes} [Wed Aug 24 05:34:05 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:34:05.501341 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24520297-1de9-4582-a482-ea9537949e2c None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:34:05.623765 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24520297-1de9-4582-a482-ea9537949e2c None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:34:05.624595 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bada5779-7223-49d7-8b22-20ee3506d39e None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:34:05.662092 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c5cd7e-f301-40c3-9b3d-395ddc525d4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:34:05.663047 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c5cd7e-f301-40c3-9b3d-395ddc525d4f None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:05.663466 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c5cd7e-f301-40c3-9b3d-395ddc525d4f None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:05.664014 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c5cd7e-f301-40c3-9b3d-395ddc525d4f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:05.667563 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:34:05.670195 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5b5dc8-a795-43da-b1a9-ae718954aa9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:34:05.670809 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5b5dc8-a795-43da-b1a9-ae718954aa9f None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:05.671132 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5b5dc8-a795-43da-b1a9-ae718954aa9f None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:05.671550 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5b5dc8-a795-43da-b1a9-ae718954aa9f None admin] PATH_INFO: `/v3/endpoints` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:05.672260 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5b5dc8-a795-43da-b1a9-ae718954aa9f None admin] RBAC: Adding query filter params (interface=public, service_id=5909dcc5db4b4c5bb4a08d187c088f2e, region_id=RegionOne) {{(pid=88112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:34:05.672567 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5b5dc8-a795-43da-b1a9-ae718954aa9f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:34:05.673936 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5b5dc8-a795-43da-b1a9-ae718954aa9f None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:34:05.677141 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:34:05.679083 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c5cd7e-f301-40c3-9b3d-395ddc525d4f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:34:05.680878 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c5cd7e-f301-40c3-9b3d-395ddc525d4f None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:34:05.682421 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 440/891] 10.222.0.26 () {56 vars in 1251 bytes} [Wed Aug 24 05:34:05 2022] GET /identity/v3/endpoints?service_id=5909dcc5db4b4c5bb4a08d187c088f2e&interface=public®ion_id=RegionOne => generated 194 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:34:05.690850 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5b5dc8-a795-43da-b1a9-ae718954aa9f None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:34:05.699297 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application [None req-62c5cd7e-f301-40c3-9b3d-395ddc525d4f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:34:05.699297 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:34:05.699297 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:34:05.699297 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:34:05.699297 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:34:05.699297 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:34:05.699297 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:34:05.699297 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:34:05.699297 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:34:05.699297 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:34:05.699297 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:34:05.699297 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:34:05.699297 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 05:34:05.699297 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 05:34:05.699297 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 05:34:05.699297 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 05:34:05.700272 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:34:05.700272 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:34:05.700272 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:34:05.700272 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:34:05.700272 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:34:05.700272 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:34:05.700272 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:34:05.700272 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application with Lock( Aug 24 05:34:05.700272 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:34:05.700272 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:34:05.700272 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:34:05.700272 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:34:05.700272 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:34:05.700272 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:34:05.700272 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:34:05.700272 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:34:05.700272 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 05:34:05.701174 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 05:34:05.701174 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:34:05.701174 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Aug 24 05:34:05.708416 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 452/892] 10.222.0.26 () {56 vars in 1108 bytes} [Wed Aug 24 05:34:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 05:34:05.709996 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c5cd7e-f301-40c3-9b3d-395ddc525d4f None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:34:05.820804 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c5cd7e-f301-40c3-9b3d-395ddc525d4f None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:34:05.821921 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5b5dc8-a795-43da-b1a9-ae718954aa9f None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:34:05.860934 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b56c18-9357-4788-a410-32944f649330 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:34:05.861557 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b56c18-9357-4788-a410-32944f649330 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:05.861813 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b56c18-9357-4788-a410-32944f649330 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:05.862110 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b56c18-9357-4788-a410-32944f649330 None admin] PATH_INFO: `/v3/domains` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:05.862761 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b56c18-9357-4788-a410-32944f649330 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:34:05.863111 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b56c18-9357-4788-a410-32944f649330 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:34:05.864502 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b56c18-9357-4788-a410-32944f649330 None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:34:05.867520 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4db9398-bf70-40d3-a2fc-4125eb419e31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:34:05.868333 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4db9398-bf70-40d3-a2fc-4125eb419e31 None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:05.868820 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4db9398-bf70-40d3-a2fc-4125eb419e31 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:05.869272 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4db9398-bf70-40d3-a2fc-4125eb419e31 None admin] PATH_INFO: `/v3/services` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:05.870086 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4db9398-bf70-40d3-a2fc-4125eb419e31 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:34:05.871744 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4db9398-bf70-40d3-a2fc-4125eb419e31 None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:34:05.875981 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 453/893] 10.222.0.26 () {56 vars in 1109 bytes} [Wed Aug 24 05:34:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:34:05.881999 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3203d9b8-7dd8-4c56-b335-77f31067f1eb None None] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:05.882188 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3203d9b8-7dd8-4c56-b335-77f31067f1eb None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:05.882378 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3203d9b8-7dd8-4c56-b335-77f31067f1eb None None] PATH_INFO: `/` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:05.887815 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 454/894] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 24 05:34:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:34:05.887815 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3203d9b8-7dd8-4c56-b335-77f31067f1eb None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:34:05.888066 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 441/895] 10.222.0.26 () {56 vars in 1087 bytes} [Wed Aug 24 05:34:05 2022] GET /identity/v3/services => generated 1268 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:34:05.889529 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e7f819-646e-4321-b583-2539dece44db None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:05.890375 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e7f819-646e-4321-b583-2539dece44db None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:05.890650 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e7f819-646e-4321-b583-2539dece44db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:05.911547 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-c6e7f819-646e-4321-b583-2539dece44db None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:34:05.912872 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-c6e7f819-646e-4321-b583-2539dece44db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:34:05.951535 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:34:05.987333 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:34:06.002178 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 442/896] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 24 05:34:05 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 05:34:06.024474 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3203d9b8-7dd8-4c56-b335-77f31067f1eb None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:34:06.064141 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4302d0a0-a831-4e5c-8513-f33179d0ccfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:34:06.064767 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4302d0a0-a831-4e5c-8513-f33179d0ccfa None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:06.065044 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4302d0a0-a831-4e5c-8513-f33179d0ccfa None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:06.065310 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4302d0a0-a831-4e5c-8513-f33179d0ccfa None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:06.073003 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4302d0a0-a831-4e5c-8513-f33179d0ccfa None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:34:06.074484 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4302d0a0-a831-4e5c-8513-f33179d0ccfa None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:34:06.087433 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application [None req-4302d0a0-a831-4e5c-8513-f33179d0ccfa None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 05:34:06.087433 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:34:06.087433 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:34:06.087433 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:34:06.087433 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:34:06.087433 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:34:06.087433 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:34:06.087433 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:34:06.087433 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:34:06.087433 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:34:06.087433 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:34:06.087433 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:34:06.087433 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 05:34:06.087433 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 05:34:06.087433 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 05:34:06.087433 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 05:34:06.088378 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:34:06.088378 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:34:06.088378 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 05:34:06.088378 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 05:34:06.088378 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 05:34:06.088378 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 05:34:06.088378 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:34:06.088378 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:34:06.088378 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:34:06.088378 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:34:06.088378 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:34:06.088378 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application with Lock( Aug 24 05:34:06.088378 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:34:06.088378 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:34:06.088378 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:34:06.088378 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:34:06.088378 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:34:06.088378 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:34:06.089309 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:34:06.089309 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:34:06.089309 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 05:34:06.089309 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 05:34:06.089309 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 05:34:06.089309 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 05:34:06.089309 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 05:34:06.089309 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 05:34:06.089309 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 05:34:06.089309 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Aug 24 05:34:06.089309 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 455/897] 10.222.0.26 () {56 vars in 1117 bytes} [Wed Aug 24 05:34:05 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:34:06.096323 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e7f819-646e-4321-b583-2539dece44db None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:34:06.204588 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e7f819-646e-4321-b583-2539dece44db None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:34:06.239318 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4116f92-1158-400b-b400-edd377222cea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:34:06.239929 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4116f92-1158-400b-b400-edd377222cea None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:06.240212 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4116f92-1158-400b-b400-edd377222cea None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:06.240482 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4116f92-1158-400b-b400-edd377222cea None admin] PATH_INFO: `/v3/users` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:06.241213 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4116f92-1158-400b-b400-edd377222cea None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=88112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:34:06.241518 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4116f92-1158-400b-b400-edd377222cea None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:34:06.242970 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4116f92-1158-400b-b400-edd377222cea None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:34:06.261593 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 443/898] 10.222.0.26 () {56 vars in 1149 bytes} [Wed Aug 24 05:34:06 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:34:06.268098 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4302d0a0-a831-4e5c-8513-f33179d0ccfa None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:34:06.301143 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4116f92-1158-400b-b400-edd377222cea None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:34:06.355412 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:34:06.400169 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4302d0a0-a831-4e5c-8513-f33179d0ccfa None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:34:06.411956 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:34:06.414796 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4116f92-1158-400b-b400-edd377222cea None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:34:06.445187 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d094a1f9-cfc2-4e07-8e68-e7bd556dadbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:34:06.445794 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d094a1f9-cfc2-4e07-8e68-e7bd556dadbd None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:06.446135 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d094a1f9-cfc2-4e07-8e68-e7bd556dadbd None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:06.446410 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d094a1f9-cfc2-4e07-8e68-e7bd556dadbd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:06.453051 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4542f31f-abd9-4aec-a10d-a5b65bd2497a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:34:06.453657 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4542f31f-abd9-4aec-a10d-a5b65bd2497a None admin] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:06.454009 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4542f31f-abd9-4aec-a10d-a5b65bd2497a None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:06.454278 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4542f31f-abd9-4aec-a10d-a5b65bd2497a None admin] PATH_INFO: `/v3/services` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:06.454989 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4542f31f-abd9-4aec-a10d-a5b65bd2497a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:34:06.456281 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4542f31f-abd9-4aec-a10d-a5b65bd2497a None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:34:06.478004 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 444/899] 10.222.0.26 () {60 vars in 1141 bytes} [Wed Aug 24 05:34:06 2022] POST /identity/v3/services => generated 241 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 05:34:06.478004 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eba99b6-fcc4-4ed6-a8af-76debfe9926b None None] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:06.478004 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eba99b6-fcc4-4ed6-a8af-76debfe9926b None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:06.478004 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eba99b6-fcc4-4ed6-a8af-76debfe9926b None None] PATH_INFO: `/` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:06.478004 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 445/900] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 24 05:34:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:34:06.485165 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d480d3ce-a4b3-4e30-b784-24eb57b740c3 None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:06.485497 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d480d3ce-a4b3-4e30-b784-24eb57b740c3 None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:06.485772 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d480d3ce-a4b3-4e30-b784-24eb57b740c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:06.523828 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-d480d3ce-a4b3-4e30-b784-24eb57b740c3 None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:34:06.525058 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-d480d3ce-a4b3-4e30-b784-24eb57b740c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:34:06.543758 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d094a1f9-cfc2-4e07-8e68-e7bd556dadbd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:34:06.547125 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d094a1f9-cfc2-4e07-8e68-e7bd556dadbd None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:34:06.619526 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 446/901] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 24 05:34:06 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 05:34:06.665341 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 456/902] 10.222.0.26 () {58 vars in 1282 bytes} [Wed Aug 24 05:34:06 2022] GET /identity/v3/auth/tokens => generated 1372 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 05:34:06.666862 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d480d3ce-a4b3-4e30-b784-24eb57b740c3 None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:34:06.702714 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:34:06.776099 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d480d3ce-a4b3-4e30-b784-24eb57b740c3 None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:34:06.810598 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c08f84-3f46-4469-b9e8-39400c8b3da3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:34:06.812148 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c08f84-3f46-4469-b9e8-39400c8b3da3 None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:06.812638 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c08f84-3f46-4469-b9e8-39400c8b3da3 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:06.813107 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c08f84-3f46-4469-b9e8-39400c8b3da3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:06.824066 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c08f84-3f46-4469-b9e8-39400c8b3da3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:34:06.825774 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c08f84-3f46-4469-b9e8-39400c8b3da3 None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:34:06.840991 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application [None req-06c08f84-3f46-4469-b9e8-39400c8b3da3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:34:06.840991 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:34:06.840991 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:34:06.840991 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:34:06.840991 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:34:06.840991 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:34:06.840991 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:34:06.840991 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:34:06.840991 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:34:06.840991 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:34:06.840991 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:34:06.840991 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:34:06.840991 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 05:34:06.840991 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 05:34:06.840991 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 05:34:06.840991 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 05:34:06.841981 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:34:06.841981 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:34:06.841981 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:34:06.841981 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:34:06.841981 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:34:06.841981 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:34:06.841981 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:34:06.841981 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application with Lock( Aug 24 05:34:06.841981 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:34:06.841981 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:34:06.841981 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:34:06.841981 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:34:06.841981 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:34:06.841981 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:34:06.841981 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:34:06.841981 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:34:06.841981 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 05:34:06.843451 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 05:34:06.843451 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:34:06.843451 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Aug 24 05:34:06.845513 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 447/903] 10.222.0.26 () {56 vars in 1108 bytes} [Wed Aug 24 05:34:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:34:06.851089 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d094a1f9-cfc2-4e07-8e68-e7bd556dadbd None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:34:06.863077 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:34:06.899543 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c08f84-3f46-4469-b9e8-39400c8b3da3 None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:34:06.963564 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d094a1f9-cfc2-4e07-8e68-e7bd556dadbd None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:34:07.002432 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c11ae4e-a5f4-4dfc-b6e1-0ff225eb1f48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:34:07.003395 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c11ae4e-a5f4-4dfc-b6e1-0ff225eb1f48 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:07.003932 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c11ae4e-a5f4-4dfc-b6e1-0ff225eb1f48 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:07.004459 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c11ae4e-a5f4-4dfc-b6e1-0ff225eb1f48 None admin] PATH_INFO: `/v3/domains` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:07.005396 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c11ae4e-a5f4-4dfc-b6e1-0ff225eb1f48 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:34:07.005912 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c11ae4e-a5f4-4dfc-b6e1-0ff225eb1f48 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:34:07.007598 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c11ae4e-a5f4-4dfc-b6e1-0ff225eb1f48 None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:34:07.013257 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:34:07.024381 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 457/904] 10.222.0.26 () {56 vars in 1109 bytes} [Wed Aug 24 05:34:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:34:07.025816 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c08f84-3f46-4469-b9e8-39400c8b3da3 None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:34:07.030179 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c11ae4e-a5f4-4dfc-b6e1-0ff225eb1f48 None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:34:07.074247 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a26326c-f929-4635-af89-ae9dc1aa0871 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:34:07.075783 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a26326c-f929-4635-af89-ae9dc1aa0871 None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:07.076074 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a26326c-f929-4635-af89-ae9dc1aa0871 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:07.076351 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a26326c-f929-4635-af89-ae9dc1aa0871 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:07.076948 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a26326c-f929-4635-af89-ae9dc1aa0871 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:34:07.078423 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a26326c-f929-4635-af89-ae9dc1aa0871 None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:34:07.089977 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application [None req-2a26326c-f929-4635-af89-ae9dc1aa0871 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 05:34:07.089977 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:34:07.089977 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 05:34:07.089977 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 05:34:07.089977 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 05:34:07.089977 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 05:34:07.089977 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 05:34:07.089977 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 05:34:07.089977 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 05:34:07.089977 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Aug 24 05:34:07.089977 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 05:34:07.089977 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Aug 24 05:34:07.089977 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:34:07.089977 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:34:07.089977 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:34:07.089977 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:34:07.090909 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:34:07.090909 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:34:07.090909 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:34:07.090909 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:34:07.090909 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:34:07.090909 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:34:07.090909 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:34:07.090909 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 05:34:07.090909 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 05:34:07.090909 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 05:34:07.090909 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 05:34:07.090909 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:34:07.090909 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:34:07.090909 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:34:07.090909 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:34:07.090909 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:34:07.090909 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:34:07.091807 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:34:07.091807 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application with Lock( Aug 24 05:34:07.091807 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:34:07.091807 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:34:07.091807 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:34:07.091807 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:34:07.091807 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:34:07.091807 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:34:07.091807 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:34:07.091807 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:34:07.091807 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 05:34:07.091807 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 05:34:07.091807 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 05:34:07.091807 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Aug 24 05:34:07.096620 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 448/905] 10.222.0.26 () {56 vars in 1132 bytes} [Wed Aug 24 05:34:06 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 05:34:07.097918 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a26326c-f929-4635-af89-ae9dc1aa0871 None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:34:07.116931 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:34:07.153926 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c11ae4e-a5f4-4dfc-b6e1-0ff225eb1f48 None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:34:07.190367 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b6a906-6e31-4470-9adf-a2e31b6e2a0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:34:07.191105 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b6a906-6e31-4470-9adf-a2e31b6e2a0c None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:07.191704 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b6a906-6e31-4470-9adf-a2e31b6e2a0c None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:07.192045 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b6a906-6e31-4470-9adf-a2e31b6e2a0c None admin] PATH_INFO: `/v3/projects/service` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:07.199736 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b6a906-6e31-4470-9adf-a2e31b6e2a0c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:34:07.201174 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b6a906-6e31-4470-9adf-a2e31b6e2a0c None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:34:07.209538 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a26326c-f929-4635-af89-ae9dc1aa0871 None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:34:07.214035 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application [None req-71b6a906-6e31-4470-9adf-a2e31b6e2a0c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 05:34:07.214035 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:34:07.214035 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:34:07.214035 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:34:07.214035 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:34:07.214035 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:34:07.214035 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:34:07.214035 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:34:07.214035 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:34:07.214035 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:34:07.214035 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:34:07.214035 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:34:07.214035 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 05:34:07.214035 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 05:34:07.214035 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 05:34:07.214910 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 05:34:07.214910 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:34:07.214910 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:34:07.214910 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:34:07.214910 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:34:07.214910 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:34:07.214910 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:34:07.214910 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:34:07.214910 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application with Lock( Aug 24 05:34:07.214910 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:34:07.214910 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:34:07.214910 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:34:07.214910 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:34:07.214910 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:34:07.214910 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:34:07.214910 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:34:07.214910 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:34:07.215807 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 05:34:07.215807 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 05:34:07.215807 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 05:34:07.215807 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 05:34:07.215807 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 05:34:07.215807 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 05:34:07.215807 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 05:34:07.215807 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Aug 24 05:34:07.220056 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 458/906] 10.222.0.26 () {56 vars in 1111 bytes} [Wed Aug 24 05:34:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 05:34:07.221887 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b6a906-6e31-4470-9adf-a2e31b6e2a0c None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:34:07.249118 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c31c62f-affc-423d-92c6-8af011449422 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:34:07.250054 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c31c62f-affc-423d-92c6-8af011449422 None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:07.250556 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c31c62f-affc-423d-92c6-8af011449422 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:07.251080 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c31c62f-affc-423d-92c6-8af011449422 None admin] PATH_INFO: `/v3/services` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:07.252040 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c31c62f-affc-423d-92c6-8af011449422 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=88112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:34:07.252543 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c31c62f-affc-423d-92c6-8af011449422 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:34:07.254221 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c31c62f-affc-423d-92c6-8af011449422 None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:34:07.264153 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 449/907] 10.222.0.26 () {56 vars in 1126 bytes} [Wed Aug 24 05:34:07 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:34:07.265851 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c31c62f-affc-423d-92c6-8af011449422 None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:34:07.285775 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:34:07.332523 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b6a906-6e31-4470-9adf-a2e31b6e2a0c None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:34:07.360909 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:34:07.369524 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5713b7-2762-4671-b1d2-f6e6a3a3e681 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:34:07.370377 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5713b7-2762-4671-b1d2-f6e6a3a3e681 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:07.370562 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5713b7-2762-4671-b1d2-f6e6a3a3e681 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:07.370788 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5713b7-2762-4671-b1d2-f6e6a3a3e681 None admin] PATH_INFO: `/v3/projects` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:07.371483 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5713b7-2762-4671-b1d2-f6e6a3a3e681 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:34:07.371843 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5713b7-2762-4671-b1d2-f6e6a3a3e681 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:34:07.373365 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5713b7-2762-4671-b1d2-f6e6a3a3e681 None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:34:07.377427 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c31c62f-affc-423d-92c6-8af011449422 None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:34:07.391658 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 459/908] 10.222.0.26 () {56 vars in 1148 bytes} [Wed Aug 24 05:34:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:34:07.392966 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5713b7-2762-4671-b1d2-f6e6a3a3e681 None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:34:07.414762 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f7c858-cafe-4525-9076-10053a7005eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:34:07.415729 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f7c858-cafe-4525-9076-10053a7005eb None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:07.416212 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f7c858-cafe-4525-9076-10053a7005eb None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:07.416849 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f7c858-cafe-4525-9076-10053a7005eb None admin] PATH_INFO: `/v3/services` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:07.417676 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f7c858-cafe-4525-9076-10053a7005eb None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=88112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:34:07.418215 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f7c858-cafe-4525-9076-10053a7005eb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:34:07.419879 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f7c858-cafe-4525-9076-10053a7005eb None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:34:07.430212 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 450/909] 10.222.0.26 () {56 vars in 1126 bytes} [Wed Aug 24 05:34:07 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:34:07.431466 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f7c858-cafe-4525-9076-10053a7005eb None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:34:07.504962 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5713b7-2762-4671-b1d2-f6e6a3a3e681 None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:34:07.521780 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:34:07.543063 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f7c858-cafe-4525-9076-10053a7005eb None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:34:07.549794 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431f6e5d-6d04-4a3e-b7d3-5c829b1a6f02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:34:07.550439 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431f6e5d-6d04-4a3e-b7d3-5c829b1a6f02 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:07.550717 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431f6e5d-6d04-4a3e-b7d3-5c829b1a6f02 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:07.550983 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431f6e5d-6d04-4a3e-b7d3-5c829b1a6f02 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:07.551890 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431f6e5d-6d04-4a3e-b7d3-5c829b1a6f02 None admin] RBAC: Adding query filter params (role.id=bc599913e28e42089c8030b72de2de1f, scope.project.id=ded4fe81d4dc43188dd84e53025ee783, user.id=6c2c08b27a0f4943b5da908eb7b1cd96) {{(pid=88113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:34:07.552113 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431f6e5d-6d04-4a3e-b7d3-5c829b1a6f02 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:34:07.553595 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431f6e5d-6d04-4a3e-b7d3-5c829b1a6f02 None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:34:07.566173 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 460/910] 10.222.0.26 () {56 vars in 1374 bytes} [Wed Aug 24 05:34:07 2022] GET /identity/v3/role_assignments?user.id=6c2c08b27a0f4943b5da908eb7b1cd96&scope.project.id=ded4fe81d4dc43188dd84e53025ee783&role.id=bc599913e28e42089c8030b72de2de1f => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:34:07.584159 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e71b08b-428b-432a-bdc5-b2586b3b831c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:34:07.585166 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e71b08b-428b-432a-bdc5-b2586b3b831c None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:07.585677 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e71b08b-428b-432a-bdc5-b2586b3b831c None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:07.586198 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e71b08b-428b-432a-bdc5-b2586b3b831c None admin] PATH_INFO: `/v3/endpoints` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:07.587167 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e71b08b-428b-432a-bdc5-b2586b3b831c None admin] RBAC: Adding query filter params (interface=public, service_id=d8344fa2b6c64d5d9406d928667304de, region_id=RegionOne) {{(pid=88112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:34:07.587696 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e71b08b-428b-432a-bdc5-b2586b3b831c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:34:07.589325 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e71b08b-428b-432a-bdc5-b2586b3b831c None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:34:07.596524 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 451/911] 10.222.0.26 () {56 vars in 1251 bytes} [Wed Aug 24 05:34:07 2022] GET /identity/v3/endpoints?service_id=d8344fa2b6c64d5d9406d928667304de&interface=public®ion_id=RegionOne => generated 194 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:34:07.602499 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431f6e5d-6d04-4a3e-b7d3-5c829b1a6f02 None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:34:07.667041 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:34:07.719610 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431f6e5d-6d04-4a3e-b7d3-5c829b1a6f02 None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:34:07.755118 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1661dc-312d-46ab-aba9-02decd7c1da8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:34:07.755778 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1661dc-312d-46ab-aba9-02decd7c1da8 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:07.756056 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1661dc-312d-46ab-aba9-02decd7c1da8 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:07.756321 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1661dc-312d-46ab-aba9-02decd7c1da8 None admin] PATH_INFO: `/v3/services` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:07.757010 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1661dc-312d-46ab-aba9-02decd7c1da8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:34:07.758464 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1661dc-312d-46ab-aba9-02decd7c1da8 None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:34:07.765428 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 461/912] 10.222.0.26 () {56 vars in 1087 bytes} [Wed Aug 24 05:34:07 2022] GET /identity/v3/services => generated 1497 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:34:07.899598 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde2865d-6f85-42c9-92aa-d2fc17e4f52f None None] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:07.900085 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde2865d-6f85-42c9-92aa-d2fc17e4f52f None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:07.900085 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde2865d-6f85-42c9-92aa-d2fc17e4f52f None None] PATH_INFO: `/` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:07.901516 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 452/913] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 24 05:34:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:34:07.907671 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a51b8b-a757-45db-9738-e9f7fbe0bc6e None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:07.907962 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a51b8b-a757-45db-9738-e9f7fbe0bc6e None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:07.908236 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a51b8b-a757-45db-9738-e9f7fbe0bc6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:07.927233 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-73a51b8b-a757-45db-9738-e9f7fbe0bc6e None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:34:07.928433 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-73a51b8b-a757-45db-9738-e9f7fbe0bc6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:34:07.998973 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 462/914] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 24 05:34:07 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 05:34:08.266063 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde2865d-6f85-42c9-92aa-d2fc17e4f52f None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:34:08.373483 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde2865d-6f85-42c9-92aa-d2fc17e4f52f None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:34:08.408264 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2115ee2d-8b98-4dd9-91bf-4ceb2339e807 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:34:08.408895 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2115ee2d-8b98-4dd9-91bf-4ceb2339e807 None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:08.409174 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2115ee2d-8b98-4dd9-91bf-4ceb2339e807 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:08.409442 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2115ee2d-8b98-4dd9-91bf-4ceb2339e807 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:08.410048 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2115ee2d-8b98-4dd9-91bf-4ceb2339e807 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:34:08.411483 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2115ee2d-8b98-4dd9-91bf-4ceb2339e807 None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:34:08.420359 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application [None req-2115ee2d-8b98-4dd9-91bf-4ceb2339e807 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 05:34:08.420359 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:34:08.420359 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 05:34:08.420359 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 05:34:08.420359 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 05:34:08.420359 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 05:34:08.420359 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 05:34:08.420359 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 05:34:08.420359 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 05:34:08.420359 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Aug 24 05:34:08.420359 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 05:34:08.420359 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Aug 24 05:34:08.420359 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:34:08.420359 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:34:08.420359 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:34:08.420359 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:34:08.420359 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:34:08.421933 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:34:08.421933 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:34:08.421933 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:34:08.421933 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:34:08.421933 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:34:08.421933 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:34:08.421933 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 05:34:08.421933 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 05:34:08.421933 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 05:34:08.421933 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 05:34:08.421933 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:34:08.421933 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:34:08.421933 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:34:08.421933 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:34:08.421933 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:34:08.421933 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:34:08.422823 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:34:08.422823 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application with Lock( Aug 24 05:34:08.422823 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:34:08.422823 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:34:08.422823 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:34:08.422823 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:34:08.422823 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:34:08.422823 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:34:08.422823 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:34:08.422823 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:34:08.422823 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 05:34:08.422823 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 05:34:08.422823 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 05:34:08.422823 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Aug 24 05:34:08.422823 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 453/915] 10.222.0.26 () {56 vars in 1114 bytes} [Wed Aug 24 05:34:08 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:34:08.428109 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a51b8b-a757-45db-9738-e9f7fbe0bc6e None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:34:08.482389 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:34:08.500934 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e43738-befb-4019-9727-cc7f33b05415 None None] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:08.501839 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e43738-befb-4019-9727-cc7f33b05415 None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:08.502155 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e43738-befb-4019-9727-cc7f33b05415 None None] PATH_INFO: `/` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:08.503605 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 454/916] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 24 05:34:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 05:34:08.509674 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55700cb-46dd-4a8a-9ab1-4d87178a460d None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:08.509988 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55700cb-46dd-4a8a-9ab1-4d87178a460d None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:08.510254 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55700cb-46dd-4a8a-9ab1-4d87178a460d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:08.528369 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-f55700cb-46dd-4a8a-9ab1-4d87178a460d None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:34:08.529578 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-f55700cb-46dd-4a8a-9ab1-4d87178a460d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:34:08.532115 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:34:08.545398 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a51b8b-a757-45db-9738-e9f7fbe0bc6e None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:34:08.584130 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fc6784-3d21-490c-a094-6fb9feaadc79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:34:08.585134 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fc6784-3d21-490c-a094-6fb9feaadc79 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:08.585624 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fc6784-3d21-490c-a094-6fb9feaadc79 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:08.586131 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fc6784-3d21-490c-a094-6fb9feaadc79 None admin] PATH_INFO: `/v3/services` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:08.586967 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fc6784-3d21-490c-a094-6fb9feaadc79 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=88113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:34:08.587503 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fc6784-3d21-490c-a094-6fb9feaadc79 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:34:08.589077 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fc6784-3d21-490c-a094-6fb9feaadc79 None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:34:08.595040 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 463/917] 10.222.0.26 () {56 vars in 1114 bytes} [Wed Aug 24 05:34:08 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:34:08.601139 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fc6784-3d21-490c-a094-6fb9feaadc79 None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:34:08.622162 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 455/918] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 24 05:34:08 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 05:34:08.714646 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fc6784-3d21-490c-a094-6fb9feaadc79 None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:34:08.727339 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:34:08.752396 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a05e7e-a198-482e-87a9-b19795f4c76a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:34:08.753365 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a05e7e-a198-482e-87a9-b19795f4c76a None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:08.753847 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a05e7e-a198-482e-87a9-b19795f4c76a None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:08.754380 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a05e7e-a198-482e-87a9-b19795f4c76a None admin] PATH_INFO: `/v3/services` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:08.755211 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a05e7e-a198-482e-87a9-b19795f4c76a None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=88113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:34:08.755736 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a05e7e-a198-482e-87a9-b19795f4c76a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:34:08.757593 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a05e7e-a198-482e-87a9-b19795f4c76a None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:34:08.763315 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 464/919] 10.222.0.26 () {56 vars in 1114 bytes} [Wed Aug 24 05:34:08 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:34:08.769715 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55700cb-46dd-4a8a-9ab1-4d87178a460d None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:34:08.871826 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55700cb-46dd-4a8a-9ab1-4d87178a460d None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:34:08.895888 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a05e7e-a198-482e-87a9-b19795f4c76a None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:34:08.915353 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19b51f1-731f-4176-990d-28ef9f85beb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:34:08.916004 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19b51f1-731f-4176-990d-28ef9f85beb5 None admin] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:08.916268 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19b51f1-731f-4176-990d-28ef9f85beb5 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:08.916509 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19b51f1-731f-4176-990d-28ef9f85beb5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:08.917183 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19b51f1-731f-4176-990d-28ef9f85beb5 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:34:08.919071 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19b51f1-731f-4176-990d-28ef9f85beb5 None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:34:08.930094 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:34:08.953975 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 456/920] 10.222.0.26 () {60 vars in 1144 bytes} [Wed Aug 24 05:34:08 2022] POST /identity/v3/endpoints => generated 346 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:34:09.022353 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a05e7e-a198-482e-87a9-b19795f4c76a None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:34:09.068917 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90141ed0-d4a7-462b-9b9c-e9373937d404 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:34:09.069560 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90141ed0-d4a7-462b-9b9c-e9373937d404 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:09.069839 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90141ed0-d4a7-462b-9b9c-e9373937d404 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:09.070170 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90141ed0-d4a7-462b-9b9c-e9373937d404 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:09.070758 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90141ed0-d4a7-462b-9b9c-e9373937d404 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:34:09.072376 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90141ed0-d4a7-462b-9b9c-e9373937d404 None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:34:09.083332 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application [None req-90141ed0-d4a7-462b-9b9c-e9373937d404 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 05:34:09.083332 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:34:09.083332 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 05:34:09.083332 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 05:34:09.083332 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 05:34:09.083332 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 05:34:09.083332 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 05:34:09.083332 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 05:34:09.083332 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 05:34:09.083332 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Aug 24 05:34:09.083332 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 05:34:09.083332 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Aug 24 05:34:09.083332 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:34:09.083332 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:34:09.083332 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:34:09.083332 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:34:09.083332 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:34:09.084418 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:34:09.084418 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:34:09.084418 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:34:09.084418 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:34:09.084418 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:34:09.084418 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:34:09.084418 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 05:34:09.084418 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 05:34:09.084418 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 05:34:09.084418 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 05:34:09.084418 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:34:09.084418 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:34:09.084418 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:34:09.084418 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:34:09.084418 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:34:09.084418 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:34:09.085282 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:34:09.085282 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application with Lock( Aug 24 05:34:09.085282 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:34:09.085282 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:34:09.085282 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:34:09.085282 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:34:09.085282 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:34:09.085282 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:34:09.085282 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:34:09.085282 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:34:09.085282 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 05:34:09.085282 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 05:34:09.085282 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 05:34:09.085282 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Aug 24 05:34:09.085282 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 465/921] 10.222.0.26 () {56 vars in 1126 bytes} [Wed Aug 24 05:34:08 2022] GET /identity/v3/services/object-store => generated 93 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:34:09.092857 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19b51f1-731f-4176-990d-28ef9f85beb5 None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:34:09.199434 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19b51f1-731f-4176-990d-28ef9f85beb5 None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:34:09.235393 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e7ac8b-9e8d-4461-bdcd-cbce42a31108 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:34:09.236009 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e7ac8b-9e8d-4461-bdcd-cbce42a31108 None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:09.236290 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e7ac8b-9e8d-4461-bdcd-cbce42a31108 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:09.236560 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e7ac8b-9e8d-4461-bdcd-cbce42a31108 None admin] PATH_INFO: `/v3/services` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:09.237192 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e7ac8b-9e8d-4461-bdcd-cbce42a31108 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=88112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:34:09.237557 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e7ac8b-9e8d-4461-bdcd-cbce42a31108 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:34:09.238961 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e7ac8b-9e8d-4461-bdcd-cbce42a31108 None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:34:09.244126 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 457/922] 10.222.0.26 () {56 vars in 1122 bytes} [Wed Aug 24 05:34:09 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:34:09.250194 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90141ed0-d4a7-462b-9b9c-e9373937d404 None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:34:09.287155 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:34:09.359025 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90141ed0-d4a7-462b-9b9c-e9373937d404 None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:34:09.394610 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db708b3-3e51-472c-ad12-21e808491b56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:34:09.395230 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db708b3-3e51-472c-ad12-21e808491b56 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:09.395512 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db708b3-3e51-472c-ad12-21e808491b56 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:09.395791 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db708b3-3e51-472c-ad12-21e808491b56 None admin] PATH_INFO: `/v3/services` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:09.396432 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db708b3-3e51-472c-ad12-21e808491b56 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=88113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:34:09.396736 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db708b3-3e51-472c-ad12-21e808491b56 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:34:09.398221 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db708b3-3e51-472c-ad12-21e808491b56 None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:34:09.403843 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 466/923] 10.222.0.26 () {56 vars in 1122 bytes} [Wed Aug 24 05:34:09 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:34:09.410276 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e7ac8b-9e8d-4461-bdcd-cbce42a31108 None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:34:09.473469 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:34:09.518760 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e7ac8b-9e8d-4461-bdcd-cbce42a31108 None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:34:09.533789 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feff7e87-e611-4264-8691-f00149dceae1 None None] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:09.534356 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feff7e87-e611-4264-8691-f00149dceae1 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:09.534356 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feff7e87-e611-4264-8691-f00149dceae1 None None] PATH_INFO: `/` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:09.545307 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 467/924] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 24 05:34:09 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:34:09.546878 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0738f137-eb41-4154-aebd-b7105e7978fa None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:09.547415 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0738f137-eb41-4154-aebd-b7105e7978fa None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:09.547885 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0738f137-eb41-4154-aebd-b7105e7978fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:09.556208 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00659d5-d080-4b15-963c-76853e051dad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:34:09.556838 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00659d5-d080-4b15-963c-76853e051dad None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:09.557121 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00659d5-d080-4b15-963c-76853e051dad None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:09.557405 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00659d5-d080-4b15-963c-76853e051dad None admin] PATH_INFO: `/v3/endpoints` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:09.558744 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00659d5-d080-4b15-963c-76853e051dad None admin] RBAC: Adding query filter params (interface=public, service_id=3f237bfb473b40f78a56fdc1af76b3ef, region_id=RegionOne) {{(pid=88112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:34:09.559061 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00659d5-d080-4b15-963c-76853e051dad None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:34:09.560436 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00659d5-d080-4b15-963c-76853e051dad None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:34:09.567268 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 458/925] 10.222.0.26 () {56 vars in 1251 bytes} [Wed Aug 24 05:34:09 2022] GET /identity/v3/endpoints?service_id=3f237bfb473b40f78a56fdc1af76b3ef&interface=public®ion_id=RegionOne => generated 194 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:34:09.569614 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-0738f137-eb41-4154-aebd-b7105e7978fa None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:34:09.571026 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-0738f137-eb41-4154-aebd-b7105e7978fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:34:09.572678 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00659d5-d080-4b15-963c-76853e051dad None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:34:09.646681 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 468/926] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 24 05:34:09 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 05:34:09.690955 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00659d5-d080-4b15-963c-76853e051dad None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:34:09.716187 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:34:09.721593 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef59462-6793-4e46-b9cd-61fd8960b84a None None] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:09.721879 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef59462-6793-4e46-b9cd-61fd8960b84a None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:09.722189 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef59462-6793-4e46-b9cd-61fd8960b84a None None] PATH_INFO: `/` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:09.723846 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 469/927] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 24 05:34:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 05:34:09.727520 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3341ae77-9c80-4a25-98e0-377cec3fc1cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:34:09.728213 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3341ae77-9c80-4a25-98e0-377cec3fc1cb None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:09.728729 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3341ae77-9c80-4a25-98e0-377cec3fc1cb None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:09.728970 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1221f71-a6c2-4b8d-bdb2-86e9b1f9c230 None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:09.729085 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3341ae77-9c80-4a25-98e0-377cec3fc1cb None admin] PATH_INFO: `/v3/services` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:09.729249 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1221f71-a6c2-4b8d-bdb2-86e9b1f9c230 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:09.729517 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1221f71-a6c2-4b8d-bdb2-86e9b1f9c230 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:09.729679 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3341ae77-9c80-4a25-98e0-377cec3fc1cb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:34:09.731057 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3341ae77-9c80-4a25-98e0-377cec3fc1cb None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:34:09.738717 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 459/928] 10.222.0.26 () {56 vars in 1087 bytes} [Wed Aug 24 05:34:09 2022] GET /identity/v3/services => generated 1497 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 05:34:09.748588 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-f1221f71-a6c2-4b8d-bdb2-86e9b1f9c230 None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:34:09.750416 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-f1221f71-a6c2-4b8d-bdb2-86e9b1f9c230 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:34:09.779345 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:34:09.831563 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 470/929] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 24 05:34:09 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 05:34:09.919777 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3341ae77-9c80-4a25-98e0-377cec3fc1cb None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:34:10.021116 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3341ae77-9c80-4a25-98e0-377cec3fc1cb None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:34:10.056002 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7529d490-2822-4f6e-a180-5e457316c477 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:34:10.056989 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7529d490-2822-4f6e-a180-5e457316c477 None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:10.057473 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7529d490-2822-4f6e-a180-5e457316c477 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:10.058021 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7529d490-2822-4f6e-a180-5e457316c477 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:10.069411 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7529d490-2822-4f6e-a180-5e457316c477 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:34:10.074528 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application [None req-7529d490-2822-4f6e-a180-5e457316c477 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 05:34:10.074528 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:34:10.074528 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:34:10.074528 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:34:10.074528 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:34:10.074528 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:34:10.074528 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:34:10.074528 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:34:10.074528 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:34:10.074528 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:34:10.074528 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:34:10.074528 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:34:10.074528 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:34:10.074528 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:34:10.074528 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:34:10.074528 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:34:10.075437 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:34:10.075437 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:34:10.075437 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:34:10.075437 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:34:10.075437 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:34:10.075437 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:34:10.075437 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:34:10.075437 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:34:10.075437 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:34:10.075437 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:34:10.075437 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:34:10.075437 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application with Lock( Aug 24 05:34:10.075437 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:34:10.075437 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:34:10.075437 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:34:10.075437 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:34:10.076423 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:34:10.076423 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:34:10.076423 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:34:10.076423 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:34:10.076423 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:34:10.076423 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:34:10.076423 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:34:10.076423 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:34:10.076423 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:34:10.076423 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:34:10.076423 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 05:34:10.076423 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Aug 24 05:34:10.076423 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 460/930] 10.222.0.26 () {56 vars in 1120 bytes} [Wed Aug 24 05:34:09 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:34:10.083729 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1221f71-a6c2-4b8d-bdb2-86e9b1f9c230 None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:34:10.104129 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7529d490-2822-4f6e-a180-5e457316c477 None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:34:10.174323 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:34:10.194981 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1221f71-a6c2-4b8d-bdb2-86e9b1f9c230 None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:34:10.236069 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fb39e7-9f24-4aa0-ba7e-8b96fb8e3bc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:34:10.236708 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fb39e7-9f24-4aa0-ba7e-8b96fb8e3bc9 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:10.236956 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fb39e7-9f24-4aa0-ba7e-8b96fb8e3bc9 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:10.237226 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fb39e7-9f24-4aa0-ba7e-8b96fb8e3bc9 None admin] PATH_INFO: `/v3/roles` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:10.237896 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fb39e7-9f24-4aa0-ba7e-8b96fb8e3bc9 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=88113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:34:10.238247 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fb39e7-9f24-4aa0-ba7e-8b96fb8e3bc9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:34:10.239715 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fb39e7-9f24-4aa0-ba7e-8b96fb8e3bc9 None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:34:10.247320 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7529d490-2822-4f6e-a180-5e457316c477 None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:34:10.253194 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 471/931] 10.222.0.26 () {56 vars in 1115 bytes} [Wed Aug 24 05:34:10 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:34:10.255568 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fb39e7-9f24-4aa0-ba7e-8b96fb8e3bc9 None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:34:10.281361 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:34:10.302178 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc87740-9644-429a-aa9f-a1417b4fab7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:34:10.303079 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc87740-9644-429a-aa9f-a1417b4fab7b None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:10.303526 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc87740-9644-429a-aa9f-a1417b4fab7b None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:10.304383 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc87740-9644-429a-aa9f-a1417b4fab7b None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:10.305115 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc87740-9644-429a-aa9f-a1417b4fab7b None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:34:10.307441 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc87740-9644-429a-aa9f-a1417b4fab7b None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:34:10.320301 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application [None req-7dc87740-9644-429a-aa9f-a1417b4fab7b None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 05:34:10.320301 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:34:10.320301 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 05:34:10.320301 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 05:34:10.320301 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 05:34:10.320301 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 05:34:10.320301 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 05:34:10.320301 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 05:34:10.320301 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 05:34:10.320301 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Aug 24 05:34:10.320301 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 05:34:10.320301 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Aug 24 05:34:10.320301 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:34:10.320301 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:34:10.320301 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:34:10.320301 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:34:10.321441 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:34:10.321441 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:34:10.321441 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:34:10.321441 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:34:10.321441 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:34:10.321441 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:34:10.321441 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:34:10.321441 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 05:34:10.321441 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 05:34:10.321441 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 05:34:10.321441 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 05:34:10.321441 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:34:10.321441 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:34:10.321441 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:34:10.321441 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:34:10.321441 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:34:10.321441 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:34:10.322570 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:34:10.322570 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application with Lock( Aug 24 05:34:10.322570 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:34:10.322570 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:34:10.322570 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:34:10.322570 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:34:10.322570 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:34:10.322570 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:34:10.322570 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:34:10.322570 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:34:10.322570 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 05:34:10.322570 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 05:34:10.322570 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 05:34:10.322570 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Aug 24 05:34:10.325412 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 461/932] 10.222.0.26 () {56 vars in 1132 bytes} [Wed Aug 24 05:34:10 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 05:34:10.331382 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc87740-9644-429a-aa9f-a1417b4fab7b None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:34:10.385087 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fb39e7-9f24-4aa0-ba7e-8b96fb8e3bc9 None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:34:10.431609 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f75b3d-80da-4ff8-9bcf-aa14c56d5d7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:34:10.432825 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f75b3d-80da-4ff8-9bcf-aa14c56d5d7e None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:10.433284 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f75b3d-80da-4ff8-9bcf-aa14c56d5d7e None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:10.434166 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f75b3d-80da-4ff8-9bcf-aa14c56d5d7e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:10.437120 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc87740-9644-429a-aa9f-a1417b4fab7b None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:34:10.448975 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:34:10.450079 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f75b3d-80da-4ff8-9bcf-aa14c56d5d7e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:34:10.452085 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f75b3d-80da-4ff8-9bcf-aa14c56d5d7e None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:34:10.473007 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application [None req-c3f75b3d-80da-4ff8-9bcf-aa14c56d5d7e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:34:10.473007 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:34:10.473007 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:34:10.473007 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:34:10.473007 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:34:10.473007 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:34:10.473007 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:34:10.473007 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:34:10.473007 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:34:10.473007 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:34:10.473007 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:34:10.473007 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:34:10.473007 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 05:34:10.473007 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 05:34:10.473007 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 05:34:10.473007 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 05:34:10.473988 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:34:10.473988 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:34:10.473988 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:34:10.473988 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:34:10.473988 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:34:10.473988 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:34:10.473988 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:34:10.473988 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application with Lock( Aug 24 05:34:10.473988 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:34:10.473988 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:34:10.473988 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:34:10.473988 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:34:10.473988 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:34:10.473988 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:34:10.473988 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:34:10.473988 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:34:10.473988 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 05:34:10.474969 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 05:34:10.474969 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:34:10.474969 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Aug 24 05:34:10.480031 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 472/933] 10.222.0.26 () {56 vars in 1108 bytes} [Wed Aug 24 05:34:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 05:34:10.481445 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f75b3d-80da-4ff8-9bcf-aa14c56d5d7e None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:34:10.482691 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99649d6f-e1b3-4ce8-b994-5ecebaa1c2b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:34:10.483930 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99649d6f-e1b3-4ce8-b994-5ecebaa1c2b5 None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:10.484207 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99649d6f-e1b3-4ce8-b994-5ecebaa1c2b5 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:10.484473 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99649d6f-e1b3-4ce8-b994-5ecebaa1c2b5 None admin] PATH_INFO: `/v3/services` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:10.485105 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99649d6f-e1b3-4ce8-b994-5ecebaa1c2b5 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=88112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:34:10.485402 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99649d6f-e1b3-4ce8-b994-5ecebaa1c2b5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:34:10.486781 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99649d6f-e1b3-4ce8-b994-5ecebaa1c2b5 None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:34:10.497785 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 462/934] 10.222.0.26 () {56 vars in 1126 bytes} [Wed Aug 24 05:34:10 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:34:10.502982 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99649d6f-e1b3-4ce8-b994-5ecebaa1c2b5 None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:34:10.593064 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:34:10.618761 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99649d6f-e1b3-4ce8-b994-5ecebaa1c2b5 None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:34:10.633657 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f75b3d-80da-4ff8-9bcf-aa14c56d5d7e None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:34:10.668476 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30106daf-f45c-4576-83a9-269b11bff5d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:34:10.669195 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30106daf-f45c-4576-83a9-269b11bff5d4 None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:10.669477 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30106daf-f45c-4576-83a9-269b11bff5d4 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:10.669756 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30106daf-f45c-4576-83a9-269b11bff5d4 None admin] PATH_INFO: `/v3/services` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:10.670584 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30106daf-f45c-4576-83a9-269b11bff5d4 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=88112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:34:10.670917 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30106daf-f45c-4576-83a9-269b11bff5d4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:34:10.672561 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30106daf-f45c-4576-83a9-269b11bff5d4 None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:34:10.673573 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee78a056-fb97-49b8-bf8d-73e800df6456 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:34:10.674461 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee78a056-fb97-49b8-bf8d-73e800df6456 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:10.674944 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee78a056-fb97-49b8-bf8d-73e800df6456 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:10.675414 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee78a056-fb97-49b8-bf8d-73e800df6456 None admin] PATH_INFO: `/v3/domains` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:10.676265 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee78a056-fb97-49b8-bf8d-73e800df6456 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:34:10.676763 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee78a056-fb97-49b8-bf8d-73e800df6456 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:34:10.681410 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 463/935] 10.222.0.26 () {56 vars in 1126 bytes} [Wed Aug 24 05:34:10 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:34:10.682738 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee78a056-fb97-49b8-bf8d-73e800df6456 None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:34:10.683245 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30106daf-f45c-4576-83a9-269b11bff5d4 None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:34:10.705565 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 473/936] 10.222.0.26 () {56 vars in 1109 bytes} [Wed Aug 24 05:34:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:34:10.707469 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee78a056-fb97-49b8-bf8d-73e800df6456 None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:34:10.732347 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:34:10.802637 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30106daf-f45c-4576-83a9-269b11bff5d4 None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:34:10.843200 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee78a056-fb97-49b8-bf8d-73e800df6456 None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:34:10.844606 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b17dbb9-cc13-4658-93e4-3c3c0d7e8a57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:34:10.845498 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b17dbb9-cc13-4658-93e4-3c3c0d7e8a57 None admin] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:10.846025 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b17dbb9-cc13-4658-93e4-3c3c0d7e8a57 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:10.846520 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b17dbb9-cc13-4658-93e4-3c3c0d7e8a57 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:10.847382 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b17dbb9-cc13-4658-93e4-3c3c0d7e8a57 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:34:10.848929 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b17dbb9-cc13-4658-93e4-3c3c0d7e8a57 None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:34:10.874293 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 464/937] 10.222.0.26 () {60 vars in 1144 bytes} [Wed Aug 24 05:34:10 2022] POST /identity/v3/endpoints => generated 347 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 05:34:10.884329 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:34:10.898693 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff358e00-5b3c-40a3-94d5-017641d3eb38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:34:10.899762 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff358e00-5b3c-40a3-94d5-017641d3eb38 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:10.900238 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff358e00-5b3c-40a3-94d5-017641d3eb38 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:10.900743 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff358e00-5b3c-40a3-94d5-017641d3eb38 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:10.910517 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff358e00-5b3c-40a3-94d5-017641d3eb38 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:34:10.912437 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff358e00-5b3c-40a3-94d5-017641d3eb38 None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:34:10.926607 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application [None req-ff358e00-5b3c-40a3-94d5-017641d3eb38 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 05:34:10.926607 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:34:10.926607 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:34:10.926607 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:34:10.926607 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:34:10.926607 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:34:10.926607 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:34:10.926607 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:34:10.926607 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:34:10.926607 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:34:10.926607 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:34:10.926607 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:34:10.926607 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 05:34:10.926607 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 05:34:10.926607 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 05:34:10.926607 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 05:34:10.927646 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:34:10.927646 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:34:10.927646 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 05:34:10.927646 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 05:34:10.927646 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 05:34:10.927646 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 05:34:10.927646 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:34:10.927646 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:34:10.927646 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:34:10.927646 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:34:10.927646 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:34:10.927646 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application with Lock( Aug 24 05:34:10.927646 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:34:10.927646 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:34:10.927646 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:34:10.927646 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:34:10.927646 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:34:10.927646 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:34:10.928572 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:34:10.928572 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:34:10.928572 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 05:34:10.928572 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 05:34:10.928572 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 05:34:10.928572 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 05:34:10.928572 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 05:34:10.928572 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 05:34:10.928572 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 05:34:10.928572 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Aug 24 05:34:10.935324 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 474/938] 10.222.0.26 () {56 vars in 1117 bytes} [Wed Aug 24 05:34:10 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 05:34:10.938643 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b17dbb9-cc13-4658-93e4-3c3c0d7e8a57 None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:34:11.038000 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cf7c54-07d5-4102-809f-f9c8d003eecd None None] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:11.038617 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cf7c54-07d5-4102-809f-f9c8d003eecd None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:11.039396 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cf7c54-07d5-4102-809f-f9c8d003eecd None None] PATH_INFO: `/` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:11.041024 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 475/939] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 24 05:34:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 05:34:11.044235 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:34:11.049269 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089c93cf-8afe-4ed4-a957-091173720e23 None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:11.049559 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089c93cf-8afe-4ed4-a957-091173720e23 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:11.053517 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b17dbb9-cc13-4658-93e4-3c3c0d7e8a57 None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:34:11.054210 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089c93cf-8afe-4ed4-a957-091173720e23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:11.085449 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-089c93cf-8afe-4ed4-a957-091173720e23 None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:34:11.086728 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-089c93cf-8afe-4ed4-a957-091173720e23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:34:11.098401 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b07a67-a514-46de-b3bf-a4f18e5f5a84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:34:11.099483 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b07a67-a514-46de-b3bf-a4f18e5f5a84 None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:11.099769 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b07a67-a514-46de-b3bf-a4f18e5f5a84 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:11.100042 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b07a67-a514-46de-b3bf-a4f18e5f5a84 None admin] PATH_INFO: `/v3/users` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:11.101361 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b07a67-a514-46de-b3bf-a4f18e5f5a84 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=88112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:34:11.101805 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b07a67-a514-46de-b3bf-a4f18e5f5a84 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:34:11.103588 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b07a67-a514-46de-b3bf-a4f18e5f5a84 None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:34:11.126841 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 465/940] 10.222.0.26 () {56 vars in 1149 bytes} [Wed Aug 24 05:34:10 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:34:11.132079 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b07a67-a514-46de-b3bf-a4f18e5f5a84 None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:34:11.169934 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 476/941] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 24 05:34:11 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 05:34:11.245288 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b07a67-a514-46de-b3bf-a4f18e5f5a84 None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:34:11.281832 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf8229d-f238-40cb-a0e2-ce538b141886 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:34:11.282493 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf8229d-f238-40cb-a0e2-ce538b141886 None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:11.282831 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf8229d-f238-40cb-a0e2-ce538b141886 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:11.283045 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf8229d-f238-40cb-a0e2-ce538b141886 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:11.293667 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf8229d-f238-40cb-a0e2-ce538b141886 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:34:11.295186 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf8229d-f238-40cb-a0e2-ce538b141886 None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:34:11.310426 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application [None req-fcf8229d-f238-40cb-a0e2-ce538b141886 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:34:11.310426 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:34:11.310426 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:34:11.310426 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:34:11.310426 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:34:11.310426 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:34:11.310426 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:34:11.310426 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:34:11.310426 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:34:11.310426 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:34:11.310426 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:34:11.310426 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:34:11.310426 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 05:34:11.310426 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 05:34:11.310426 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 05:34:11.310426 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 05:34:11.311918 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:34:11.311918 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:34:11.311918 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:34:11.311918 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:34:11.311918 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:34:11.311918 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:34:11.311918 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:34:11.311918 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application with Lock( Aug 24 05:34:11.311918 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:34:11.311918 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:34:11.311918 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:34:11.311918 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:34:11.311918 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:34:11.311918 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:34:11.311918 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:34:11.311918 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:34:11.311918 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 05:34:11.312814 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 05:34:11.312814 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:34:11.312814 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Aug 24 05:34:11.312814 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 466/942] 10.222.0.26 () {56 vars in 1108 bytes} [Wed Aug 24 05:34:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:34:11.318117 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089c93cf-8afe-4ed4-a957-091173720e23 None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:34:11.425172 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089c93cf-8afe-4ed4-a957-091173720e23 None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:34:11.438531 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf8229d-f238-40cb-a0e2-ce538b141886 None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:34:11.442622 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:34:11.446711 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:34:11.473405 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb7384d-2565-49ce-8919-61e2b3fc4e04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:34:11.474661 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb7384d-2565-49ce-8919-61e2b3fc4e04 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:11.475539 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb7384d-2565-49ce-8919-61e2b3fc4e04 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:11.476297 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb7384d-2565-49ce-8919-61e2b3fc4e04 None admin] PATH_INFO: `/v3/domains` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:11.477176 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb7384d-2565-49ce-8919-61e2b3fc4e04 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:34:11.477679 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb7384d-2565-49ce-8919-61e2b3fc4e04 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:34:11.480347 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb7384d-2565-49ce-8919-61e2b3fc4e04 None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:34:11.506383 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 477/943] 10.222.0.26 () {56 vars in 1109 bytes} [Wed Aug 24 05:34:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:34:11.507632 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb7384d-2565-49ce-8919-61e2b3fc4e04 None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:34:11.573981 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf8229d-f238-40cb-a0e2-ce538b141886 None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:34:11.621367 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb7384d-2565-49ce-8919-61e2b3fc4e04 None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:34:11.626005 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9fc45a-94fe-4cf6-a89c-2bfd9cae6057 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:34:11.626909 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9fc45a-94fe-4cf6-a89c-2bfd9cae6057 None admin] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:11.627391 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9fc45a-94fe-4cf6-a89c-2bfd9cae6057 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:11.627863 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9fc45a-94fe-4cf6-a89c-2bfd9cae6057 None admin] PATH_INFO: `/v3/projects` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:11.629198 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9fc45a-94fe-4cf6-a89c-2bfd9cae6057 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:34:11.631354 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9fc45a-94fe-4cf6-a89c-2bfd9cae6057 None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:34:11.635205 dv-cinder-854268-1-smb devstack@keystone.service[88112]: WARNING keystone.server.flask.common [None req-0c9fc45a-94fe-4cf6-a89c-2bfd9cae6057 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 24 05:34:11.657577 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f190d155-825d-4be3-ad8a-65b23a1289d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:34:11.658193 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f190d155-825d-4be3-ad8a-65b23a1289d3 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:11.658485 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f190d155-825d-4be3-ad8a-65b23a1289d3 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:11.658738 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f190d155-825d-4be3-ad8a-65b23a1289d3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:11.660487 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.sql.core [None req-0c9fc45a-94fe-4cf6-a89c-2bfd9cae6057 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 24 05:34:11.660487 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 24 05:34:11.660487 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [parameters: {'id': '3c453940b8954da68022a15d5163daac', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 24 05:34:11.660487 dv-cinder-854268-1-smb devstack@keystone.service[88112]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=88112) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 24 05:34:11.665902 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f190d155-825d-4be3-ad8a-65b23a1289d3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:34:11.667493 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f190d155-825d-4be3-ad8a-65b23a1289d3 None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:34:11.678752 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application [None req-0c9fc45a-94fe-4cf6-a89c-2bfd9cae6057 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 3c453940b8954da68022a15d5163daac.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 3c453940b8954da68022a15d5163daac. Aug 24 05:34:11.678752 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:34:11.678752 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 24 05:34:11.678752 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 24 05:34:11.678752 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 24 05:34:11.678752 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 24 05:34:11.678752 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 24 05:34:11.678752 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application result = self._query(query) Aug 24 05:34:11.678752 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 24 05:34:11.678752 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application conn.query(q) Aug 24 05:34:11.678752 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 24 05:34:11.678752 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 24 05:34:11.678752 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 24 05:34:11.679620 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application result.read() Aug 24 05:34:11.679620 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 24 05:34:11.679620 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 24 05:34:11.679620 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 24 05:34:11.679620 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 24 05:34:11.679620 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 24 05:34:11.679620 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 24 05:34:11.679620 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 24 05:34:11.679620 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 24 05:34:11.679620 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 24 05:34:11.679620 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Aug 24 05:34:11.679620 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 24 05:34:11.679620 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Aug 24 05:34:11.679620 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:34:11.679620 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 24 05:34:11.679620 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 24 05:34:11.679620 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 24 05:34:11.679620 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 24 05:34:11.680582 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 24 05:34:11.680582 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application next(self.gen) Aug 24 05:34:11.680582 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 24 05:34:11.680582 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application yield resource Aug 24 05:34:11.680582 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 24 05:34:11.680582 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application next(self.gen) Aug 24 05:34:11.680582 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 24 05:34:11.680582 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application self.session.rollback() Aug 24 05:34:11.680582 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 24 05:34:11.680582 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application self.force_reraise() Aug 24 05:34:11.680582 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 24 05:34:11.680582 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application raise self.value Aug 24 05:34:11.680582 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 24 05:34:11.680582 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 24 05:34:11.680582 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 24 05:34:11.680582 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application session.commit() Aug 24 05:34:11.680582 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 24 05:34:11.681528 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 24 05:34:11.681528 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 24 05:34:11.681528 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application self._prepare_impl() Aug 24 05:34:11.681528 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 24 05:34:11.681528 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application self.session.flush() Aug 24 05:34:11.681528 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 24 05:34:11.681528 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application self._flush(objects) Aug 24 05:34:11.681528 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 24 05:34:11.681528 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 24 05:34:11.681528 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 24 05:34:11.681528 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application compat.raise_( Aug 24 05:34:11.681528 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 24 05:34:11.681528 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application raise exception Aug 24 05:34:11.681528 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 24 05:34:11.681528 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application flush_context.execute() Aug 24 05:34:11.681528 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 24 05:34:11.681528 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application rec.execute(self) Aug 24 05:34:11.683300 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 24 05:34:11.683300 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 24 05:34:11.683300 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 24 05:34:11.683300 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 24 05:34:11.683300 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 24 05:34:11.683300 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 24 05:34:11.683300 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 24 05:34:11.683300 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 24 05:34:11.683300 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 24 05:34:11.683300 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 24 05:34:11.683300 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 24 05:34:11.683300 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 24 05:34:11.683300 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 24 05:34:11.683300 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 24 05:34:11.683300 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 24 05:34:11.684735 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 24 05:34:11.684735 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 24 05:34:11.684735 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application raise exception Aug 24 05:34:11.684735 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 24 05:34:11.684735 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 24 05:34:11.684735 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 24 05:34:11.684735 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 24 05:34:11.684735 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 24 05:34:11.684735 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application result = self._query(query) Aug 24 05:34:11.684735 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 24 05:34:11.684735 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application conn.query(q) Aug 24 05:34:11.684735 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 24 05:34:11.684735 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 24 05:34:11.684735 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 24 05:34:11.684735 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application result.read() Aug 24 05:34:11.684735 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 24 05:34:11.684735 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 24 05:34:11.690178 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 24 05:34:11.690178 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 24 05:34:11.690178 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 24 05:34:11.690178 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 24 05:34:11.690178 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 24 05:34:11.690178 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 24 05:34:11.690178 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 24 05:34:11.690178 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 24 05:34:11.690178 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application [parameters: {'id': '3c453940b8954da68022a15d5163daac', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 24 05:34:11.690178 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 24 05:34:11.690178 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Aug 24 05:34:11.690178 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 05:34:11.690178 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Aug 24 05:34:11.690178 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:34:11.690178 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 24 05:34:11.691002 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 24 05:34:11.691002 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 24 05:34:11.691002 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 24 05:34:11.691002 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Aug 24 05:34:11.691002 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Aug 24 05:34:11.691002 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 05:34:11.691002 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Aug 24 05:34:11.691002 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:34:11.691002 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:34:11.691002 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:34:11.691002 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:34:11.691002 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:34:11.691002 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:34:11.691002 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:34:11.691002 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:34:11.691002 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:34:11.691002 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:34:11.692167 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:34:11.692167 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 24 05:34:11.692167 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 24 05:34:11.692167 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:34:11.692167 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:34:11.692167 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 24 05:34:11.692167 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 24 05:34:11.692167 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 3c453940b8954da68022a15d5163daac. Aug 24 05:34:11.692167 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Aug 24 05:34:11.692657 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application [None req-f190d155-825d-4be3-ad8a-65b23a1289d3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 05:34:11.692657 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:34:11.692657 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:34:11.692657 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:34:11.692657 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:34:11.692657 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:34:11.692657 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:34:11.692657 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:34:11.692657 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:34:11.692657 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:34:11.692657 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:34:11.692657 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:34:11.692657 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 05:34:11.692657 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 05:34:11.692657 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 05:34:11.693429 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 05:34:11.693429 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:34:11.693429 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:34:11.693429 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:34:11.693429 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:34:11.693429 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:34:11.693429 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:34:11.693429 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:34:11.693429 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application with Lock( Aug 24 05:34:11.693429 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:34:11.693429 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:34:11.693429 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:34:11.693429 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:34:11.693429 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:34:11.693429 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:34:11.693429 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:34:11.693429 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:34:11.694361 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 05:34:11.694361 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 05:34:11.694361 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 05:34:11.694361 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 05:34:11.694361 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 05:34:11.694361 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 05:34:11.694361 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 05:34:11.694361 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Aug 24 05:34:11.694789 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 467/944] 10.222.0.26 () {60 vars in 1140 bytes} [Wed Aug 24 05:34:11 2022] POST /identity/v3/projects => generated 262 bytes in 242 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:34:11.694858 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 478/945] 10.222.0.26 () {56 vars in 1111 bytes} [Wed Aug 24 05:34:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 05:34:11.694931 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9fc45a-94fe-4cf6-a89c-2bfd9cae6057 None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:34:11.695000 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f190d155-825d-4be3-ad8a-65b23a1289d3 None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:34:11.743867 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:34:11.760462 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:34:11.810640 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9fc45a-94fe-4cf6-a89c-2bfd9cae6057 None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:34:11.818066 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f190d155-825d-4be3-ad8a-65b23a1289d3 None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:34:11.853354 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fed6274-aa1b-4d54-be95-9e255c7827d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:34:11.853544 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d165119-d536-4344-82e3-4cd837d263f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:34:11.853887 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fed6274-aa1b-4d54-be95-9e255c7827d5 None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:11.854027 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d165119-d536-4344-82e3-4cd837d263f9 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:11.854194 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fed6274-aa1b-4d54-be95-9e255c7827d5 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:11.854297 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d165119-d536-4344-82e3-4cd837d263f9 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:11.854449 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fed6274-aa1b-4d54-be95-9e255c7827d5 None admin] PATH_INFO: `/v3/projects` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:11.854554 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d165119-d536-4344-82e3-4cd837d263f9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:11.855167 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fed6274-aa1b-4d54-be95-9e255c7827d5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:34:11.855479 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fed6274-aa1b-4d54-be95-9e255c7827d5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:34:11.857091 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fed6274-aa1b-4d54-be95-9e255c7827d5 None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:34:11.861248 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d165119-d536-4344-82e3-4cd837d263f9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:34:11.862921 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d165119-d536-4344-82e3-4cd837d263f9 None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:34:11.873429 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 468/946] 10.222.0.26 () {56 vars in 1148 bytes} [Wed Aug 24 05:34:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:34:11.874810 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ff0008-9674-4cff-98c0-b43c8bc0df81 None None] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:11.875094 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ff0008-9674-4cff-98c0-b43c8bc0df81 None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:11.875361 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ff0008-9674-4cff-98c0-b43c8bc0df81 None None] PATH_INFO: `/` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:11.876074 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application [None req-8d165119-d536-4344-82e3-4cd837d263f9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 05:34:11.876074 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:34:11.876074 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:34:11.876074 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:34:11.876074 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:34:11.876074 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:34:11.876074 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:34:11.876074 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:34:11.876074 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:34:11.876074 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:34:11.876074 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:34:11.876074 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:34:11.876074 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 05:34:11.876074 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 05:34:11.876074 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 05:34:11.876988 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 05:34:11.876988 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:34:11.876988 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:34:11.876988 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:34:11.876988 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:34:11.876988 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:34:11.876988 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:34:11.876988 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:34:11.876988 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application with Lock( Aug 24 05:34:11.876988 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:34:11.876988 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:34:11.876988 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:34:11.876988 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:34:11.876988 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:34:11.876988 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:34:11.876988 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:34:11.876988 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:34:11.877983 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 05:34:11.877983 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 05:34:11.877983 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 05:34:11.877983 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 05:34:11.877983 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 05:34:11.877983 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 05:34:11.877983 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 05:34:11.877983 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Aug 24 05:34:11.878495 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 469/947] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 24 05:34:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:34:11.879809 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 479/948] 10.222.0.26 () {56 vars in 1111 bytes} [Wed Aug 24 05:34:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 05:34:11.883376 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d165119-d536-4344-82e3-4cd837d263f9 None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:34:11.884325 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ee9cbd-a5fd-4991-a035-01ab158fe300 None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:11.884609 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ee9cbd-a5fd-4991-a035-01ab158fe300 None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:11.885063 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ee9cbd-a5fd-4991-a035-01ab158fe300 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:11.908225 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-f6ee9cbd-a5fd-4991-a035-01ab158fe300 None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:34:11.909817 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-f6ee9cbd-a5fd-4991-a035-01ab158fe300 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:34:11.983261 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 470/949] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 24 05:34:11 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 05:34:11.994602 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ee9cbd-a5fd-4991-a035-01ab158fe300 None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:34:11.994698 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:34:11.999499 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d165119-d536-4344-82e3-4cd837d263f9 None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:34:12.041646 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:34:12.046644 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941ea586-cae0-4b9b-a221-cd8b5cf75ebd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:34:12.047646 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941ea586-cae0-4b9b-a221-cd8b5cf75ebd None admin] REQUEST_METHOD: `PUT` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:12.047933 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941ea586-cae0-4b9b-a221-cd8b5cf75ebd None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:12.048207 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941ea586-cae0-4b9b-a221-cd8b5cf75ebd None admin] PATH_INFO: `/v3/projects/ded4fe81d4dc43188dd84e53025ee783/users/6c2c08b27a0f4943b5da908eb7b1cd96/roles/bc599913e28e42089c8030b72de2de1f` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:12.051172 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941ea586-cae0-4b9b-a221-cd8b5cf75ebd None admin] RBAC: Authorizing `identity:create_grant(project_id=ded4fe81d4dc43188dd84e53025ee783, user_id=6c2c08b27a0f4943b5da908eb7b1cd96, role_id=bc599913e28e42089c8030b72de2de1f)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:34:12.053381 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941ea586-cae0-4b9b-a221-cd8b5cf75ebd None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:34:12.076401 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 480/950] 10.222.0.26 () {58 vars in 1439 bytes} [Wed Aug 24 05:34:11 2022] PUT /identity/v3/projects/ded4fe81d4dc43188dd84e53025ee783/users/6c2c08b27a0f4943b5da908eb7b1cd96/roles/bc599913e28e42089c8030b72de2de1f => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:34:12.103619 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ee9cbd-a5fd-4991-a035-01ab158fe300 None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:34:12.145678 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854f1081-37da-4cb9-88dc-b055452bb1a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:34:12.146382 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854f1081-37da-4cb9-88dc-b055452bb1a3 None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:12.146705 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854f1081-37da-4cb9-88dc-b055452bb1a3 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:12.147030 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854f1081-37da-4cb9-88dc-b055452bb1a3 None admin] PATH_INFO: `/v3/projects` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:12.147718 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854f1081-37da-4cb9-88dc-b055452bb1a3 None admin] RBAC: Adding query filter params (name=service) {{(pid=88112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:34:12.148020 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854f1081-37da-4cb9-88dc-b055452bb1a3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:34:12.149513 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854f1081-37da-4cb9-88dc-b055452bb1a3 None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:34:12.169864 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 471/951] 10.222.0.26 () {56 vars in 1112 bytes} [Wed Aug 24 05:34:11 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:34:12.260803 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941ea586-cae0-4b9b-a221-cd8b5cf75ebd None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:34:12.372523 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941ea586-cae0-4b9b-a221-cd8b5cf75ebd None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:34:12.408646 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2728c9-b650-45ae-b56c-62d66d6c4ea6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:34:12.409291 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2728c9-b650-45ae-b56c-62d66d6c4ea6 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:12.409570 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2728c9-b650-45ae-b56c-62d66d6c4ea6 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:12.409841 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2728c9-b650-45ae-b56c-62d66d6c4ea6 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:12.410466 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2728c9-b650-45ae-b56c-62d66d6c4ea6 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:34:12.411837 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2728c9-b650-45ae-b56c-62d66d6c4ea6 None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:34:12.420948 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application [None req-fe2728c9-b650-45ae-b56c-62d66d6c4ea6 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 05:34:12.420948 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:34:12.420948 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 05:34:12.420948 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 05:34:12.420948 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 05:34:12.420948 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 05:34:12.420948 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 05:34:12.420948 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 05:34:12.420948 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 05:34:12.420948 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Aug 24 05:34:12.420948 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 05:34:12.420948 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Aug 24 05:34:12.420948 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:34:12.420948 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:34:12.420948 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:34:12.420948 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:34:12.420948 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:34:12.423355 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:34:12.423355 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:34:12.423355 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:34:12.423355 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:34:12.423355 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:34:12.423355 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:34:12.423355 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 05:34:12.423355 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 05:34:12.423355 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 05:34:12.423355 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 05:34:12.423355 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:34:12.423355 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:34:12.423355 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:34:12.423355 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:34:12.423355 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:34:12.423355 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:34:12.425344 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:34:12.425344 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application with Lock( Aug 24 05:34:12.425344 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:34:12.425344 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:34:12.425344 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:34:12.425344 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:34:12.425344 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:34:12.425344 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:34:12.425344 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:34:12.425344 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:34:12.425344 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 05:34:12.425344 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 05:34:12.425344 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 05:34:12.425344 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Aug 24 05:34:12.425344 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 481/952] 10.222.0.26 () {56 vars in 1126 bytes} [Wed Aug 24 05:34:12 2022] GET /identity/v3/services/object-store => generated 93 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:34:12.428347 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854f1081-37da-4cb9-88dc-b055452bb1a3 None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:34:12.538622 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854f1081-37da-4cb9-88dc-b055452bb1a3 None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:34:12.551034 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:34:12.579218 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49339ea0-444c-427e-9c75-c803f8bd40b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:34:12.580196 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49339ea0-444c-427e-9c75-c803f8bd40b3 None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:12.580670 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49339ea0-444c-427e-9c75-c803f8bd40b3 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:12.581129 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49339ea0-444c-427e-9c75-c803f8bd40b3 None admin] PATH_INFO: `/v3/services` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:12.581981 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49339ea0-444c-427e-9c75-c803f8bd40b3 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=88112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:34:12.582490 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49339ea0-444c-427e-9c75-c803f8bd40b3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:34:12.584044 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49339ea0-444c-427e-9c75-c803f8bd40b3 None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:34:12.589624 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 472/953] 10.222.0.26 () {56 vars in 1122 bytes} [Wed Aug 24 05:34:12 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:34:12.596178 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2728c9-b650-45ae-b56c-62d66d6c4ea6 None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:34:12.629202 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:34:12.711368 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2728c9-b650-45ae-b56c-62d66d6c4ea6 None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:34:12.748110 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef725cd-5687-4762-95e2-444823c4807f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:34:12.749244 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef725cd-5687-4762-95e2-444823c4807f None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:12.749637 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef725cd-5687-4762-95e2-444823c4807f None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:12.750113 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef725cd-5687-4762-95e2-444823c4807f None admin] PATH_INFO: `/v3/services` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:12.750961 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef725cd-5687-4762-95e2-444823c4807f None admin] RBAC: Adding query filter params (type=object-store) {{(pid=88113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:34:12.751321 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef725cd-5687-4762-95e2-444823c4807f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:34:12.752737 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef725cd-5687-4762-95e2-444823c4807f None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:34:12.761027 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 482/954] 10.222.0.26 () {56 vars in 1122 bytes} [Wed Aug 24 05:34:12 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:34:12.767997 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49339ea0-444c-427e-9c75-c803f8bd40b3 None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:34:12.870176 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49339ea0-444c-427e-9c75-c803f8bd40b3 None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:34:12.898820 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9576a61-c554-4aab-bd70-c1ba0f923655 None None] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:12.899113 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9576a61-c554-4aab-bd70-c1ba0f923655 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:12.899280 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9576a61-c554-4aab-bd70-c1ba0f923655 None None] PATH_INFO: `/` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:12.900755 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 483/955] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 24 05:34:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:34:12.905631 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdf9eed-b227-418c-86fa-cb73ee2281d3 None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:12.906060 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdf9eed-b227-418c-86fa-cb73ee2281d3 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:12.906252 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdf9eed-b227-418c-86fa-cb73ee2281d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:12.910803 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e36980b-3ef2-4aa4-b598-386676b0d90a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:34:12.911685 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e36980b-3ef2-4aa4-b598-386676b0d90a None admin] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:12.912170 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e36980b-3ef2-4aa4-b598-386676b0d90a None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:12.912908 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e36980b-3ef2-4aa4-b598-386676b0d90a None admin] PATH_INFO: `/v3/endpoints` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:12.913848 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e36980b-3ef2-4aa4-b598-386676b0d90a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:34:12.915243 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e36980b-3ef2-4aa4-b598-386676b0d90a None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:34:12.926542 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-acdf9eed-b227-418c-86fa-cb73ee2281d3 None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:34:12.927974 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-acdf9eed-b227-418c-86fa-cb73ee2281d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:34:12.938145 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 473/956] 10.222.0.26 () {60 vars in 1144 bytes} [Wed Aug 24 05:34:12 2022] POST /identity/v3/endpoints => generated 349 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:34:13.016279 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 484/957] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 24 05:34:12 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 05:34:13.285642 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e36980b-3ef2-4aa4-b598-386676b0d90a None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:34:13.317879 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:34:13.391687 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e36980b-3ef2-4aa4-b598-386676b0d90a None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:34:13.426779 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fed3b9-777a-4eb3-96fd-330ea6bb83fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:34:13.427744 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fed3b9-777a-4eb3-96fd-330ea6bb83fb None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:13.428169 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fed3b9-777a-4eb3-96fd-330ea6bb83fb None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:13.428593 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fed3b9-777a-4eb3-96fd-330ea6bb83fb None admin] PATH_INFO: `/v3/services/compute` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:13.429322 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fed3b9-777a-4eb3-96fd-330ea6bb83fb None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:34:13.430858 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fed3b9-777a-4eb3-96fd-330ea6bb83fb None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:34:13.440180 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application [None req-00fed3b9-777a-4eb3-96fd-330ea6bb83fb None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 05:34:13.440180 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:34:13.440180 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 05:34:13.440180 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 05:34:13.440180 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 05:34:13.440180 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 05:34:13.440180 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 05:34:13.440180 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 05:34:13.440180 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 05:34:13.440180 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Aug 24 05:34:13.440180 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 05:34:13.440180 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Aug 24 05:34:13.440180 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:34:13.440180 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:34:13.440180 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:34:13.440180 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:34:13.440180 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:34:13.441725 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:34:13.441725 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:34:13.441725 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:34:13.441725 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:34:13.441725 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:34:13.441725 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:34:13.441725 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 05:34:13.441725 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 05:34:13.441725 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 05:34:13.441725 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 05:34:13.441725 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:34:13.441725 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:34:13.441725 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:34:13.441725 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:34:13.441725 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:34:13.441725 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:34:13.442841 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:34:13.442841 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application with Lock( Aug 24 05:34:13.442841 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:34:13.442841 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:34:13.442841 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:34:13.442841 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:34:13.442841 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:34:13.442841 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:34:13.442841 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:34:13.442841 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:34:13.442841 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 05:34:13.442841 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 05:34:13.442841 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 05:34:13.442841 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Aug 24 05:34:13.445151 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 474/958] 10.222.0.26 () {56 vars in 1111 bytes} [Wed Aug 24 05:34:13 2022] GET /identity/v3/services/compute => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:34:13.450749 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdf9eed-b227-418c-86fa-cb73ee2281d3 None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:34:13.465571 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:34:13.570644 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdf9eed-b227-418c-86fa-cb73ee2281d3 None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:34:13.605880 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366911eb-ad70-444c-ba53-4a5a99ece550 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:34:13.606522 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366911eb-ad70-444c-ba53-4a5a99ece550 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:13.606806 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366911eb-ad70-444c-ba53-4a5a99ece550 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:13.607082 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366911eb-ad70-444c-ba53-4a5a99ece550 None admin] PATH_INFO: `/v3/services` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:13.607713 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366911eb-ad70-444c-ba53-4a5a99ece550 None admin] RBAC: Adding query filter params (name=compute) {{(pid=88113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:34:13.608072 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366911eb-ad70-444c-ba53-4a5a99ece550 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:34:13.609967 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366911eb-ad70-444c-ba53-4a5a99ece550 None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:34:13.615230 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 485/959] 10.222.0.26 () {56 vars in 1112 bytes} [Wed Aug 24 05:34:13 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:34:13.620712 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fed3b9-777a-4eb3-96fd-330ea6bb83fb None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:34:13.722923 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:34:13.728610 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fed3b9-777a-4eb3-96fd-330ea6bb83fb None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:34:13.766438 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b175ff-b108-468a-8314-dabd19103245 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:34:13.767052 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b175ff-b108-468a-8314-dabd19103245 None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:13.767379 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b175ff-b108-468a-8314-dabd19103245 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:13.767658 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b175ff-b108-468a-8314-dabd19103245 None admin] PATH_INFO: `/v3/services` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:13.768293 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b175ff-b108-468a-8314-dabd19103245 None admin] RBAC: Adding query filter params (type=compute) {{(pid=88112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:34:13.768595 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b175ff-b108-468a-8314-dabd19103245 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:34:13.769981 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b175ff-b108-468a-8314-dabd19103245 None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:34:13.774902 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 475/960] 10.222.0.26 () {56 vars in 1112 bytes} [Wed Aug 24 05:34:13 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:34:14.144946 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4777fe-d806-437e-8da7-5725c831a938 None None] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:14.145493 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4777fe-d806-437e-8da7-5725c831a938 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:14.145493 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4777fe-d806-437e-8da7-5725c831a938 None None] PATH_INFO: `/` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:14.147115 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 486/961] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 24 05:34:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:34:14.152220 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f41420-d3d1-4f61-95a0-27242ad72669 None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:14.152514 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f41420-d3d1-4f61-95a0-27242ad72669 None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:14.152793 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f41420-d3d1-4f61-95a0-27242ad72669 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:14.171741 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-b2f41420-d3d1-4f61-95a0-27242ad72669 None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:34:14.172937 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-b2f41420-d3d1-4f61-95a0-27242ad72669 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:34:14.241478 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 476/962] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 24 05:34:14 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 05:34:14.297338 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e9fe27-8ccd-4d9f-8413-0801f1d7ac99 None None] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:14.297338 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e9fe27-8ccd-4d9f-8413-0801f1d7ac99 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:14.297338 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e9fe27-8ccd-4d9f-8413-0801f1d7ac99 None None] PATH_INFO: `/` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:14.298115 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 487/963] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 24 05:34:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:34:14.303540 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e032ebaf-0a6c-4d3b-9fb7-137da83555d3 None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:14.303978 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e032ebaf-0a6c-4d3b-9fb7-137da83555d3 None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:14.304143 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e032ebaf-0a6c-4d3b-9fb7-137da83555d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:14.322623 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-e032ebaf-0a6c-4d3b-9fb7-137da83555d3 None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:34:14.323811 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-e032ebaf-0a6c-4d3b-9fb7-137da83555d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:34:14.391394 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 477/964] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 24 05:34:14 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 05:34:14.534156 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e9fe27-8ccd-4d9f-8413-0801f1d7ac99 None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:34:14.616200 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:34:14.644781 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e9fe27-8ccd-4d9f-8413-0801f1d7ac99 None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:34:14.680873 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bacf7f1-66c5-4d59-8ce9-b58fb98d9dac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:34:14.681881 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bacf7f1-66c5-4d59-8ce9-b58fb98d9dac None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:14.682395 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bacf7f1-66c5-4d59-8ce9-b58fb98d9dac None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:14.682870 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bacf7f1-66c5-4d59-8ce9-b58fb98d9dac None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:14.694174 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bacf7f1-66c5-4d59-8ce9-b58fb98d9dac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:34:14.697890 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e032ebaf-0a6c-4d3b-9fb7-137da83555d3 None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:34:14.699368 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application [None req-8bacf7f1-66c5-4d59-8ce9-b58fb98d9dac None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 05:34:14.699368 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:34:14.699368 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:34:14.699368 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:34:14.699368 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:34:14.699368 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:34:14.699368 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:34:14.699368 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:34:14.699368 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:34:14.699368 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:34:14.699368 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:34:14.699368 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:34:14.699368 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:34:14.699368 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:34:14.699368 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:34:14.699368 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:34:14.700306 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:34:14.700306 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:34:14.700306 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:34:14.700306 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:34:14.700306 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:34:14.700306 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:34:14.700306 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:34:14.700306 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:34:14.700306 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:34:14.700306 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:34:14.700306 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:34:14.700306 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application with Lock( Aug 24 05:34:14.700306 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:34:14.700306 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:34:14.700306 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:34:14.700306 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:34:14.702430 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:34:14.702430 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:34:14.702430 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:34:14.702430 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:34:14.702430 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:34:14.702430 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:34:14.702430 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:34:14.702430 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:34:14.702430 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:34:14.702430 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:34:14.702430 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 05:34:14.702430 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Aug 24 05:34:14.702430 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 488/965] 10.222.0.26 () {56 vars in 1120 bytes} [Wed Aug 24 05:34:14 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:34:14.707108 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bacf7f1-66c5-4d59-8ce9-b58fb98d9dac None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:34:14.722363 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:34:14.810530 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e032ebaf-0a6c-4d3b-9fb7-137da83555d3 None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:34:14.811675 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bacf7f1-66c5-4d59-8ce9-b58fb98d9dac None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:34:14.848088 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa77625-220f-4c31-94bd-212e8153083c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:34:14.848886 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa77625-220f-4c31-94bd-212e8153083c None admin] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:14.849146 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb53c02b-59ae-4ad2-bcc9-09879290f302 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:34:14.849358 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa77625-220f-4c31-94bd-212e8153083c None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:14.849726 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa77625-220f-4c31-94bd-212e8153083c None admin] PATH_INFO: `/v3/users` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:14.850260 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb53c02b-59ae-4ad2-bcc9-09879290f302 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:14.850620 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa77625-220f-4c31-94bd-212e8153083c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:34:14.850884 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb53c02b-59ae-4ad2-bcc9-09879290f302 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:14.851300 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb53c02b-59ae-4ad2-bcc9-09879290f302 None admin] PATH_INFO: `/v3/roles` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:14.852123 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb53c02b-59ae-4ad2-bcc9-09879290f302 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=88113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:34:14.852409 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa77625-220f-4c31-94bd-212e8153083c None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:34:14.852739 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb53c02b-59ae-4ad2-bcc9-09879290f302 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:34:14.854302 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb53c02b-59ae-4ad2-bcc9-09879290f302 None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:34:14.857030 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:34:14.869363 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 489/966] 10.222.0.26 () {56 vars in 1115 bytes} [Wed Aug 24 05:34:14 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:34:14.870674 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb53c02b-59ae-4ad2-bcc9-09879290f302 None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:34:14.871411 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.sql.core [None req-5fa77625-220f-4c31-94bd-212e8153083c None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 24 05:34:14.871411 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 24 05:34:14.871411 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [parameters: {'user_id': '3bf887eec6a84eab825fc26978d6015d', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 24 05:34:14.871411 dv-cinder-854268-1-smb devstack@keystone.service[88112]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=88112) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 24 05:34:14.878811 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application [None req-5fa77625-220f-4c31-94bd-212e8153083c None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 24 05:34:14.878811 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:34:14.878811 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 24 05:34:14.878811 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 24 05:34:14.878811 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 24 05:34:14.878811 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 24 05:34:14.878811 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 24 05:34:14.878811 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application result = self._query(query) Aug 24 05:34:14.878811 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 24 05:34:14.878811 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application conn.query(q) Aug 24 05:34:14.878811 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 24 05:34:14.878811 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 24 05:34:14.878811 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 24 05:34:14.878811 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application result.read() Aug 24 05:34:14.878811 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 24 05:34:14.880015 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 24 05:34:14.880015 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 24 05:34:14.880015 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 24 05:34:14.880015 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 24 05:34:14.880015 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 24 05:34:14.880015 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 24 05:34:14.880015 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 24 05:34:14.880015 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 24 05:34:14.880015 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Aug 24 05:34:14.880015 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 24 05:34:14.880015 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Aug 24 05:34:14.880015 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:34:14.880015 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 24 05:34:14.880015 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 24 05:34:14.880015 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Aug 24 05:34:14.880015 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Aug 24 05:34:14.880015 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 24 05:34:14.880015 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application next(self.gen) Aug 24 05:34:14.881257 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 24 05:34:14.881257 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application yield resource Aug 24 05:34:14.881257 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 24 05:34:14.881257 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application next(self.gen) Aug 24 05:34:14.881257 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 24 05:34:14.881257 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application self.session.rollback() Aug 24 05:34:14.881257 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 24 05:34:14.881257 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application self.force_reraise() Aug 24 05:34:14.881257 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 24 05:34:14.881257 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application raise self.value Aug 24 05:34:14.881257 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 24 05:34:14.881257 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 24 05:34:14.881257 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 24 05:34:14.881257 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application session.commit() Aug 24 05:34:14.881257 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 24 05:34:14.881257 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 24 05:34:14.881257 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 24 05:34:14.882437 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application self._prepare_impl() Aug 24 05:34:14.882437 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 24 05:34:14.882437 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application self.session.flush() Aug 24 05:34:14.882437 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 24 05:34:14.882437 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application self._flush(objects) Aug 24 05:34:14.882437 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 24 05:34:14.882437 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 24 05:34:14.882437 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 24 05:34:14.882437 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application compat.raise_( Aug 24 05:34:14.882437 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 24 05:34:14.882437 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application raise exception Aug 24 05:34:14.882437 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 24 05:34:14.882437 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application flush_context.execute() Aug 24 05:34:14.882437 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 24 05:34:14.882437 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application rec.execute(self) Aug 24 05:34:14.882437 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 24 05:34:14.882437 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 24 05:34:14.883587 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 24 05:34:14.883587 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 24 05:34:14.883587 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 24 05:34:14.883587 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application result = connection._execute_20( Aug 24 05:34:14.883587 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 24 05:34:14.883587 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 24 05:34:14.883587 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 24 05:34:14.883587 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 24 05:34:14.883587 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 24 05:34:14.883587 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 24 05:34:14.883587 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 24 05:34:14.883587 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 24 05:34:14.883587 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 24 05:34:14.883587 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 24 05:34:14.883587 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 24 05:34:14.883587 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application raise exception Aug 24 05:34:14.884670 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 24 05:34:14.884670 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 24 05:34:14.884670 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 24 05:34:14.884670 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 24 05:34:14.884670 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 24 05:34:14.884670 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application result = self._query(query) Aug 24 05:34:14.884670 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 24 05:34:14.884670 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application conn.query(q) Aug 24 05:34:14.884670 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 24 05:34:14.884670 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 24 05:34:14.884670 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 24 05:34:14.884670 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application result.read() Aug 24 05:34:14.884670 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 24 05:34:14.884670 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 24 05:34:14.884670 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 24 05:34:14.884670 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 24 05:34:14.885723 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 24 05:34:14.885723 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 24 05:34:14.885723 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 24 05:34:14.885723 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 24 05:34:14.885723 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 24 05:34:14.885723 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 24 05:34:14.885723 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application [parameters: {'user_id': '3bf887eec6a84eab825fc26978d6015d', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 24 05:34:14.885723 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 24 05:34:14.885723 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Aug 24 05:34:14.885723 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 05:34:14.885723 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Aug 24 05:34:14.885723 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:34:14.885723 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:34:14.885723 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:34:14.885723 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:34:14.886843 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:34:14.886843 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:34:14.886843 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:34:14.886843 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:34:14.886843 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:34:14.886843 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:34:14.886843 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:34:14.886843 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 24 05:34:14.886843 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 24 05:34:14.886843 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:34:14.886843 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:34:14.886843 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 05:34:14.886843 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 05:34:14.886843 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 05:34:14.886843 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 05:34:14.886843 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Aug 24 05:34:14.886843 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Aug 24 05:34:14.891608 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Aug 24 05:34:14.891608 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Aug 24 05:34:14.891608 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 24 05:34:14.891608 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 24 05:34:14.891608 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 24 05:34:14.891608 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Aug 24 05:34:14.893342 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 478/967] 10.222.0.26 () {60 vars in 1131 bytes} [Wed Aug 24 05:34:14 2022] POST /identity/v3/users => generated 160 bytes in 190 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:34:14.895416 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa77625-220f-4c31-94bd-212e8153083c None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:34:14.985139 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:34:14.988545 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb53c02b-59ae-4ad2-bcc9-09879290f302 None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:34:15.007238 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa77625-220f-4c31-94bd-212e8153083c None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:34:15.024584 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efa13bf-ecbc-48d0-ad57-813d5f72938b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:34:15.025205 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efa13bf-ecbc-48d0-ad57-813d5f72938b None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:15.025489 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efa13bf-ecbc-48d0-ad57-813d5f72938b None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:15.025763 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efa13bf-ecbc-48d0-ad57-813d5f72938b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:15.036041 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efa13bf-ecbc-48d0-ad57-813d5f72938b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:34:15.037486 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efa13bf-ecbc-48d0-ad57-813d5f72938b None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:34:15.043871 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230dc6ff-5824-4312-84ae-060364efb6e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:34:15.044602 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230dc6ff-5824-4312-84ae-060364efb6e5 None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:15.044877 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230dc6ff-5824-4312-84ae-060364efb6e5 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:15.045145 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230dc6ff-5824-4312-84ae-060364efb6e5 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:15.051432 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application [None req-0efa13bf-ecbc-48d0-ad57-813d5f72938b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:34:15.051432 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:34:15.051432 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:34:15.051432 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:34:15.051432 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:34:15.051432 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:34:15.051432 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:34:15.051432 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:34:15.051432 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:34:15.051432 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:34:15.051432 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:34:15.051432 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:34:15.051432 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 05:34:15.051432 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 05:34:15.051432 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 05:34:15.051432 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 05:34:15.052383 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:34:15.052383 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:34:15.052383 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:34:15.052383 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:34:15.052383 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:34:15.052383 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:34:15.052383 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:34:15.052383 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application with Lock( Aug 24 05:34:15.052383 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:34:15.052383 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:34:15.052383 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:34:15.052383 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:34:15.052383 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:34:15.052383 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:34:15.052383 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:34:15.052383 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:34:15.052383 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 05:34:15.053338 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 05:34:15.053338 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:34:15.053338 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Aug 24 05:34:15.053338 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 490/968] 10.222.0.26 () {56 vars in 1108 bytes} [Wed Aug 24 05:34:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:34:15.054047 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88063d99-4f3b-4405-8143-2fff38092fec None None] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:15.054047 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88063d99-4f3b-4405-8143-2fff38092fec None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:15.054223 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88063d99-4f3b-4405-8143-2fff38092fec None None] PATH_INFO: `/` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:15.055573 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 491/969] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 24 05:34:15 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:34:15.059474 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230dc6ff-5824-4312-84ae-060364efb6e5 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:34:15.059621 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88063d99-4f3b-4405-8143-2fff38092fec None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:34:15.060294 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230dc6ff-5824-4312-84ae-060364efb6e5 None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:34:15.073260 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application [None req-230dc6ff-5824-4312-84ae-060364efb6e5 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 05:34:15.073260 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:34:15.073260 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:34:15.073260 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:34:15.073260 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:34:15.073260 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:34:15.073260 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:34:15.073260 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:34:15.073260 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:34:15.073260 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:34:15.073260 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:34:15.073260 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:34:15.073260 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 05:34:15.073260 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 05:34:15.073260 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 05:34:15.073260 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 05:34:15.074458 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:34:15.074458 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:34:15.074458 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 05:34:15.074458 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 05:34:15.074458 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 05:34:15.074458 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 05:34:15.074458 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:34:15.074458 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:34:15.074458 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:34:15.074458 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:34:15.074458 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:34:15.074458 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application with Lock( Aug 24 05:34:15.074458 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:34:15.074458 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:34:15.074458 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:34:15.074458 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:34:15.074458 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:34:15.074458 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:34:15.075416 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:34:15.075416 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:34:15.075416 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 05:34:15.075416 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 05:34:15.075416 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 05:34:15.075416 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 05:34:15.075416 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 05:34:15.075416 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 05:34:15.075416 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 05:34:15.075416 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Aug 24 05:34:15.078107 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 479/970] 10.222.0.26 () {56 vars in 1099 bytes} [Wed Aug 24 05:34:14 2022] GET /identity/v3/users/cinder => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 05:34:15.079549 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb26f0bc-84e5-425e-bf57-1805db6d40c0 None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:15.079839 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb26f0bc-84e5-425e-bf57-1805db6d40c0 None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:15.080109 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb26f0bc-84e5-425e-bf57-1805db6d40c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:15.099993 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-bb26f0bc-84e5-425e-bf57-1805db6d40c0 None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:34:15.101734 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-bb26f0bc-84e5-425e-bf57-1805db6d40c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:34:15.116714 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:34:15.169744 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88063d99-4f3b-4405-8143-2fff38092fec None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:34:15.183379 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 480/971] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 24 05:34:15 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 05:34:15.184515 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb26f0bc-84e5-425e-bf57-1805db6d40c0 None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:34:15.214603 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f85006-b12c-4c06-90b0-825884c90039 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:34:15.215603 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f85006-b12c-4c06-90b0-825884c90039 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:15.216236 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f85006-b12c-4c06-90b0-825884c90039 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:15.216737 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f85006-b12c-4c06-90b0-825884c90039 None admin] PATH_INFO: `/v3/domains` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:15.217717 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f85006-b12c-4c06-90b0-825884c90039 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:34:15.218302 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f85006-b12c-4c06-90b0-825884c90039 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:34:15.220111 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f85006-b12c-4c06-90b0-825884c90039 None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:34:15.238728 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 492/972] 10.222.0.26 () {56 vars in 1109 bytes} [Wed Aug 24 05:34:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:34:15.240035 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f85006-b12c-4c06-90b0-825884c90039 None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:34:15.256741 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:34:15.288346 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb26f0bc-84e5-425e-bf57-1805db6d40c0 None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:34:15.324009 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d75487e-7237-425c-9dee-f34aba23a3d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:34:15.324617 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d75487e-7237-425c-9dee-f34aba23a3d2 None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:15.324846 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d75487e-7237-425c-9dee-f34aba23a3d2 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:15.325081 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d75487e-7237-425c-9dee-f34aba23a3d2 None admin] PATH_INFO: `/v3/users` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:15.325788 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d75487e-7237-425c-9dee-f34aba23a3d2 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=88112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:34:15.326123 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d75487e-7237-425c-9dee-f34aba23a3d2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:34:15.328318 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d75487e-7237-425c-9dee-f34aba23a3d2 None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:34:15.356485 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f85006-b12c-4c06-90b0-825884c90039 None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:34:15.366734 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 481/973] 10.222.0.26 () {56 vars in 1101 bytes} [Wed Aug 24 05:34:15 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:34:15.369821 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:34:15.402705 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46da2065-ba21-46a6-b56c-f35069dfc62e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:34:15.403357 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46da2065-ba21-46a6-b56c-f35069dfc62e None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:15.403637 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46da2065-ba21-46a6-b56c-f35069dfc62e None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:15.403909 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46da2065-ba21-46a6-b56c-f35069dfc62e None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:15.412733 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46da2065-ba21-46a6-b56c-f35069dfc62e None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:34:15.414335 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46da2065-ba21-46a6-b56c-f35069dfc62e None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:34:15.429686 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application [None req-46da2065-ba21-46a6-b56c-f35069dfc62e None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 05:34:15.429686 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:34:15.429686 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:34:15.429686 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:34:15.429686 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:34:15.429686 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:34:15.429686 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:34:15.429686 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:34:15.429686 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:34:15.429686 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:34:15.429686 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:34:15.429686 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:34:15.429686 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 05:34:15.429686 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 05:34:15.429686 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 05:34:15.429686 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 05:34:15.430909 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:34:15.430909 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:34:15.430909 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 05:34:15.430909 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 05:34:15.430909 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 05:34:15.430909 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 05:34:15.430909 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:34:15.430909 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:34:15.430909 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:34:15.430909 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:34:15.430909 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:34:15.430909 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application with Lock( Aug 24 05:34:15.430909 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:34:15.430909 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:34:15.430909 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:34:15.430909 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:34:15.430909 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:34:15.430909 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:34:15.432105 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:34:15.432105 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:34:15.432105 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 05:34:15.432105 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 05:34:15.432105 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 05:34:15.432105 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 05:34:15.432105 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 05:34:15.432105 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 05:34:15.432105 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 05:34:15.432105 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Aug 24 05:34:15.432105 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 493/974] 10.222.0.26 () {56 vars in 1117 bytes} [Wed Aug 24 05:34:15 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:34:15.440798 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d75487e-7237-425c-9dee-f34aba23a3d2 None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:34:15.481249 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46da2065-ba21-46a6-b56c-f35069dfc62e None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:34:15.559033 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d75487e-7237-425c-9dee-f34aba23a3d2 None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:34:15.591794 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:34:15.603873 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e2ce51-eb2c-4a94-a7ba-78ed73ed1f99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:34:15.605064 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e2ce51-eb2c-4a94-a7ba-78ed73ed1f99 None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:15.605364 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e2ce51-eb2c-4a94-a7ba-78ed73ed1f99 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:15.605648 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e2ce51-eb2c-4a94-a7ba-78ed73ed1f99 None admin] PATH_INFO: `/v3/users` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:15.607207 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e2ce51-eb2c-4a94-a7ba-78ed73ed1f99 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=88112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:34:15.607516 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e2ce51-eb2c-4a94-a7ba-78ed73ed1f99 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:34:15.609565 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e2ce51-eb2c-4a94-a7ba-78ed73ed1f99 None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:34:15.612134 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46da2065-ba21-46a6-b56c-f35069dfc62e None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:34:15.629552 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 482/975] 10.222.0.26 () {56 vars in 1149 bytes} [Wed Aug 24 05:34:15 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:34:15.635768 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e2ce51-eb2c-4a94-a7ba-78ed73ed1f99 None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:34:15.663866 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d5ef6d-5e61-4fc0-baf8-577e2cfbaae9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:34:15.663866 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d5ef6d-5e61-4fc0-baf8-577e2cfbaae9 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:15.663866 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d5ef6d-5e61-4fc0-baf8-577e2cfbaae9 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:15.663866 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d5ef6d-5e61-4fc0-baf8-577e2cfbaae9 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:15.664467 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d5ef6d-5e61-4fc0-baf8-577e2cfbaae9 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:34:15.665849 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d5ef6d-5e61-4fc0-baf8-577e2cfbaae9 None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:34:15.674959 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application [None req-82d5ef6d-5e61-4fc0-baf8-577e2cfbaae9 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 05:34:15.674959 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:34:15.674959 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 05:34:15.674959 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 05:34:15.674959 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 05:34:15.674959 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 05:34:15.674959 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 05:34:15.674959 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 05:34:15.674959 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 05:34:15.674959 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Aug 24 05:34:15.674959 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 05:34:15.674959 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Aug 24 05:34:15.674959 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:34:15.674959 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:34:15.674959 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:34:15.674959 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:34:15.674959 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:34:15.675977 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:34:15.675977 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:34:15.675977 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:34:15.675977 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:34:15.675977 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:34:15.675977 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:34:15.675977 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 05:34:15.675977 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 05:34:15.675977 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 05:34:15.675977 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 05:34:15.675977 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:34:15.675977 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:34:15.675977 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:34:15.675977 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:34:15.675977 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:34:15.675977 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:34:15.676810 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:34:15.676810 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application with Lock( Aug 24 05:34:15.676810 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:34:15.676810 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:34:15.676810 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:34:15.676810 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:34:15.676810 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:34:15.676810 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:34:15.676810 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:34:15.676810 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:34:15.676810 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 05:34:15.676810 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 05:34:15.676810 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 05:34:15.676810 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Aug 24 05:34:15.676810 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 494/976] 10.222.0.26 () {56 vars in 1126 bytes} [Wed Aug 24 05:34:15 2022] GET /identity/v3/services/object-store => generated 93 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:34:15.681806 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d5ef6d-5e61-4fc0-baf8-577e2cfbaae9 None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:34:15.719140 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:34:15.749711 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e2ce51-eb2c-4a94-a7ba-78ed73ed1f99 None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:34:15.782728 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f39361-ab69-4356-bc38-80fdcbe1b0d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:34:15.783326 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f39361-ab69-4356-bc38-80fdcbe1b0d8 None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:15.783600 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f39361-ab69-4356-bc38-80fdcbe1b0d8 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:15.783866 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f39361-ab69-4356-bc38-80fdcbe1b0d8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:15.785341 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d5ef6d-5e61-4fc0-baf8-577e2cfbaae9 None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:34:15.818483 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca3270e-d90a-41fa-831d-08d0c9ed6a66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:34:15.819076 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca3270e-d90a-41fa-831d-08d0c9ed6a66 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:15.819349 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca3270e-d90a-41fa-831d-08d0c9ed6a66 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:15.819611 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca3270e-d90a-41fa-831d-08d0c9ed6a66 None admin] PATH_INFO: `/v3/services` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:15.820224 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca3270e-d90a-41fa-831d-08d0c9ed6a66 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=88113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:34:15.820520 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca3270e-d90a-41fa-831d-08d0c9ed6a66 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:34:15.821896 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca3270e-d90a-41fa-831d-08d0c9ed6a66 None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:34:15.826406 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 495/977] 10.222.0.26 () {56 vars in 1122 bytes} [Wed Aug 24 05:34:15 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:34:15.828158 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba36b4c8-a50c-479f-88ca-a438e1860043 None None] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:15.828447 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba36b4c8-a50c-479f-88ca-a438e1860043 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:15.828723 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba36b4c8-a50c-479f-88ca-a438e1860043 None None] PATH_INFO: `/` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:15.833828 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 496/978] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 24 05:34:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:34:15.833828 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba36b4c8-a50c-479f-88ca-a438e1860043 None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:34:15.843077 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:34:15.856728 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f39361-ab69-4356-bc38-80fdcbe1b0d8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:34:15.858778 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f39361-ab69-4356-bc38-80fdcbe1b0d8 None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:34:15.929305 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:34:15.934226 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba36b4c8-a50c-479f-88ca-a438e1860043 None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:34:15.957244 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 483/979] 10.222.0.26 () {58 vars in 1282 bytes} [Wed Aug 24 05:34:15 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 05:34:15.958663 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e0ebb2-3594-4aac-8761-1d02911be7a2 None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:15.958950 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e0ebb2-3594-4aac-8761-1d02911be7a2 None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:15.959220 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e0ebb2-3594-4aac-8761-1d02911be7a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:15.969041 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2be439-dbf9-472e-8b0c-fe3ff14c784f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:34:15.969645 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2be439-dbf9-472e-8b0c-fe3ff14c784f None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:15.969924 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2be439-dbf9-472e-8b0c-fe3ff14c784f None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:15.970297 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2be439-dbf9-472e-8b0c-fe3ff14c784f None admin] PATH_INFO: `/v3/services` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:15.970930 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2be439-dbf9-472e-8b0c-fe3ff14c784f None admin] RBAC: Adding query filter params (type=object-store) {{(pid=88113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:34:15.971237 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2be439-dbf9-472e-8b0c-fe3ff14c784f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:34:15.972593 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2be439-dbf9-472e-8b0c-fe3ff14c784f None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:34:15.976355 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-97e0ebb2-3594-4aac-8761-1d02911be7a2 None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:34:15.977288 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 497/980] 10.222.0.26 () {56 vars in 1122 bytes} [Wed Aug 24 05:34:15 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:34:15.977532 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-97e0ebb2-3594-4aac-8761-1d02911be7a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:34:15.978084 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2be439-dbf9-472e-8b0c-fe3ff14c784f None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:34:16.044458 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 484/981] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 24 05:34:15 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 05:34:16.045301 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e0ebb2-3594-4aac-8761-1d02911be7a2 None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:34:16.062057 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:34:16.077202 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2be439-dbf9-472e-8b0c-fe3ff14c784f None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:34:16.112708 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5633eebd-7241-4f71-ab00-eed6e8a66ed5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:34:16.113266 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5633eebd-7241-4f71-ab00-eed6e8a66ed5 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:16.113543 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5633eebd-7241-4f71-ab00-eed6e8a66ed5 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:16.113837 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5633eebd-7241-4f71-ab00-eed6e8a66ed5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:16.124191 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5633eebd-7241-4f71-ab00-eed6e8a66ed5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:34:16.125623 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5633eebd-7241-4f71-ab00-eed6e8a66ed5 None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:34:16.139782 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application [None req-5633eebd-7241-4f71-ab00-eed6e8a66ed5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:34:16.139782 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:34:16.139782 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:34:16.139782 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:34:16.139782 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:34:16.139782 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:34:16.139782 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:34:16.139782 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:34:16.139782 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:34:16.139782 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:34:16.139782 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:34:16.139782 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:34:16.139782 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 05:34:16.139782 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 05:34:16.139782 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 05:34:16.139782 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 05:34:16.140706 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:34:16.140706 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:34:16.140706 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:34:16.140706 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:34:16.140706 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:34:16.140706 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:34:16.140706 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:34:16.140706 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application with Lock( Aug 24 05:34:16.140706 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:34:16.140706 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:34:16.140706 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:34:16.140706 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:34:16.140706 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:34:16.140706 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:34:16.140706 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:34:16.140706 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:34:16.140706 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 05:34:16.141596 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 05:34:16.141596 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:34:16.141596 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Aug 24 05:34:16.141596 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 498/982] 10.222.0.26 () {56 vars in 1108 bytes} [Wed Aug 24 05:34:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:34:16.146412 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5633eebd-7241-4f71-ab00-eed6e8a66ed5 None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:34:16.150184 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e0ebb2-3594-4aac-8761-1d02911be7a2 None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:34:16.162523 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:34:16.186152 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e217d9f-f504-4647-9f52-1084150546a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:34:16.186757 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e217d9f-f504-4647-9f52-1084150546a8 None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:16.187031 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e217d9f-f504-4647-9f52-1084150546a8 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:16.187296 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e217d9f-f504-4647-9f52-1084150546a8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:16.188020 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e217d9f-f504-4647-9f52-1084150546a8 None admin] RBAC: Adding query filter params (interface=admin, service_id=3f237bfb473b40f78a56fdc1af76b3ef, region_id=RegionOne) {{(pid=88112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:34:16.188379 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e217d9f-f504-4647-9f52-1084150546a8 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:34:16.189733 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e217d9f-f504-4647-9f52-1084150546a8 None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:34:16.195003 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 485/983] 10.222.0.26 () {56 vars in 1249 bytes} [Wed Aug 24 05:34:16 2022] GET /identity/v3/endpoints?service_id=3f237bfb473b40f78a56fdc1af76b3ef&interface=admin®ion_id=RegionOne => generated 193 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:34:16.200483 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e217d9f-f504-4647-9f52-1084150546a8 None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:34:16.250955 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5633eebd-7241-4f71-ab00-eed6e8a66ed5 None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:34:16.282068 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:34:16.285518 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2f9047-e475-4d71-9086-ed3865d95f74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:34:16.286147 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2f9047-e475-4d71-9086-ed3865d95f74 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:16.286427 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2f9047-e475-4d71-9086-ed3865d95f74 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:16.286696 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2f9047-e475-4d71-9086-ed3865d95f74 None admin] PATH_INFO: `/v3/domains` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:16.287339 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2f9047-e475-4d71-9086-ed3865d95f74 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:34:16.287641 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2f9047-e475-4d71-9086-ed3865d95f74 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:34:16.289014 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2f9047-e475-4d71-9086-ed3865d95f74 None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:34:16.304803 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 499/984] 10.222.0.26 () {56 vars in 1109 bytes} [Wed Aug 24 05:34:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:34:16.307239 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e217d9f-f504-4647-9f52-1084150546a8 None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:34:16.310047 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2f9047-e475-4d71-9086-ed3865d95f74 None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:34:16.341898 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c192325-00e1-416d-b24d-9c143fc4feb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:34:16.342573 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c192325-00e1-416d-b24d-9c143fc4feb5 None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:16.342834 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c192325-00e1-416d-b24d-9c143fc4feb5 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:16.343102 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c192325-00e1-416d-b24d-9c143fc4feb5 None admin] PATH_INFO: `/v3/services` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:16.343695 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c192325-00e1-416d-b24d-9c143fc4feb5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:34:16.345050 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c192325-00e1-416d-b24d-9c143fc4feb5 None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:34:16.350857 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 486/985] 10.222.0.26 () {56 vars in 1087 bytes} [Wed Aug 24 05:34:16 2022] GET /identity/v3/services => generated 1497 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 05:34:16.351611 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c192325-00e1-416d-b24d-9c143fc4feb5 None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:34:16.391875 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:34:16.425547 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2f9047-e475-4d71-9086-ed3865d95f74 None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:34:16.463812 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60be268f-06e4-49b7-ba94-32e069d6e5b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:34:16.464488 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c192325-00e1-416d-b24d-9c143fc4feb5 None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:34:16.464601 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60be268f-06e4-49b7-ba94-32e069d6e5b1 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:16.464787 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60be268f-06e4-49b7-ba94-32e069d6e5b1 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:16.465037 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60be268f-06e4-49b7-ba94-32e069d6e5b1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:16.472877 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60be268f-06e4-49b7-ba94-32e069d6e5b1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:34:16.474391 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60be268f-06e4-49b7-ba94-32e069d6e5b1 None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:34:16.486788 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application [None req-60be268f-06e4-49b7-ba94-32e069d6e5b1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 05:34:16.486788 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:34:16.486788 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:34:16.486788 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:34:16.486788 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:34:16.486788 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:34:16.486788 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:34:16.486788 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:34:16.486788 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:34:16.486788 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:34:16.486788 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:34:16.486788 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:34:16.486788 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 05:34:16.486788 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 05:34:16.486788 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 05:34:16.487764 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 05:34:16.487764 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:34:16.487764 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:34:16.487764 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:34:16.487764 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:34:16.487764 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:34:16.487764 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:34:16.487764 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:34:16.487764 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application with Lock( Aug 24 05:34:16.487764 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:34:16.487764 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:34:16.487764 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:34:16.487764 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:34:16.487764 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:34:16.487764 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:34:16.487764 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:34:16.487764 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:34:16.488723 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 05:34:16.488723 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 05:34:16.488723 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 05:34:16.488723 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 05:34:16.488723 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 05:34:16.488723 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 05:34:16.488723 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 05:34:16.488723 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Aug 24 05:34:16.492859 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 500/986] 10.222.0.26 () {56 vars in 1111 bytes} [Wed Aug 24 05:34:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 05:34:16.494588 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60be268f-06e4-49b7-ba94-32e069d6e5b1 None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:34:16.506954 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d0208d-686b-43c0-9c77-c945b6202cbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:34:16.507570 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d0208d-686b-43c0-9c77-c945b6202cbc None admin] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:16.507856 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d0208d-686b-43c0-9c77-c945b6202cbc None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:16.508134 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d0208d-686b-43c0-9c77-c945b6202cbc None admin] PATH_INFO: `/v3/services` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:16.508828 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d0208d-686b-43c0-9c77-c945b6202cbc None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:34:16.510292 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d0208d-686b-43c0-9c77-c945b6202cbc None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:34:16.527015 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 487/987] 10.222.0.26 () {60 vars in 1141 bytes} [Wed Aug 24 05:34:16 2022] POST /identity/v3/services => generated 242 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:34:16.619500 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60be268f-06e4-49b7-ba94-32e069d6e5b1 None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:34:16.656719 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:34:16.665055 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662cc7d7-26ac-4629-9ca1-2d93eaff236a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:34:16.665671 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662cc7d7-26ac-4629-9ca1-2d93eaff236a None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:16.665978 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662cc7d7-26ac-4629-9ca1-2d93eaff236a None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:16.666244 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662cc7d7-26ac-4629-9ca1-2d93eaff236a None admin] PATH_INFO: `/v3/projects` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:16.667071 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662cc7d7-26ac-4629-9ca1-2d93eaff236a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:34:16.667267 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662cc7d7-26ac-4629-9ca1-2d93eaff236a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:34:16.668711 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662cc7d7-26ac-4629-9ca1-2d93eaff236a None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:34:16.683446 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 501/988] 10.222.0.26 () {56 vars in 1148 bytes} [Wed Aug 24 05:34:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:34:16.689643 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d0208d-686b-43c0-9c77-c945b6202cbc None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:34:16.693933 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:34:16.799129 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d0208d-686b-43c0-9c77-c945b6202cbc None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:34:16.832130 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c577ce-8fcc-430a-8bff-aa25609b5ca0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:34:16.832736 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c577ce-8fcc-430a-8bff-aa25609b5ca0 None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:16.833012 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c577ce-8fcc-430a-8bff-aa25609b5ca0 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:16.833279 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c577ce-8fcc-430a-8bff-aa25609b5ca0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:16.834016 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c577ce-8fcc-430a-8bff-aa25609b5ca0 None admin] RBAC: Adding query filter params (role.id=bc599913e28e42089c8030b72de2de1f, scope.project.id=ded4fe81d4dc43188dd84e53025ee783, user.id=6c2c08b27a0f4943b5da908eb7b1cd96) {{(pid=88112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:34:16.834322 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c577ce-8fcc-430a-8bff-aa25609b5ca0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:34:16.835726 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c577ce-8fcc-430a-8bff-aa25609b5ca0 None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:34:16.841619 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 488/989] 10.222.0.26 () {56 vars in 1374 bytes} [Wed Aug 24 05:34:16 2022] GET /identity/v3/role_assignments?user.id=6c2c08b27a0f4943b5da908eb7b1cd96&scope.project.id=ded4fe81d4dc43188dd84e53025ee783&role.id=bc599913e28e42089c8030b72de2de1f => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:34:18.254334 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5601dbe4-edc3-4a56-993e-80e646db86a7 None None] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:18.254864 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5601dbe4-edc3-4a56-993e-80e646db86a7 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:18.254864 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5601dbe4-edc3-4a56-993e-80e646db86a7 None None] PATH_INFO: `/` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:18.256240 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 502/990] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 24 05:34:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:34:18.261464 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e719a4-e708-44b7-ad0a-dfc494dc1eff None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:18.261911 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e719a4-e708-44b7-ad0a-dfc494dc1eff None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:18.262081 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e719a4-e708-44b7-ad0a-dfc494dc1eff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:18.281448 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-95e719a4-e708-44b7-ad0a-dfc494dc1eff None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:34:18.282661 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-95e719a4-e708-44b7-ad0a-dfc494dc1eff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:34:18.346615 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:34:18.352976 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 489/991] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 24 05:34:18 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 05:34:18.452311 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f754d6-60e9-4cca-8256-f267add2bc81 None None] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:18.452651 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f754d6-60e9-4cca-8256-f267add2bc81 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:18.452871 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f754d6-60e9-4cca-8256-f267add2bc81 None None] PATH_INFO: `/` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:18.454382 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 503/992] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 24 05:34:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:34:18.459501 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d83aee-7fd2-4a07-9b60-b87b525a692a None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:18.459799 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d83aee-7fd2-4a07-9b60-b87b525a692a None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:18.460079 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d83aee-7fd2-4a07-9b60-b87b525a692a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:18.478207 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-30d83aee-7fd2-4a07-9b60-b87b525a692a None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:34:18.479391 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-30d83aee-7fd2-4a07-9b60-b87b525a692a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:34:18.557510 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 490/993] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 24 05:34:18 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 05:34:18.618260 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f754d6-60e9-4cca-8256-f267add2bc81 None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:34:18.721306 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f754d6-60e9-4cca-8256-f267add2bc81 None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:34:18.748407 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4641e8f8-8a97-4a3a-bec5-f8730ded6e81 None None] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:18.748697 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4641e8f8-8a97-4a3a-bec5-f8730ded6e81 None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:18.748970 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4641e8f8-8a97-4a3a-bec5-f8730ded6e81 None None] PATH_INFO: `/` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:18.750582 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 491/994] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 24 05:34:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 05:34:18.755495 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36fc149-e580-469a-80fd-9cf4196a878e None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:18.755779 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36fc149-e580-469a-80fd-9cf4196a878e None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:18.755960 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d0be36-829a-44fa-abcd-8c11ff17b000 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:34:18.756115 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36fc149-e580-469a-80fd-9cf4196a878e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:18.756576 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d0be36-829a-44fa-abcd-8c11ff17b000 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:18.756854 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d0be36-829a-44fa-abcd-8c11ff17b000 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:18.757122 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d0be36-829a-44fa-abcd-8c11ff17b000 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:18.757699 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d0be36-829a-44fa-abcd-8c11ff17b000 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:34:18.759094 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d0be36-829a-44fa-abcd-8c11ff17b000 None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:34:18.767840 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application [None req-92d0be36-829a-44fa-abcd-8c11ff17b000 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 05:34:18.767840 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:34:18.767840 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 05:34:18.767840 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 05:34:18.767840 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 05:34:18.767840 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 05:34:18.767840 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 05:34:18.767840 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 05:34:18.767840 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 05:34:18.767840 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Aug 24 05:34:18.767840 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 05:34:18.767840 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Aug 24 05:34:18.767840 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:34:18.767840 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:34:18.767840 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:34:18.767840 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:34:18.767840 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:34:18.768858 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:34:18.768858 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:34:18.768858 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:34:18.768858 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:34:18.768858 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:34:18.768858 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:34:18.768858 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 05:34:18.768858 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 05:34:18.768858 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 05:34:18.768858 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 05:34:18.768858 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:34:18.768858 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:34:18.768858 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:34:18.768858 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:34:18.768858 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:34:18.768858 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:34:18.769711 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:34:18.769711 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application with Lock( Aug 24 05:34:18.769711 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:34:18.769711 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:34:18.769711 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:34:18.769711 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:34:18.769711 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:34:18.769711 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:34:18.769711 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:34:18.769711 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:34:18.769711 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 05:34:18.769711 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 05:34:18.769711 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 05:34:18.769711 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Aug 24 05:34:18.769711 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 504/995] 10.222.0.26 () {56 vars in 1126 bytes} [Wed Aug 24 05:34:18 2022] GET /identity/v3/services/object-store => generated 93 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:34:18.774668 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d0be36-829a-44fa-abcd-8c11ff17b000 None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:34:18.776700 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-a36fc149-e580-469a-80fd-9cf4196a878e None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:34:18.777881 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-a36fc149-e580-469a-80fd-9cf4196a878e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:34:18.837487 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:34:18.847778 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 492/996] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 24 05:34:18 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 05:34:18.848631 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36fc149-e580-469a-80fd-9cf4196a878e None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:34:18.885280 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d0be36-829a-44fa-abcd-8c11ff17b000 None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:34:18.910651 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:34:18.923212 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b2e7ad-e4ec-4420-b876-2699e38e85c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:34:18.923826 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b2e7ad-e4ec-4420-b876-2699e38e85c8 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:18.924099 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b2e7ad-e4ec-4420-b876-2699e38e85c8 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:18.924378 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b2e7ad-e4ec-4420-b876-2699e38e85c8 None admin] PATH_INFO: `/v3/services` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:18.925005 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b2e7ad-e4ec-4420-b876-2699e38e85c8 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=88113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:34:18.925306 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b2e7ad-e4ec-4420-b876-2699e38e85c8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:34:18.926709 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b2e7ad-e4ec-4420-b876-2699e38e85c8 None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:34:18.931802 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 505/997] 10.222.0.26 () {56 vars in 1122 bytes} [Wed Aug 24 05:34:18 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:34:18.937261 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b2e7ad-e4ec-4420-b876-2699e38e85c8 None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:34:18.962682 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36fc149-e580-469a-80fd-9cf4196a878e None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:34:18.999213 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150a4d9b-c5f3-4ea9-b022-f44698c965c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:34:18.999839 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150a4d9b-c5f3-4ea9-b022-f44698c965c8 None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:19.000117 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150a4d9b-c5f3-4ea9-b022-f44698c965c8 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:19.000389 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150a4d9b-c5f3-4ea9-b022-f44698c965c8 None admin] PATH_INFO: `/v3/services/compute` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:19.001070 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150a4d9b-c5f3-4ea9-b022-f44698c965c8 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:34:19.002580 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150a4d9b-c5f3-4ea9-b022-f44698c965c8 None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:34:19.011657 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application [None req-150a4d9b-c5f3-4ea9-b022-f44698c965c8 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 05:34:19.011657 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:34:19.011657 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 05:34:19.011657 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 05:34:19.011657 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 05:34:19.011657 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 05:34:19.011657 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 05:34:19.011657 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 05:34:19.011657 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 05:34:19.011657 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Aug 24 05:34:19.011657 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 05:34:19.011657 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Aug 24 05:34:19.011657 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:34:19.011657 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:34:19.011657 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:34:19.011657 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:34:19.011657 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:34:19.012653 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:34:19.012653 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:34:19.012653 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:34:19.012653 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:34:19.012653 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:34:19.012653 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:34:19.012653 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 05:34:19.012653 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 05:34:19.012653 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 05:34:19.012653 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 05:34:19.012653 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:34:19.012653 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:34:19.012653 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:34:19.012653 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:34:19.012653 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:34:19.012653 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:34:19.018680 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:34:19.018680 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application with Lock( Aug 24 05:34:19.018680 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:34:19.018680 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:34:19.018680 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:34:19.018680 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:34:19.018680 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:34:19.018680 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:34:19.018680 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:34:19.018680 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:34:19.018680 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 05:34:19.018680 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 05:34:19.018680 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 05:34:19.018680 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Aug 24 05:34:19.018680 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 493/998] 10.222.0.26 () {56 vars in 1111 bytes} [Wed Aug 24 05:34:18 2022] GET /identity/v3/services/compute => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:34:19.019486 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150a4d9b-c5f3-4ea9-b022-f44698c965c8 None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:34:19.047118 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b2e7ad-e4ec-4420-b876-2699e38e85c8 None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:34:19.063624 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:34:19.085244 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8807f744-960d-4508-9838-571eac9c1483 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:34:19.085851 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8807f744-960d-4508-9838-571eac9c1483 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:19.086174 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8807f744-960d-4508-9838-571eac9c1483 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:19.086448 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8807f744-960d-4508-9838-571eac9c1483 None admin] PATH_INFO: `/v3/services` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:19.087385 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8807f744-960d-4508-9838-571eac9c1483 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=88113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:34:19.087741 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8807f744-960d-4508-9838-571eac9c1483 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:34:19.089922 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8807f744-960d-4508-9838-571eac9c1483 None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:34:19.096182 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 506/999] 10.222.0.26 () {56 vars in 1122 bytes} [Wed Aug 24 05:34:18 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:34:19.101739 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8807f744-960d-4508-9838-571eac9c1483 None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:34:19.127260 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150a4d9b-c5f3-4ea9-b022-f44698c965c8 None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:34:19.149092 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:34:19.162825 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b320a9e-0317-41e8-976f-d44f87fa7824 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:34:19.163433 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b320a9e-0317-41e8-976f-d44f87fa7824 None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:19.163721 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b320a9e-0317-41e8-976f-d44f87fa7824 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:19.163998 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b320a9e-0317-41e8-976f-d44f87fa7824 None admin] PATH_INFO: `/v3/services` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:19.164631 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b320a9e-0317-41e8-976f-d44f87fa7824 None admin] RBAC: Adding query filter params (name=compute) {{(pid=88112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:34:19.164931 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b320a9e-0317-41e8-976f-d44f87fa7824 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:34:19.166328 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b320a9e-0317-41e8-976f-d44f87fa7824 None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:34:19.171057 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 494/1000] 10.222.0.26 () {56 vars in 1112 bytes} [Wed Aug 24 05:34:19 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:34:19.171836 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b320a9e-0317-41e8-976f-d44f87fa7824 None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:34:19.201187 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8807f744-960d-4508-9838-571eac9c1483 None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:34:19.235987 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31bf288-dc3b-4e46-92d8-faeefae786d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:34:19.236580 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31bf288-dc3b-4e46-92d8-faeefae786d2 None admin] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:19.236856 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31bf288-dc3b-4e46-92d8-faeefae786d2 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:19.237124 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31bf288-dc3b-4e46-92d8-faeefae786d2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:19.237788 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31bf288-dc3b-4e46-92d8-faeefae786d2 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:34:19.239167 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31bf288-dc3b-4e46-92d8-faeefae786d2 None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:34:19.254574 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 507/1001] 10.222.0.26 () {60 vars in 1144 bytes} [Wed Aug 24 05:34:19 2022] POST /identity/v3/endpoints => generated 325 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 05:34:19.255984 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31bf288-dc3b-4e46-92d8-faeefae786d2 None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:34:19.271705 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b320a9e-0317-41e8-976f-d44f87fa7824 None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:34:19.313210 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:34:19.321243 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6376c03-5ae1-42d0-a2f3-5ceb204ebd4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:34:19.322182 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6376c03-5ae1-42d0-a2f3-5ceb204ebd4f None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:19.322491 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6376c03-5ae1-42d0-a2f3-5ceb204ebd4f None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:19.322767 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6376c03-5ae1-42d0-a2f3-5ceb204ebd4f None admin] PATH_INFO: `/v3/services/image` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:19.323371 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6376c03-5ae1-42d0-a2f3-5ceb204ebd4f None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:34:19.324756 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6376c03-5ae1-42d0-a2f3-5ceb204ebd4f None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:34:19.334517 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application [None req-f6376c03-5ae1-42d0-a2f3-5ceb204ebd4f None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 05:34:19.334517 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:34:19.334517 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 05:34:19.334517 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 05:34:19.334517 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 05:34:19.334517 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 05:34:19.334517 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 05:34:19.334517 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 05:34:19.334517 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 05:34:19.334517 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Aug 24 05:34:19.334517 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 05:34:19.334517 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Aug 24 05:34:19.334517 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:34:19.334517 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:34:19.334517 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:34:19.334517 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:34:19.334517 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:34:19.335701 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:34:19.335701 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:34:19.335701 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:34:19.335701 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:34:19.335701 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:34:19.335701 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:34:19.335701 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 05:34:19.335701 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 05:34:19.335701 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 05:34:19.335701 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 05:34:19.335701 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:34:19.335701 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:34:19.335701 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:34:19.335701 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:34:19.335701 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:34:19.335701 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:34:19.336559 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:34:19.336559 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application with Lock( Aug 24 05:34:19.336559 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:34:19.336559 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:34:19.336559 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:34:19.336559 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:34:19.336559 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:34:19.336559 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:34:19.336559 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:34:19.336559 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:34:19.336559 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 05:34:19.336559 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 05:34:19.336559 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 05:34:19.336559 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Aug 24 05:34:19.336559 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 495/1002] 10.222.0.26 () {56 vars in 1105 bytes} [Wed Aug 24 05:34:19 2022] GET /identity/v3/services/image => generated 86 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:34:19.341920 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6376c03-5ae1-42d0-a2f3-5ceb204ebd4f None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:34:19.387597 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31bf288-dc3b-4e46-92d8-faeefae786d2 None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:34:19.393390 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:34:19.427629 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4158c7-e900-4832-be51-4d2ba61220ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:34:19.428670 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4158c7-e900-4832-be51-4d2ba61220ef None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:19.428965 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4158c7-e900-4832-be51-4d2ba61220ef None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:19.429245 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4158c7-e900-4832-be51-4d2ba61220ef None admin] PATH_INFO: `/v3/services` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:19.429904 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4158c7-e900-4832-be51-4d2ba61220ef None admin] RBAC: Adding query filter params (type=compute) {{(pid=88113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:34:19.430226 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4158c7-e900-4832-be51-4d2ba61220ef None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:34:19.432012 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4158c7-e900-4832-be51-4d2ba61220ef None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:34:19.438184 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 508/1003] 10.222.0.26 () {56 vars in 1112 bytes} [Wed Aug 24 05:34:19 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:34:19.444392 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4158c7-e900-4832-be51-4d2ba61220ef None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:34:19.456596 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6376c03-5ae1-42d0-a2f3-5ceb204ebd4f None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:34:19.498518 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1274eca9-8e04-4637-a6b5-e6d293ba4586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:34:19.499194 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1274eca9-8e04-4637-a6b5-e6d293ba4586 None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:19.499483 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1274eca9-8e04-4637-a6b5-e6d293ba4586 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:19.499760 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1274eca9-8e04-4637-a6b5-e6d293ba4586 None admin] PATH_INFO: `/v3/services` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:19.500407 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1274eca9-8e04-4637-a6b5-e6d293ba4586 None admin] RBAC: Adding query filter params (name=image) {{(pid=88112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:34:19.500711 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1274eca9-8e04-4637-a6b5-e6d293ba4586 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:34:19.502104 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1274eca9-8e04-4637-a6b5-e6d293ba4586 None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:34:19.507341 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 496/1004] 10.222.0.26 () {56 vars in 1108 bytes} [Wed Aug 24 05:34:19 2022] GET /identity/v3/services?name=image => generated 122 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:34:19.512963 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1274eca9-8e04-4637-a6b5-e6d293ba4586 None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:34:19.561575 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4158c7-e900-4832-be51-4d2ba61220ef None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:34:19.569752 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:34:19.598980 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3e68b7-f0b8-427d-9f38-7f7f3eb782e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:34:19.599507 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3e68b7-f0b8-427d-9f38-7f7f3eb782e0 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:19.599788 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3e68b7-f0b8-427d-9f38-7f7f3eb782e0 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:19.600063 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3e68b7-f0b8-427d-9f38-7f7f3eb782e0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:19.600764 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3e68b7-f0b8-427d-9f38-7f7f3eb782e0 None admin] RBAC: Adding query filter params (interface=public, service_id=2baa7b602bd247ddb57b4782d76464e1, region_id=RegionOne) {{(pid=88113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:34:19.601105 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3e68b7-f0b8-427d-9f38-7f7f3eb782e0 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:34:19.602525 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3e68b7-f0b8-427d-9f38-7f7f3eb782e0 None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:34:19.612041 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 509/1005] 10.222.0.26 () {56 vars in 1251 bytes} [Wed Aug 24 05:34:19 2022] GET /identity/v3/endpoints?service_id=2baa7b602bd247ddb57b4782d76464e1&interface=public®ion_id=RegionOne => generated 194 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:34:19.613118 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3e68b7-f0b8-427d-9f38-7f7f3eb782e0 None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:34:19.625088 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1274eca9-8e04-4637-a6b5-e6d293ba4586 None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:34:19.636019 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:34:19.661191 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b74c88c-79cb-4831-b827-49b347c29529 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:34:19.661848 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b74c88c-79cb-4831-b827-49b347c29529 None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:19.662392 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b74c88c-79cb-4831-b827-49b347c29529 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:19.662524 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b74c88c-79cb-4831-b827-49b347c29529 None admin] PATH_INFO: `/v3/services` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:19.663058 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b74c88c-79cb-4831-b827-49b347c29529 None admin] RBAC: Adding query filter params (type=image) {{(pid=88112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:34:19.663363 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b74c88c-79cb-4831-b827-49b347c29529 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:34:19.664723 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b74c88c-79cb-4831-b827-49b347c29529 None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:34:19.669406 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 497/1006] 10.222.0.26 () {56 vars in 1108 bytes} [Wed Aug 24 05:34:19 2022] GET /identity/v3/services?type=image => generated 122 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:34:19.724761 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3e68b7-f0b8-427d-9f38-7f7f3eb782e0 None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:34:19.762346 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbc0918-f384-4905-84b3-67e75c779635 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:34:19.762975 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbc0918-f384-4905-84b3-67e75c779635 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:19.763255 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbc0918-f384-4905-84b3-67e75c779635 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:19.763530 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbc0918-f384-4905-84b3-67e75c779635 None admin] PATH_INFO: `/v3/services` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:19.764717 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbc0918-f384-4905-84b3-67e75c779635 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:34:19.766128 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbc0918-f384-4905-84b3-67e75c779635 None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:34:19.773205 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 510/1007] 10.222.0.26 () {56 vars in 1087 bytes} [Wed Aug 24 05:34:19 2022] GET /identity/v3/services => generated 1727 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 05:34:21.180149 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6958452a-a0ec-4b77-8774-d8616bc00626 None None] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:21.180677 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6958452a-a0ec-4b77-8774-d8616bc00626 None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:21.180677 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6958452a-a0ec-4b77-8774-d8616bc00626 None None] PATH_INFO: `/` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:21.182077 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 498/1008] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 24 05:34:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:34:21.187357 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a23e53-cae4-4152-8682-f1f028a1ab7c None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:21.187742 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a23e53-cae4-4152-8682-f1f028a1ab7c None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:21.187898 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a23e53-cae4-4152-8682-f1f028a1ab7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:21.206308 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-59a23e53-cae4-4152-8682-f1f028a1ab7c None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:34:21.207486 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-59a23e53-cae4-4152-8682-f1f028a1ab7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:34:21.235967 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:34:21.277543 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 511/1009] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 24 05:34:21 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 05:34:21.543185 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6958452a-a0ec-4b77-8774-d8616bc00626 None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:34:21.549478 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8acd2c-763f-4adf-8063-c1f5412b711b None None] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:21.549764 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8acd2c-763f-4adf-8063-c1f5412b711b None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:21.550060 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8acd2c-763f-4adf-8063-c1f5412b711b None None] PATH_INFO: `/` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:21.551649 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 512/1010] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 24 05:34:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:34:21.556509 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d02d174-e79e-401a-8ab6-3896ecb24633 None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:21.557059 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d02d174-e79e-401a-8ab6-3896ecb24633 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:21.557059 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d02d174-e79e-401a-8ab6-3896ecb24633 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:21.577371 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-2d02d174-e79e-401a-8ab6-3896ecb24633 None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:34:21.578571 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-2d02d174-e79e-401a-8ab6-3896ecb24633 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:34:21.648506 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6958452a-a0ec-4b77-8774-d8616bc00626 None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:34:21.650155 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 513/1011] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 24 05:34:21 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 05:34:21.673554 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46738da-993d-4b60-b10e-e30a9f0c0097 None None] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:21.673893 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46738da-993d-4b60-b10e-e30a9f0c0097 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:21.674118 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46738da-993d-4b60-b10e-e30a9f0c0097 None None] PATH_INFO: `/` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:21.675429 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 514/1012] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 24 05:34:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 05:34:21.680259 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998b1031-6f6b-418d-8a52-1cee1e3a0d8f None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:21.680531 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998b1031-6f6b-418d-8a52-1cee1e3a0d8f None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:21.680758 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998b1031-6f6b-418d-8a52-1cee1e3a0d8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:21.684270 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6134a0ef-ab00-43d2-9945-fe8dd71d9fe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:34:21.684893 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6134a0ef-ab00-43d2-9945-fe8dd71d9fe3 None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:21.685166 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6134a0ef-ab00-43d2-9945-fe8dd71d9fe3 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:21.685433 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6134a0ef-ab00-43d2-9945-fe8dd71d9fe3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:21.686575 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6134a0ef-ab00-43d2-9945-fe8dd71d9fe3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:34:21.687989 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6134a0ef-ab00-43d2-9945-fe8dd71d9fe3 None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:34:21.693985 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 499/1013] 10.222.0.26 () {56 vars in 1108 bytes} [Wed Aug 24 05:34:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:34:21.695493 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6134a0ef-ab00-43d2-9945-fe8dd71d9fe3 None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:34:21.698738 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-998b1031-6f6b-418d-8a52-1cee1e3a0d8f None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:34:21.699925 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-998b1031-6f6b-418d-8a52-1cee1e3a0d8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:34:21.742786 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:34:21.772409 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 515/1014] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 24 05:34:21 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 05:34:21.801330 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6134a0ef-ab00-43d2-9945-fe8dd71d9fe3 None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:34:21.835848 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8d677c-7980-448e-949a-630e3d2090c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:34:21.836515 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8d677c-7980-448e-949a-630e3d2090c0 None admin] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:21.836798 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8d677c-7980-448e-949a-630e3d2090c0 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:21.837093 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8d677c-7980-448e-949a-630e3d2090c0 None admin] PATH_INFO: `/v3/projects` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:21.837753 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8d677c-7980-448e-949a-630e3d2090c0 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:34:21.839195 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8d677c-7980-448e-949a-630e3d2090c0 None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:34:21.873969 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 500/1015] 10.222.0.26 () {60 vars in 1141 bytes} [Wed Aug 24 05:34:21 2022] POST /identity/v3/projects => generated 311 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 05:34:21.918210 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998b1031-6f6b-418d-8a52-1cee1e3a0d8f None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:34:21.946215 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:34:22.030432 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998b1031-6f6b-418d-8a52-1cee1e3a0d8f None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:34:22.044435 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8d677c-7980-448e-949a-630e3d2090c0 None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:34:22.065682 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f946038-2bdd-4b78-9979-b4d622d70f2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:34:22.066562 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f946038-2bdd-4b78-9979-b4d622d70f2f None admin] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:22.066837 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f946038-2bdd-4b78-9979-b4d622d70f2f None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:22.067153 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f946038-2bdd-4b78-9979-b4d622d70f2f None admin] PATH_INFO: `/v3/services` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:22.067798 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f946038-2bdd-4b78-9979-b4d622d70f2f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:34:22.069629 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f946038-2bdd-4b78-9979-b4d622d70f2f None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:34:22.087098 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 516/1016] 10.222.0.26 () {60 vars in 1141 bytes} [Wed Aug 24 05:34:21 2022] POST /identity/v3/services => generated 242 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:34:22.158641 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:34:22.168910 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8d677c-7980-448e-949a-630e3d2090c0 None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:34:22.212396 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959ce15c-f895-4e18-883a-857eeb29c944 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:34:22.213081 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959ce15c-f895-4e18-883a-857eeb29c944 None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:22.213364 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959ce15c-f895-4e18-883a-857eeb29c944 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:22.213589 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959ce15c-f895-4e18-883a-857eeb29c944 None admin] PATH_INFO: `/v3/services/compute` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:22.214217 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959ce15c-f895-4e18-883a-857eeb29c944 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:34:22.215616 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959ce15c-f895-4e18-883a-857eeb29c944 None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:34:22.225570 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application [None req-959ce15c-f895-4e18-883a-857eeb29c944 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 05:34:22.225570 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:34:22.225570 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 05:34:22.225570 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 05:34:22.225570 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 05:34:22.225570 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 05:34:22.225570 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 05:34:22.225570 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 05:34:22.225570 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 05:34:22.225570 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Aug 24 05:34:22.225570 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 05:34:22.225570 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Aug 24 05:34:22.225570 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:34:22.225570 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:34:22.225570 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:34:22.225570 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:34:22.225570 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:34:22.226621 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:34:22.226621 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:34:22.226621 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:34:22.226621 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:34:22.226621 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:34:22.226621 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:34:22.226621 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 05:34:22.226621 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 05:34:22.226621 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 05:34:22.226621 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 05:34:22.226621 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:34:22.226621 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:34:22.226621 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:34:22.226621 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:34:22.226621 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:34:22.226621 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:34:22.227471 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:34:22.227471 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application with Lock( Aug 24 05:34:22.227471 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:34:22.227471 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:34:22.227471 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:34:22.227471 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:34:22.227471 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:34:22.227471 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:34:22.227471 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:34:22.227471 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:34:22.227471 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 05:34:22.227471 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 05:34:22.227471 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 05:34:22.227471 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Aug 24 05:34:22.227471 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 501/1017] 10.222.0.26 () {56 vars in 1111 bytes} [Wed Aug 24 05:34:22 2022] GET /identity/v3/services/compute => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:34:22.232801 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f946038-2bdd-4b78-9979-b4d622d70f2f None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:34:22.319407 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:34:22.336769 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f946038-2bdd-4b78-9979-b4d622d70f2f None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:34:22.369758 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c762d18e-8412-400b-8946-ab887346f4d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:34:22.370398 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c762d18e-8412-400b-8946-ab887346f4d6 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:22.370673 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c762d18e-8412-400b-8946-ab887346f4d6 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:22.370939 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c762d18e-8412-400b-8946-ab887346f4d6 None admin] PATH_INFO: `/v3/services` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:22.371571 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c762d18e-8412-400b-8946-ab887346f4d6 None admin] RBAC: Adding query filter params (name=compute) {{(pid=88113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:34:22.371870 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c762d18e-8412-400b-8946-ab887346f4d6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:34:22.373256 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c762d18e-8412-400b-8946-ab887346f4d6 None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:34:22.378321 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 517/1018] 10.222.0.26 () {56 vars in 1112 bytes} [Wed Aug 24 05:34:22 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:34:22.384265 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959ce15c-f895-4e18-883a-857eeb29c944 None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:34:22.486330 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959ce15c-f895-4e18-883a-857eeb29c944 None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:34:22.524220 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ac1efc-b479-482c-8486-81a7bb4bf9aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:34:22.524834 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ac1efc-b479-482c-8486-81a7bb4bf9aa None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:22.525116 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ac1efc-b479-482c-8486-81a7bb4bf9aa None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:22.525388 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ac1efc-b479-482c-8486-81a7bb4bf9aa None admin] PATH_INFO: `/v3/services` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:22.526055 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ac1efc-b479-482c-8486-81a7bb4bf9aa None admin] RBAC: Adding query filter params (type=compute) {{(pid=88112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:34:22.526362 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ac1efc-b479-482c-8486-81a7bb4bf9aa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:34:22.527729 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ac1efc-b479-482c-8486-81a7bb4bf9aa None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:34:22.538636 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c762d18e-8412-400b-8946-ab887346f4d6 None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:34:22.539091 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 502/1019] 10.222.0.26 () {56 vars in 1112 bytes} [Wed Aug 24 05:34:22 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:34:22.642054 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c762d18e-8412-400b-8946-ab887346f4d6 None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:34:22.675068 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a1cf49-d1e0-4f81-a7b3-5de781c83d7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:34:22.675676 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a1cf49-d1e0-4f81-a7b3-5de781c83d7e None admin] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:22.675957 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a1cf49-d1e0-4f81-a7b3-5de781c83d7e None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:22.676231 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a1cf49-d1e0-4f81-a7b3-5de781c83d7e None admin] PATH_INFO: `/v3/endpoints` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:22.676895 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a1cf49-d1e0-4f81-a7b3-5de781c83d7e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:34:22.678296 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a1cf49-d1e0-4f81-a7b3-5de781c83d7e None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:34:22.698214 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 518/1020] 10.222.0.26 () {60 vars in 1144 bytes} [Wed Aug 24 05:34:22 2022] POST /identity/v3/endpoints => generated 334 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:34:23.808161 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9d87ac-a5a6-4b6a-88fb-60cb66309fd5 None None] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:23.808682 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9d87ac-a5a6-4b6a-88fb-60cb66309fd5 None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:23.808682 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9d87ac-a5a6-4b6a-88fb-60cb66309fd5 None None] PATH_INFO: `/` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:23.810135 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 503/1021] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 24 05:34:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:34:23.815768 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c2f4f4-6ae9-4bcb-b427-23cda5ebc367 None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:23.816433 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c2f4f4-6ae9-4bcb-b427-23cda5ebc367 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:23.816613 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c2f4f4-6ae9-4bcb-b427-23cda5ebc367 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:23.823761 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:34:23.836381 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-14c2f4f4-6ae9-4bcb-b427-23cda5ebc367 None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:34:23.837573 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-14c2f4f4-6ae9-4bcb-b427-23cda5ebc367 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:34:23.911382 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 519/1022] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 24 05:34:23 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 05:34:24.047107 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626173ba-d124-4238-aa87-fb80927040b9 None None] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:24.047453 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626173ba-d124-4238-aa87-fb80927040b9 None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:24.047671 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626173ba-d124-4238-aa87-fb80927040b9 None None] PATH_INFO: `/` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:24.049158 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 504/1023] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 24 05:34:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:34:24.054210 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8892675a-4323-4b9d-9124-ebbbadbee9a0 None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:24.054506 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8892675a-4323-4b9d-9124-ebbbadbee9a0 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:24.054785 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8892675a-4323-4b9d-9124-ebbbadbee9a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:24.073727 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-8892675a-4323-4b9d-9124-ebbbadbee9a0 None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:34:24.074886 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-8892675a-4323-4b9d-9124-ebbbadbee9a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:34:24.145985 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 520/1024] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 24 05:34:24 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 05:34:24.177065 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626173ba-d124-4238-aa87-fb80927040b9 None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:34:24.197193 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:34:24.280267 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626173ba-d124-4238-aa87-fb80927040b9 None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:34:24.313488 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21874f22-5ed2-405d-b914-e7bc37bdc0fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:34:24.314136 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21874f22-5ed2-405d-b914-e7bc37bdc0fd None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:24.314414 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21874f22-5ed2-405d-b914-e7bc37bdc0fd None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:24.314679 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21874f22-5ed2-405d-b914-e7bc37bdc0fd None admin] PATH_INFO: `/v3/domains/default` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:24.315773 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21874f22-5ed2-405d-b914-e7bc37bdc0fd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:34:24.317449 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21874f22-5ed2-405d-b914-e7bc37bdc0fd None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:34:24.319190 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 505/1025] 10.222.0.26 () {56 vars in 1108 bytes} [Wed Aug 24 05:34:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:34:24.324724 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8892675a-4323-4b9d-9124-ebbbadbee9a0 None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:34:24.382985 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:34:24.415927 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21874f22-5ed2-405d-b914-e7bc37bdc0fd None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:34:24.426009 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8892675a-4323-4b9d-9124-ebbbadbee9a0 None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:34:24.464605 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185afdab-0c9b-4728-8ba4-2f0307929da6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:34:24.465304 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185afdab-0c9b-4728-8ba4-2f0307929da6 None admin] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:24.465501 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185afdab-0c9b-4728-8ba4-2f0307929da6 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:24.465768 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185afdab-0c9b-4728-8ba4-2f0307929da6 None admin] PATH_INFO: `/v3/users` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:24.466455 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185afdab-0c9b-4728-8ba4-2f0307929da6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:34:24.468448 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185afdab-0c9b-4728-8ba4-2f0307929da6 None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:34:24.489824 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 521/1026] 10.222.0.26 () {60 vars in 1132 bytes} [Wed Aug 24 05:34:24 2022] POST /identity/v3/users => generated 285 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:34:24.514243 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:34:24.532418 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21874f22-5ed2-405d-b914-e7bc37bdc0fd None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:34:24.576286 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11233923-80f9-4cdd-a5cf-75b72831ea57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:34:24.576851 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11233923-80f9-4cdd-a5cf-75b72831ea57 None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:24.577132 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11233923-80f9-4cdd-a5cf-75b72831ea57 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:24.577408 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11233923-80f9-4cdd-a5cf-75b72831ea57 None admin] PATH_INFO: `/v3/services/image` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:24.578044 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11233923-80f9-4cdd-a5cf-75b72831ea57 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:34:24.579436 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11233923-80f9-4cdd-a5cf-75b72831ea57 None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:34:24.589057 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application [None req-11233923-80f9-4cdd-a5cf-75b72831ea57 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 05:34:24.589057 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:34:24.589057 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 05:34:24.589057 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 05:34:24.589057 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 05:34:24.589057 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 05:34:24.589057 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 05:34:24.589057 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 05:34:24.589057 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 05:34:24.589057 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Aug 24 05:34:24.589057 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 05:34:24.589057 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Aug 24 05:34:24.589057 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:34:24.589057 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:34:24.589057 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:34:24.589057 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:34:24.589057 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:34:24.590160 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:34:24.590160 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:34:24.590160 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:34:24.590160 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:34:24.590160 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:34:24.590160 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:34:24.590160 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 05:34:24.590160 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 05:34:24.590160 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 05:34:24.590160 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 05:34:24.590160 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:34:24.590160 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:34:24.590160 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:34:24.590160 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:34:24.590160 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:34:24.590160 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:34:24.591013 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:34:24.591013 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application with Lock( Aug 24 05:34:24.591013 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:34:24.591013 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:34:24.591013 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:34:24.591013 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:34:24.591013 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:34:24.591013 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:34:24.591013 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:34:24.591013 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:34:24.591013 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 05:34:24.591013 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 05:34:24.591013 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 05:34:24.591013 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Aug 24 05:34:24.591013 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 506/1027] 10.222.0.26 () {56 vars in 1105 bytes} [Wed Aug 24 05:34:24 2022] GET /identity/v3/services/image => generated 86 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 05:34:24.598316 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185afdab-0c9b-4728-8ba4-2f0307929da6 None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:34:24.687565 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8723c273-925d-4e80-97c2-9983a2bdc5ff None None] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:24.687903 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8723c273-925d-4e80-97c2-9983a2bdc5ff None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:24.688106 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8723c273-925d-4e80-97c2-9983a2bdc5ff None None] PATH_INFO: `/` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:24.689759 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 507/1028] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 24 05:34:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 05:34:24.694938 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c524f02-eb5b-437e-9944-48a43792bea9 None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:24.695218 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c524f02-eb5b-437e-9944-48a43792bea9 None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:24.695491 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c524f02-eb5b-437e-9944-48a43792bea9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:24.710271 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185afdab-0c9b-4728-8ba4-2f0307929da6 None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:34:24.718469 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-1c524f02-eb5b-437e-9944-48a43792bea9 None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:34:24.719657 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-1c524f02-eb5b-437e-9944-48a43792bea9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:34:24.729060 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:34:24.750176 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae83d02a-0dcb-439e-9c7e-6627f2ee0ac8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:34:24.750793 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae83d02a-0dcb-439e-9c7e-6627f2ee0ac8 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:24.751070 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae83d02a-0dcb-439e-9c7e-6627f2ee0ac8 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:24.751345 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae83d02a-0dcb-439e-9c7e-6627f2ee0ac8 None admin] PATH_INFO: `/v3/services` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:24.751977 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae83d02a-0dcb-439e-9c7e-6627f2ee0ac8 None admin] RBAC: Adding query filter params (name=image) {{(pid=88113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:34:24.752285 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae83d02a-0dcb-439e-9c7e-6627f2ee0ac8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:34:24.753652 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae83d02a-0dcb-439e-9c7e-6627f2ee0ac8 None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:34:24.762922 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 522/1029] 10.222.0.26 () {56 vars in 1108 bytes} [Wed Aug 24 05:34:24 2022] GET /identity/v3/services?name=image => generated 122 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:34:24.765457 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae83d02a-0dcb-439e-9c7e-6627f2ee0ac8 None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:34:24.794616 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 508/1030] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 24 05:34:24 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 05:34:24.877589 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae83d02a-0dcb-439e-9c7e-6627f2ee0ac8 None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:34:24.911664 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aae8d88-8a4d-4178-8837-33ac8951dc35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:34:24.912266 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aae8d88-8a4d-4178-8837-33ac8951dc35 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:24.912544 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aae8d88-8a4d-4178-8837-33ac8951dc35 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:24.912816 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aae8d88-8a4d-4178-8837-33ac8951dc35 None admin] PATH_INFO: `/v3/services` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:24.913443 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aae8d88-8a4d-4178-8837-33ac8951dc35 None admin] RBAC: Adding query filter params (type=image) {{(pid=88113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:34:24.913916 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aae8d88-8a4d-4178-8837-33ac8951dc35 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:34:24.915266 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aae8d88-8a4d-4178-8837-33ac8951dc35 None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:34:24.920629 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 523/1031] 10.222.0.26 () {56 vars in 1108 bytes} [Wed Aug 24 05:34:24 2022] GET /identity/v3/services?type=image => generated 350 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:34:24.926398 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c524f02-eb5b-437e-9944-48a43792bea9 None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:34:25.006821 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:34:25.027080 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c524f02-eb5b-437e-9944-48a43792bea9 None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:34:25.062520 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d479c91-b656-499a-85f7-906b52ae80bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:34:25.063132 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d479c91-b656-499a-85f7-906b52ae80bd None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:25.063410 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d479c91-b656-499a-85f7-906b52ae80bd None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:25.063772 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d479c91-b656-499a-85f7-906b52ae80bd None admin] PATH_INFO: `/v3/endpoints` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:25.064907 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aae8d88-8a4d-4178-8837-33ac8951dc35 None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:34:25.065886 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d479c91-b656-499a-85f7-906b52ae80bd None admin] RBAC: Adding query filter params (interface=public, service_id=76616ea57233447dbbeafd6f0ab1322c, region_id=RegionOne) {{(pid=88112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:34:25.066482 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d479c91-b656-499a-85f7-906b52ae80bd None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:34:25.067845 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d479c91-b656-499a-85f7-906b52ae80bd None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:34:25.078273 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 509/1032] 10.222.0.26 () {56 vars in 1251 bytes} [Wed Aug 24 05:34:24 2022] GET /identity/v3/endpoints?service_id=76616ea57233447dbbeafd6f0ab1322c&interface=public®ion_id=RegionOne => generated 194 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:34:25.079222 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d479c91-b656-499a-85f7-906b52ae80bd None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:34:25.119977 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:34:25.179987 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aae8d88-8a4d-4178-8837-33ac8951dc35 None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:34:25.187581 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d479c91-b656-499a-85f7-906b52ae80bd None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:34:25.213361 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5227bfb7-24a3-44a3-9b88-c086349fbee2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:34:25.214009 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5227bfb7-24a3-44a3-9b88-c086349fbee2 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:25.214293 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5227bfb7-24a3-44a3-9b88-c086349fbee2 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:25.214563 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5227bfb7-24a3-44a3-9b88-c086349fbee2 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:25.225403 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5227bfb7-24a3-44a3-9b88-c086349fbee2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:34:25.226626 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fa0972-b98f-47a6-99e3-38a47fd84123 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:34:25.227422 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fa0972-b98f-47a6-99e3-38a47fd84123 None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:25.227877 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fa0972-b98f-47a6-99e3-38a47fd84123 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:25.228327 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fa0972-b98f-47a6-99e3-38a47fd84123 None admin] PATH_INFO: `/v3/services` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:25.229120 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fa0972-b98f-47a6-99e3-38a47fd84123 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:34:25.230035 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application [None req-5227bfb7-24a3-44a3-9b88-c086349fbee2 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 05:34:25.230035 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:34:25.230035 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:34:25.230035 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:34:25.230035 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:34:25.230035 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:34:25.230035 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:34:25.230035 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:34:25.230035 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:34:25.230035 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:34:25.230035 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:34:25.230035 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:34:25.230035 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:34:25.230035 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:34:25.230035 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:34:25.230035 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:34:25.230961 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:34:25.230961 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:34:25.230961 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:34:25.230961 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:34:25.230961 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:34:25.230961 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:34:25.230961 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:34:25.230961 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:34:25.230961 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:34:25.230961 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:34:25.230961 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:34:25.230961 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application with Lock( Aug 24 05:34:25.230961 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:34:25.230961 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:34:25.230961 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:34:25.230961 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:34:25.232211 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:34:25.232211 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:34:25.232211 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:34:25.232211 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:34:25.232211 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:34:25.232211 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:34:25.232211 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:34:25.232211 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:34:25.232211 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:34:25.232211 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:34:25.232211 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 05:34:25.232211 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Aug 24 05:34:25.232211 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 524/1033] 10.222.0.26 () {56 vars in 1120 bytes} [Wed Aug 24 05:34:25 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:34:25.233892 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fa0972-b98f-47a6-99e3-38a47fd84123 None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:34:25.236889 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5227bfb7-24a3-44a3-9b88-c086349fbee2 None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:34:25.241584 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 510/1034] 10.222.0.26 () {56 vars in 1087 bytes} [Wed Aug 24 05:34:25 2022] GET /identity/v3/services => generated 1957 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 05:34:25.351030 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5227bfb7-24a3-44a3-9b88-c086349fbee2 None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:34:25.353579 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:34:25.392320 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b936355-938f-4b5f-9d65-b5d08e899408 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:34:25.392927 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b936355-938f-4b5f-9d65-b5d08e899408 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:25.393206 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b936355-938f-4b5f-9d65-b5d08e899408 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:25.393477 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b936355-938f-4b5f-9d65-b5d08e899408 None admin] PATH_INFO: `/v3/roles` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:25.394201 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b936355-938f-4b5f-9d65-b5d08e899408 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=88113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:34:25.394504 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b936355-938f-4b5f-9d65-b5d08e899408 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:34:25.395875 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b936355-938f-4b5f-9d65-b5d08e899408 None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:34:25.405178 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 525/1035] 10.222.0.26 () {56 vars in 1115 bytes} [Wed Aug 24 05:34:25 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:34:25.410697 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fa0972-b98f-47a6-99e3-38a47fd84123 None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:34:25.422051 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:34:25.519343 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fa0972-b98f-47a6-99e3-38a47fd84123 None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:34:25.558122 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fd6621-0800-4385-9751-c66376b42726 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:34:25.558758 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fd6621-0800-4385-9751-c66376b42726 None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:25.559035 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fd6621-0800-4385-9751-c66376b42726 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:25.559301 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fd6621-0800-4385-9751-c66376b42726 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:25.570183 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fd6621-0800-4385-9751-c66376b42726 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:34:25.571637 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fd6621-0800-4385-9751-c66376b42726 None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:34:25.586543 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application [None req-e9fd6621-0800-4385-9751-c66376b42726 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:34:25.586543 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:34:25.586543 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:34:25.586543 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:34:25.586543 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:34:25.586543 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:34:25.586543 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:34:25.586543 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:34:25.586543 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:34:25.586543 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:34:25.586543 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:34:25.586543 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:34:25.586543 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 05:34:25.586543 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 05:34:25.586543 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 05:34:25.586543 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 05:34:25.587518 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:34:25.587518 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:34:25.587518 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:34:25.587518 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:34:25.587518 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:34:25.587518 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:34:25.587518 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:34:25.587518 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application with Lock( Aug 24 05:34:25.587518 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:34:25.587518 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:34:25.587518 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:34:25.587518 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:34:25.587518 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:34:25.587518 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:34:25.587518 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:34:25.587518 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:34:25.587518 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 05:34:25.588420 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 05:34:25.588420 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:34:25.588420 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Aug 24 05:34:25.588420 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 511/1036] 10.222.0.26 () {56 vars in 1108 bytes} [Wed Aug 24 05:34:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 05:34:25.595456 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b936355-938f-4b5f-9d65-b5d08e899408 None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:34:25.699328 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b936355-938f-4b5f-9d65-b5d08e899408 None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:34:25.732769 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a475238-5b4b-43eb-92fb-d600e18c7544 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:34:25.733374 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a475238-5b4b-43eb-92fb-d600e18c7544 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:25.733652 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a475238-5b4b-43eb-92fb-d600e18c7544 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:25.733922 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a475238-5b4b-43eb-92fb-d600e18c7544 None admin] PATH_INFO: `/v3/domains` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:25.734590 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a475238-5b4b-43eb-92fb-d600e18c7544 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:34:25.734892 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a475238-5b4b-43eb-92fb-d600e18c7544 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:34:25.736250 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a475238-5b4b-43eb-92fb-d600e18c7544 None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:34:25.753205 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 526/1037] 10.222.0.26 () {56 vars in 1109 bytes} [Wed Aug 24 05:34:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:34:25.754628 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fd6621-0800-4385-9751-c66376b42726 None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:34:25.813984 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:34:25.856409 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fd6621-0800-4385-9751-c66376b42726 None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:34:25.890849 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b450e4d-96ca-4fef-b3aa-7aa82c8b29b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:34:25.891481 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b450e4d-96ca-4fef-b3aa-7aa82c8b29b9 None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:25.891760 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b450e4d-96ca-4fef-b3aa-7aa82c8b29b9 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:25.892038 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b450e4d-96ca-4fef-b3aa-7aa82c8b29b9 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:25.899638 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b450e4d-96ca-4fef-b3aa-7aa82c8b29b9 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:34:25.901068 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b450e4d-96ca-4fef-b3aa-7aa82c8b29b9 None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:34:25.912531 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application [None req-0b450e4d-96ca-4fef-b3aa-7aa82c8b29b9 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 05:34:25.912531 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:34:25.912531 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:34:25.912531 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:34:25.912531 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:34:25.912531 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:34:25.912531 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:34:25.912531 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:34:25.912531 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:34:25.912531 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:34:25.912531 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:34:25.912531 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:34:25.912531 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 05:34:25.912531 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 05:34:25.912531 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 05:34:25.912531 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 05:34:25.913488 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:34:25.913488 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:34:25.913488 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 05:34:25.913488 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 05:34:25.913488 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 05:34:25.913488 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 05:34:25.913488 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:34:25.913488 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:34:25.913488 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:34:25.913488 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:34:25.913488 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:34:25.913488 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application with Lock( Aug 24 05:34:25.913488 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:34:25.913488 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:34:25.913488 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:34:25.913488 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:34:25.913488 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:34:25.913488 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:34:25.914542 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:34:25.914542 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:34:25.914542 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 05:34:25.914542 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 05:34:25.914542 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 05:34:25.914542 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 05:34:25.914542 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 05:34:25.914542 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 05:34:25.914542 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 05:34:25.914542 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Aug 24 05:34:25.914542 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 512/1038] 10.222.0.26 () {56 vars in 1093 bytes} [Wed Aug 24 05:34:25 2022] GET /identity/v3/users/nova => generated 82 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 05:34:25.921290 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a475238-5b4b-43eb-92fb-d600e18c7544 None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:34:25.949838 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:34:26.023824 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a475238-5b4b-43eb-92fb-d600e18c7544 None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:34:26.057661 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c784a5d9-49d3-483c-b97c-63e9d6e158dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:34:26.058292 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c784a5d9-49d3-483c-b97c-63e9d6e158dd None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:26.058573 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c784a5d9-49d3-483c-b97c-63e9d6e158dd None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:26.058844 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c784a5d9-49d3-483c-b97c-63e9d6e158dd None admin] PATH_INFO: `/v3/users` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:26.059569 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c784a5d9-49d3-483c-b97c-63e9d6e158dd None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:34:26.059872 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c784a5d9-49d3-483c-b97c-63e9d6e158dd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:34:26.061354 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c784a5d9-49d3-483c-b97c-63e9d6e158dd None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:34:26.083806 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 527/1039] 10.222.0.26 () {56 vars in 1133 bytes} [Wed Aug 24 05:34:25 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:34:26.084854 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b450e4d-96ca-4fef-b3aa-7aa82c8b29b9 None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:34:26.185522 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b450e4d-96ca-4fef-b3aa-7aa82c8b29b9 None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:34:26.206485 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:34:26.222473 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21700ab-4e51-4547-88f9-8b4be284904a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:34:26.223084 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21700ab-4e51-4547-88f9-8b4be284904a None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:26.223364 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21700ab-4e51-4547-88f9-8b4be284904a None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:26.223635 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21700ab-4e51-4547-88f9-8b4be284904a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:26.291612 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21700ab-4e51-4547-88f9-8b4be284904a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:34:26.293054 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21700ab-4e51-4547-88f9-8b4be284904a None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:34:26.401166 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 513/1040] 10.222.0.26 () {58 vars in 1282 bytes} [Wed Aug 24 05:34:26 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 24 05:34:26.402672 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c784a5d9-49d3-483c-b97c-63e9d6e158dd None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:34:26.442677 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b305a3d-c339-4c70-a159-5b218567d879 None None] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:26.442965 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b305a3d-c339-4c70-a159-5b218567d879 None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:26.443239 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b305a3d-c339-4c70-a159-5b218567d879 None None] PATH_INFO: `/` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:26.444706 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 514/1041] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 24 05:34:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 05:34:26.449320 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d33c78-cd91-4c31-9ce3-4e8423a2f60a None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:26.449599 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d33c78-cd91-4c31-9ce3-4e8423a2f60a None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:26.449865 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d33c78-cd91-4c31-9ce3-4e8423a2f60a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:26.468515 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-16d33c78-cd91-4c31-9ce3-4e8423a2f60a None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:34:26.469692 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-16d33c78-cd91-4c31-9ce3-4e8423a2f60a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:34:26.483717 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:34:26.491396 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:34:26.510893 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c784a5d9-49d3-483c-b97c-63e9d6e158dd None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:34:26.549638 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4b3790-3b4c-440e-95d4-8b7a87829766 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:34:26.550263 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4b3790-3b4c-440e-95d4-8b7a87829766 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:26.550546 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4b3790-3b4c-440e-95d4-8b7a87829766 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:26.550816 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4b3790-3b4c-440e-95d4-8b7a87829766 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:26.551646 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 515/1042] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 24 05:34:26 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 05:34:26.562217 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4b3790-3b4c-440e-95d4-8b7a87829766 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:34:26.563663 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4b3790-3b4c-440e-95d4-8b7a87829766 None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:34:26.579022 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application [None req-ee4b3790-3b4c-440e-95d4-8b7a87829766 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:34:26.579022 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:34:26.579022 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:34:26.579022 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:34:26.579022 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:34:26.579022 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:34:26.579022 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:34:26.579022 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:34:26.579022 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:34:26.579022 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:34:26.579022 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:34:26.579022 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:34:26.579022 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 05:34:26.579022 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 05:34:26.579022 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 05:34:26.579022 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 05:34:26.579986 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:34:26.579986 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:34:26.579986 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:34:26.579986 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:34:26.579986 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:34:26.579986 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:34:26.579986 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:34:26.579986 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application with Lock( Aug 24 05:34:26.579986 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:34:26.579986 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:34:26.579986 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:34:26.579986 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:34:26.579986 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:34:26.579986 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:34:26.579986 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:34:26.579986 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:34:26.579986 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 05:34:26.585992 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 05:34:26.585992 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:34:26.585992 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Aug 24 05:34:26.585992 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 528/1043] 10.222.0.26 () {56 vars in 1108 bytes} [Wed Aug 24 05:34:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 05:34:26.586281 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d33c78-cd91-4c31-9ce3-4e8423a2f60a None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:34:26.686799 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d33c78-cd91-4c31-9ce3-4e8423a2f60a None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:34:26.721693 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2818c35-27ab-4d73-82f1-1c29caa0dc14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:34:26.722334 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2818c35-27ab-4d73-82f1-1c29caa0dc14 None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:26.722612 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2818c35-27ab-4d73-82f1-1c29caa0dc14 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:26.722881 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2818c35-27ab-4d73-82f1-1c29caa0dc14 None admin] PATH_INFO: `/v3/domains` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:26.723514 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2818c35-27ab-4d73-82f1-1c29caa0dc14 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:34:26.723811 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2818c35-27ab-4d73-82f1-1c29caa0dc14 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:34:26.725164 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2818c35-27ab-4d73-82f1-1c29caa0dc14 None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:34:26.740771 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 516/1044] 10.222.0.26 () {56 vars in 1109 bytes} [Wed Aug 24 05:34:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:34:26.742214 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4b3790-3b4c-440e-95d4-8b7a87829766 None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:34:26.824616 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2818c35-27ab-4d73-82f1-1c29caa0dc14 None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:34:26.837687 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:34:26.846184 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4b3790-3b4c-440e-95d4-8b7a87829766 None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:34:26.882820 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd62e28-0058-4a91-8878-ac64e98c7fd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:34:26.883563 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd62e28-0058-4a91-8878-ac64e98c7fd9 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:26.883848 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd62e28-0058-4a91-8878-ac64e98c7fd9 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:26.884230 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd62e28-0058-4a91-8878-ac64e98c7fd9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:26.887580 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:34:26.893962 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd62e28-0058-4a91-8878-ac64e98c7fd9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:34:26.895916 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd62e28-0058-4a91-8878-ac64e98c7fd9 None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:34:26.910030 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application [None req-4fd62e28-0058-4a91-8878-ac64e98c7fd9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 05:34:26.910030 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:34:26.910030 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:34:26.910030 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:34:26.910030 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:34:26.910030 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:34:26.910030 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:34:26.910030 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:34:26.910030 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:34:26.910030 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:34:26.910030 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:34:26.910030 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:34:26.910030 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 05:34:26.910030 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 05:34:26.910030 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 05:34:26.910958 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 05:34:26.910958 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:34:26.910958 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:34:26.910958 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:34:26.910958 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:34:26.910958 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:34:26.910958 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:34:26.910958 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:34:26.910958 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application with Lock( Aug 24 05:34:26.910958 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:34:26.910958 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:34:26.910958 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:34:26.910958 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:34:26.910958 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:34:26.910958 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:34:26.910958 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:34:26.910958 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:34:26.911857 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 05:34:26.911857 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 05:34:26.911857 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 05:34:26.911857 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 05:34:26.911857 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 05:34:26.911857 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 05:34:26.911857 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 05:34:26.911857 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Aug 24 05:34:26.911857 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 529/1045] 10.222.0.26 () {56 vars in 1111 bytes} [Wed Aug 24 05:34:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 05:34:26.917400 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd62e28-0058-4a91-8878-ac64e98c7fd9 None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:34:26.931322 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2818c35-27ab-4d73-82f1-1c29caa0dc14 None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:34:26.965416 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcf46ba-5440-4094-a155-6fe4dbf4663a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:34:26.966066 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcf46ba-5440-4094-a155-6fe4dbf4663a None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:26.966340 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcf46ba-5440-4094-a155-6fe4dbf4663a None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:26.967140 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcf46ba-5440-4094-a155-6fe4dbf4663a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:26.977774 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcf46ba-5440-4094-a155-6fe4dbf4663a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:34:26.982442 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application [None req-9bcf46ba-5440-4094-a155-6fe4dbf4663a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 05:34:26.982442 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:34:26.982442 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:34:26.982442 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:34:26.982442 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:34:26.982442 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:34:26.982442 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:34:26.982442 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:34:26.982442 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:34:26.982442 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:34:26.982442 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:34:26.982442 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:34:26.982442 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:34:26.982442 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:34:26.982442 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:34:26.982442 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:34:26.983372 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:34:26.983372 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:34:26.983372 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:34:26.983372 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:34:26.983372 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:34:26.983372 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:34:26.983372 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:34:26.983372 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:34:26.983372 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:34:26.983372 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:34:26.983372 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:34:26.983372 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application with Lock( Aug 24 05:34:26.983372 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:34:26.983372 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:34:26.983372 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:34:26.983372 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:34:26.984228 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:34:26.984228 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:34:26.984228 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:34:26.984228 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:34:26.984228 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:34:26.984228 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:34:26.984228 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:34:26.984228 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:34:26.984228 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:34:26.984228 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:34:26.984228 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 05:34:26.984228 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Aug 24 05:34:26.984228 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 517/1046] 10.222.0.26 () {56 vars in 1096 bytes} [Wed Aug 24 05:34:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 05:34:26.989273 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcf46ba-5440-4094-a155-6fe4dbf4663a None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:34:27.029173 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd62e28-0058-4a91-8878-ac64e98c7fd9 None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:34:27.059781 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:34:27.066375 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97b088c-abe7-485c-97b1-e7744d70dc96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:34:27.067415 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97b088c-abe7-485c-97b1-e7744d70dc96 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:27.067705 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97b088c-abe7-485c-97b1-e7744d70dc96 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:27.067978 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97b088c-abe7-485c-97b1-e7744d70dc96 None admin] PATH_INFO: `/v3/projects` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:27.068671 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97b088c-abe7-485c-97b1-e7744d70dc96 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:34:27.068976 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97b088c-abe7-485c-97b1-e7744d70dc96 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:34:27.071126 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97b088c-abe7-485c-97b1-e7744d70dc96 None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:34:27.089007 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 530/1047] 10.222.0.26 () {56 vars in 1148 bytes} [Wed Aug 24 05:34:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:34:27.090462 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97b088c-abe7-485c-97b1-e7744d70dc96 None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:34:27.091881 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcf46ba-5440-4094-a155-6fe4dbf4663a None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:34:27.130046 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4dcc1e-7157-426b-82bc-b92b68ba7441 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:34:27.130676 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4dcc1e-7157-426b-82bc-b92b68ba7441 None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:27.130952 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4dcc1e-7157-426b-82bc-b92b68ba7441 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:27.131219 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4dcc1e-7157-426b-82bc-b92b68ba7441 None admin] PATH_INFO: `/v3/roles` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:27.131881 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4dcc1e-7157-426b-82bc-b92b68ba7441 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:34:27.132180 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4dcc1e-7157-426b-82bc-b92b68ba7441 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:34:27.133528 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4dcc1e-7157-426b-82bc-b92b68ba7441 None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:34:27.143473 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 518/1048] 10.222.0.26 () {56 vars in 1099 bytes} [Wed Aug 24 05:34:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:34:27.148852 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4dcc1e-7157-426b-82bc-b92b68ba7441 None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:34:27.150758 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:34:27.195159 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97b088c-abe7-485c-97b1-e7744d70dc96 None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:34:27.229284 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99978751-240a-4567-9c4b-26bb7128873c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:34:27.229817 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99978751-240a-4567-9c4b-26bb7128873c None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:27.230156 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99978751-240a-4567-9c4b-26bb7128873c None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:27.230429 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99978751-240a-4567-9c4b-26bb7128873c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:27.231146 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99978751-240a-4567-9c4b-26bb7128873c None admin] RBAC: Adding query filter params (role.id=bc599913e28e42089c8030b72de2de1f, scope.project.id=ded4fe81d4dc43188dd84e53025ee783, user.id=7b633e1aec6c4269bce13aa9c89e911a) {{(pid=88113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:34:27.231456 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99978751-240a-4567-9c4b-26bb7128873c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:34:27.232909 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99978751-240a-4567-9c4b-26bb7128873c None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:34:27.238220 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 531/1049] 10.222.0.26 () {56 vars in 1374 bytes} [Wed Aug 24 05:34:27 2022] GET /identity/v3/role_assignments?user.id=7b633e1aec6c4269bce13aa9c89e911a&scope.project.id=ded4fe81d4dc43188dd84e53025ee783&role.id=bc599913e28e42089c8030b72de2de1f => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:34:27.240463 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f311b2d3-f076-4c9a-882b-9daefa5857e3 None None] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:27.240751 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f311b2d3-f076-4c9a-882b-9daefa5857e3 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:27.241082 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f311b2d3-f076-4c9a-882b-9daefa5857e3 None None] PATH_INFO: `/` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:27.242552 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 532/1050] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 24 05:34:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:34:27.248711 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec15861c-11c0-4030-9df8-cdfd7849e460 None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:27.248990 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec15861c-11c0-4030-9df8-cdfd7849e460 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:27.249258 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec15861c-11c0-4030-9df8-cdfd7849e460 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:27.251144 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4dcc1e-7157-426b-82bc-b92b68ba7441 None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:34:27.269774 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-ec15861c-11c0-4030-9df8-cdfd7849e460 None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:34:27.271042 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-ec15861c-11c0-4030-9df8-cdfd7849e460 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:34:27.285243 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:34:27.292162 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6801cc-9fe1-4205-a998-320870c6469b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:34:27.292820 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6801cc-9fe1-4205-a998-320870c6469b None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:27.293097 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6801cc-9fe1-4205-a998-320870c6469b None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:27.293368 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6801cc-9fe1-4205-a998-320870c6469b None admin] PATH_INFO: `/v3/users/5bbc74901dea40269dfbc782d3bb1a1f` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:27.309744 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6801cc-9fe1-4205-a998-320870c6469b None admin] RBAC: Authorizing `identity:get_user(user_id=5bbc74901dea40269dfbc782d3bb1a1f)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:34:27.311959 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6801cc-9fe1-4205-a998-320870c6469b None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:34:27.313902 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 519/1051] 10.222.0.26 () {56 vars in 1177 bytes} [Wed Aug 24 05:34:27 2022] GET /identity/v3/users/5bbc74901dea40269dfbc782d3bb1a1f => generated 285 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:34:27.320025 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6801cc-9fe1-4205-a998-320870c6469b None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:34:27.352284 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 533/1052] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 24 05:34:27 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 05:34:27.430010 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6801cc-9fe1-4205-a998-320870c6469b None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:34:27.465169 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f33911-3b2a-4756-bdf5-4880bc3e2c57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:34:27.465774 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f33911-3b2a-4756-bdf5-4880bc3e2c57 None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:27.466081 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f33911-3b2a-4756-bdf5-4880bc3e2c57 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:27.466355 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f33911-3b2a-4756-bdf5-4880bc3e2c57 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:27.528191 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:34:27.540478 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f33911-3b2a-4756-bdf5-4880bc3e2c57 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:34:27.542197 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f33911-3b2a-4756-bdf5-4880bc3e2c57 None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:34:27.616009 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec15861c-11c0-4030-9df8-cdfd7849e460 None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:34:27.648546 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 520/1053] 10.222.0.26 () {58 vars in 1282 bytes} [Wed Aug 24 05:34:27 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 24 05:34:27.653168 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f33911-3b2a-4756-bdf5-4880bc3e2c57 None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:34:27.672528 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:34:27.728439 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec15861c-11c0-4030-9df8-cdfd7849e460 None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:34:27.744396 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:34:27.754244 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f33911-3b2a-4756-bdf5-4880bc3e2c57 None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:34:27.766623 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e61bf5-b46c-4183-a009-28eff488b9b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:34:27.767361 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e61bf5-b46c-4183-a009-28eff488b9b2 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:27.767644 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e61bf5-b46c-4183-a009-28eff488b9b2 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:27.768029 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e61bf5-b46c-4183-a009-28eff488b9b2 None admin] PATH_INFO: `/v3/services/image` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:27.768607 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e61bf5-b46c-4183-a009-28eff488b9b2 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:34:27.769993 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e61bf5-b46c-4183-a009-28eff488b9b2 None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:34:27.779613 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application [None req-f5e61bf5-b46c-4183-a009-28eff488b9b2 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 05:34:27.779613 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:34:27.779613 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 05:34:27.779613 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 05:34:27.779613 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 05:34:27.779613 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 05:34:27.779613 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 05:34:27.779613 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 05:34:27.779613 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 05:34:27.779613 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Aug 24 05:34:27.779613 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 05:34:27.779613 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Aug 24 05:34:27.779613 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:34:27.779613 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:34:27.779613 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:34:27.779613 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:34:27.779613 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:34:27.780582 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:34:27.780582 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:34:27.780582 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:34:27.780582 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:34:27.780582 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:34:27.780582 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:34:27.780582 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 05:34:27.780582 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 05:34:27.780582 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 05:34:27.780582 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 05:34:27.780582 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:34:27.780582 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:34:27.780582 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:34:27.780582 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:34:27.780582 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:34:27.780582 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:34:27.781408 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:34:27.781408 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application with Lock( Aug 24 05:34:27.781408 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:34:27.781408 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:34:27.781408 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:34:27.781408 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:34:27.781408 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:34:27.781408 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:34:27.781408 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:34:27.781408 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:34:27.781408 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 05:34:27.781408 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 05:34:27.781408 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 05:34:27.781408 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Aug 24 05:34:27.781408 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 534/1054] 10.222.0.26 () {56 vars in 1105 bytes} [Wed Aug 24 05:34:27 2022] GET /identity/v3/services/image => generated 86 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 05:34:27.786506 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e61bf5-b46c-4183-a009-28eff488b9b2 None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:34:27.791588 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ad231a-7bfa-4ddc-bb30-adca07eeacb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:34:27.792216 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ad231a-7bfa-4ddc-bb30-adca07eeacb0 None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:27.792495 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ad231a-7bfa-4ddc-bb30-adca07eeacb0 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:27.792767 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ad231a-7bfa-4ddc-bb30-adca07eeacb0 None admin] PATH_INFO: `/v3/projects/c4b04f714c5f4e9f96d74e914d3722f4` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:27.793883 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ad231a-7bfa-4ddc-bb30-adca07eeacb0 None admin] RBAC: Authorizing `identity:get_project(project_id=c4b04f714c5f4e9f96d74e914d3722f4)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:34:27.795941 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ad231a-7bfa-4ddc-bb30-adca07eeacb0 None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:34:27.797571 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 521/1055] 10.222.0.26 () {56 vars in 1186 bytes} [Wed Aug 24 05:34:27 2022] GET /identity/v3/projects/c4b04f714c5f4e9f96d74e914d3722f4 => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:34:27.803347 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ad231a-7bfa-4ddc-bb30-adca07eeacb0 None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:34:27.893980 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e61bf5-b46c-4183-a009-28eff488b9b2 None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:34:27.908241 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:34:27.908471 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ad231a-7bfa-4ddc-bb30-adca07eeacb0 None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:34:27.930128 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6868c281-3f57-4032-b50f-dff33a89a973 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:34:27.930794 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6868c281-3f57-4032-b50f-dff33a89a973 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:27.931002 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6868c281-3f57-4032-b50f-dff33a89a973 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:27.931271 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6868c281-3f57-4032-b50f-dff33a89a973 None admin] PATH_INFO: `/v3/services` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:27.931895 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6868c281-3f57-4032-b50f-dff33a89a973 None admin] RBAC: Adding query filter params (name=image) {{(pid=88113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:34:27.932202 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6868c281-3f57-4032-b50f-dff33a89a973 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:34:27.933565 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6868c281-3f57-4032-b50f-dff33a89a973 None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:34:27.943546 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 535/1056] 10.222.0.26 () {56 vars in 1108 bytes} [Wed Aug 24 05:34:27 2022] GET /identity/v3/services?name=image => generated 122 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:34:27.944519 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6868c281-3f57-4032-b50f-dff33a89a973 None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:34:27.950328 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d76e96-6067-4187-974e-af0ad9b8bf52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:34:27.950984 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d76e96-6067-4187-974e-af0ad9b8bf52 None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:27.951258 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d76e96-6067-4187-974e-af0ad9b8bf52 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:27.951526 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d76e96-6067-4187-974e-af0ad9b8bf52 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:27.952240 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d76e96-6067-4187-974e-af0ad9b8bf52 None admin] RBAC: Adding query filter params (role.id=640bda0879494e60b72680ee505285f0, scope.project.id=c4b04f714c5f4e9f96d74e914d3722f4, user.id=5bbc74901dea40269dfbc782d3bb1a1f) {{(pid=88112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:34:27.952543 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d76e96-6067-4187-974e-af0ad9b8bf52 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:34:27.953978 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d76e96-6067-4187-974e-af0ad9b8bf52 None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:34:27.959633 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 522/1057] 10.222.0.26 () {56 vars in 1374 bytes} [Wed Aug 24 05:34:27 2022] GET /identity/v3/role_assignments?user.id=5bbc74901dea40269dfbc782d3bb1a1f&scope.project.id=c4b04f714c5f4e9f96d74e914d3722f4&role.id=640bda0879494e60b72680ee505285f0 => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:34:28.054107 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6868c281-3f57-4032-b50f-dff33a89a973 None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:34:28.089575 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa1c981-71c9-4a1b-a037-1016021272fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:34:28.090220 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa1c981-71c9-4a1b-a037-1016021272fa None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:28.090899 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa1c981-71c9-4a1b-a037-1016021272fa None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:28.090899 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa1c981-71c9-4a1b-a037-1016021272fa None admin] PATH_INFO: `/v3/services` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:28.091947 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa1c981-71c9-4a1b-a037-1016021272fa None admin] RBAC: Adding query filter params (type=image) {{(pid=88113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:34:28.092262 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa1c981-71c9-4a1b-a037-1016021272fa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:34:28.094074 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa1c981-71c9-4a1b-a037-1016021272fa None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:34:28.099697 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 536/1058] 10.222.0.26 () {56 vars in 1108 bytes} [Wed Aug 24 05:34:27 2022] GET /identity/v3/services?type=image => generated 350 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:34:28.105544 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d76e96-6067-4187-974e-af0ad9b8bf52 None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:34:28.132323 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:34:28.213149 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d76e96-6067-4187-974e-af0ad9b8bf52 None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:34:28.247788 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762e4816-6761-46dd-89d9-f8d34f762e80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:34:28.248398 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762e4816-6761-46dd-89d9-f8d34f762e80 None admin] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:28.248676 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762e4816-6761-46dd-89d9-f8d34f762e80 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:28.248946 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762e4816-6761-46dd-89d9-f8d34f762e80 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:28.249612 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762e4816-6761-46dd-89d9-f8d34f762e80 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:34:28.251031 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762e4816-6761-46dd-89d9-f8d34f762e80 None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:34:28.272200 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 523/1059] 10.222.0.26 () {60 vars in 1144 bytes} [Wed Aug 24 05:34:28 2022] POST /identity/v3/endpoints => generated 327 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:34:29.131750 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a851690-376b-4a6f-9dc9-2abdac7cfff1 None None] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:29.132299 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a851690-376b-4a6f-9dc9-2abdac7cfff1 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:29.132299 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a851690-376b-4a6f-9dc9-2abdac7cfff1 None None] PATH_INFO: `/` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:29.133754 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 537/1060] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 24 05:34:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:34:29.139204 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56ddf03-019b-4c8d-9e8a-ee145dd49016 None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:29.139601 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56ddf03-019b-4c8d-9e8a-ee145dd49016 None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:29.139781 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56ddf03-019b-4c8d-9e8a-ee145dd49016 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:29.158075 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-d56ddf03-019b-4c8d-9e8a-ee145dd49016 None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:34:29.159239 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-d56ddf03-019b-4c8d-9e8a-ee145dd49016 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:34:29.231004 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 524/1061] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 24 05:34:29 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 05:34:29.493184 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a851690-376b-4a6f-9dc9-2abdac7cfff1 None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:34:29.541057 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:34:29.600832 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a851690-376b-4a6f-9dc9-2abdac7cfff1 None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:34:29.634465 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4412079a-196c-4849-99ef-660a9a8246b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:34:29.635093 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4412079a-196c-4849-99ef-660a9a8246b4 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:29.635368 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4412079a-196c-4849-99ef-660a9a8246b4 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:29.635634 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4412079a-196c-4849-99ef-660a9a8246b4 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:29.646554 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4412079a-196c-4849-99ef-660a9a8246b4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:34:29.651084 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application [None req-4412079a-196c-4849-99ef-660a9a8246b4 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 05:34:29.651084 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:34:29.651084 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:34:29.651084 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:34:29.651084 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:34:29.651084 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:34:29.651084 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:34:29.651084 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:34:29.651084 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:34:29.651084 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:34:29.651084 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:34:29.651084 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:34:29.651084 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:34:29.651084 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:34:29.651084 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:34:29.651084 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:34:29.652028 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:34:29.652028 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:34:29.652028 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:34:29.652028 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:34:29.652028 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:34:29.652028 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:34:29.652028 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:34:29.652028 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:34:29.652028 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:34:29.652028 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:34:29.652028 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:34:29.652028 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application with Lock( Aug 24 05:34:29.652028 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:34:29.652028 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:34:29.652028 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:34:29.652028 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:34:29.652888 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:34:29.652888 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:34:29.652888 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:34:29.652888 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:34:29.652888 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:34:29.652888 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:34:29.652888 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:34:29.652888 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:34:29.652888 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:34:29.652888 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:34:29.652888 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 05:34:29.652888 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Aug 24 05:34:29.657879 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 538/1062] 10.222.0.26 () {56 vars in 1120 bytes} [Wed Aug 24 05:34:29 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:34:29.658761 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56ddf03-019b-4c8d-9e8a-ee145dd49016 None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:34:29.662279 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:34:29.760763 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56ddf03-019b-4c8d-9e8a-ee145dd49016 None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:34:29.794296 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a5f4a3-aa0f-4a93-9d30-74767196c4a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:34:29.795450 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a5f4a3-aa0f-4a93-9d30-74767196c4a8 None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:29.795724 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a5f4a3-aa0f-4a93-9d30-74767196c4a8 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:29.795999 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a5f4a3-aa0f-4a93-9d30-74767196c4a8 None admin] PATH_INFO: `/v3/roles` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:29.796664 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a5f4a3-aa0f-4a93-9d30-74767196c4a8 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=88112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:34:29.796968 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a5f4a3-aa0f-4a93-9d30-74767196c4a8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:34:29.798354 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a5f4a3-aa0f-4a93-9d30-74767196c4a8 None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:34:29.811895 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 525/1063] 10.222.0.26 () {56 vars in 1115 bytes} [Wed Aug 24 05:34:29 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:34:29.812876 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4412079a-196c-4849-99ef-660a9a8246b4 None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:34:29.845200 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e5a86c-187a-42de-89b0-ba2d68196ac4 None None] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:29.845485 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e5a86c-187a-42de-89b0-ba2d68196ac4 None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:29.845758 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e5a86c-187a-42de-89b0-ba2d68196ac4 None None] PATH_INFO: `/` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:29.847440 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 526/1064] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 24 05:34:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 05:34:29.852957 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3362cd1f-0448-4d69-a129-51f8a9bbd5c8 None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:29.853240 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3362cd1f-0448-4d69-a129-51f8a9bbd5c8 None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:29.853530 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3362cd1f-0448-4d69-a129-51f8a9bbd5c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:29.873939 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-3362cd1f-0448-4d69-a129-51f8a9bbd5c8 None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:34:29.875430 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-3362cd1f-0448-4d69-a129-51f8a9bbd5c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:34:29.922032 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4412079a-196c-4849-99ef-660a9a8246b4 None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:34:29.924048 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:34:29.944040 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:34:29.952744 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 527/1065] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 24 05:34:29 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 05:34:29.959948 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4e4e39-9daa-4fec-be11-2ac8aad8e553 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:34:29.960581 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4e4e39-9daa-4fec-be11-2ac8aad8e553 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:29.960864 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4e4e39-9daa-4fec-be11-2ac8aad8e553 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:29.961140 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4e4e39-9daa-4fec-be11-2ac8aad8e553 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:29.972751 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4e4e39-9daa-4fec-be11-2ac8aad8e553 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:34:29.974230 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4e4e39-9daa-4fec-be11-2ac8aad8e553 None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:34:29.989010 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application [None req-0f4e4e39-9daa-4fec-be11-2ac8aad8e553 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:34:29.989010 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:34:29.989010 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:34:29.989010 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:34:29.989010 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:34:29.989010 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:34:29.989010 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:34:29.989010 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:34:29.989010 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:34:29.989010 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:34:29.989010 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:34:29.989010 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:34:29.989010 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 05:34:29.989010 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 05:34:29.989010 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 05:34:29.989010 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 05:34:29.989929 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:34:29.989929 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:34:29.989929 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:34:29.989929 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:34:29.989929 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:34:29.989929 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:34:29.989929 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:34:29.989929 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application with Lock( Aug 24 05:34:29.989929 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:34:29.989929 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:34:29.989929 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:34:29.989929 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:34:29.989929 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:34:29.989929 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:34:29.989929 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:34:29.989929 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:34:29.989929 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 05:34:29.991555 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 05:34:29.991555 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:34:29.991555 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Aug 24 05:34:29.991555 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 539/1066] 10.222.0.26 () {56 vars in 1108 bytes} [Wed Aug 24 05:34:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 05:34:29.997989 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3362cd1f-0448-4d69-a129-51f8a9bbd5c8 None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:34:30.098594 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3362cd1f-0448-4d69-a129-51f8a9bbd5c8 None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:34:30.131959 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55364cd9-874f-4363-ad7d-77768841df35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:34:30.132562 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55364cd9-874f-4363-ad7d-77768841df35 None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:30.132837 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55364cd9-874f-4363-ad7d-77768841df35 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:30.133104 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55364cd9-874f-4363-ad7d-77768841df35 None admin] PATH_INFO: `/v3/domains` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:30.133738 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55364cd9-874f-4363-ad7d-77768841df35 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:34:30.134064 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55364cd9-874f-4363-ad7d-77768841df35 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:34:30.135423 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55364cd9-874f-4363-ad7d-77768841df35 None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:34:30.151090 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 528/1067] 10.222.0.26 () {56 vars in 1109 bytes} [Wed Aug 24 05:34:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:34:30.152997 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4e4e39-9daa-4fec-be11-2ac8aad8e553 None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:34:30.191678 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbdaa99-5506-45f6-91ca-b95517247a15 None None] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:30.191957 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbdaa99-5506-45f6-91ca-b95517247a15 None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:30.192226 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbdaa99-5506-45f6-91ca-b95517247a15 None None] PATH_INFO: `/` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:30.193560 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 529/1068] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 24 05:34:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:34:30.199221 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7b40f8-904c-4722-bbc1-ef340dfa090a None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:30.199583 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7b40f8-904c-4722-bbc1-ef340dfa090a None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:30.200228 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7b40f8-904c-4722-bbc1-ef340dfa090a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:30.219658 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-ce7b40f8-904c-4722-bbc1-ef340dfa090a None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:34:30.221126 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-ce7b40f8-904c-4722-bbc1-ef340dfa090a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:34:30.256693 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4e4e39-9daa-4fec-be11-2ac8aad8e553 None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:34:30.271659 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:34:30.289393 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 530/1069] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 24 05:34:30 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 05:34:30.289639 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e218cd-3503-478c-9e0c-ce62254718b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:34:30.290296 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e218cd-3503-478c-9e0c-ce62254718b6 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:30.290404 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7b40f8-904c-4722-bbc1-ef340dfa090a None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:34:30.290581 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e218cd-3503-478c-9e0c-ce62254718b6 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:30.290853 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e218cd-3503-478c-9e0c-ce62254718b6 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:30.300532 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e218cd-3503-478c-9e0c-ce62254718b6 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:34:30.301976 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e218cd-3503-478c-9e0c-ce62254718b6 None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:34:30.313066 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application [None req-90e218cd-3503-478c-9e0c-ce62254718b6 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 05:34:30.313066 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:34:30.313066 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:34:30.313066 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:34:30.313066 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:34:30.313066 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:34:30.313066 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:34:30.313066 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:34:30.313066 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:34:30.313066 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:34:30.313066 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:34:30.313066 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:34:30.313066 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 05:34:30.313066 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 05:34:30.313066 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 05:34:30.313066 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 05:34:30.314122 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:34:30.314122 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:34:30.314122 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 05:34:30.314122 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 05:34:30.314122 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 05:34:30.314122 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 05:34:30.314122 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:34:30.314122 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:34:30.314122 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:34:30.314122 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:34:30.314122 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:34:30.314122 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application with Lock( Aug 24 05:34:30.314122 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:34:30.314122 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:34:30.314122 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:34:30.314122 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:34:30.314122 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:34:30.314122 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:34:30.315410 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:34:30.315410 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:34:30.315410 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 05:34:30.315410 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 05:34:30.315410 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 05:34:30.315410 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 05:34:30.315410 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 05:34:30.315410 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 05:34:30.315410 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 05:34:30.315410 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Aug 24 05:34:30.315410 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 540/1070] 10.222.0.26 () {56 vars in 1093 bytes} [Wed Aug 24 05:34:30 2022] GET /identity/v3/users/nova => generated 82 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 05:34:30.319999 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e218cd-3503-478c-9e0c-ce62254718b6 None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:34:30.336083 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:34:30.400429 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7b40f8-904c-4722-bbc1-ef340dfa090a None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:34:30.422426 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e218cd-3503-478c-9e0c-ce62254718b6 None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:34:30.436967 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a531e44-88c6-4f8f-9ff2-bc82b6f1924d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:34:30.437988 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a531e44-88c6-4f8f-9ff2-bc82b6f1924d None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:30.438567 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a531e44-88c6-4f8f-9ff2-bc82b6f1924d None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:30.438844 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a531e44-88c6-4f8f-9ff2-bc82b6f1924d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:30.449709 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a531e44-88c6-4f8f-9ff2-bc82b6f1924d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:34:30.455135 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9958cef7-493b-415e-bf8a-787db1de8382 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:34:30.455344 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application [None req-6a531e44-88c6-4f8f-9ff2-bc82b6f1924d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 05:34:30.455344 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:34:30.455344 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:34:30.455344 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:34:30.455344 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:34:30.455344 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:34:30.455344 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:34:30.455344 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:34:30.455344 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:34:30.455344 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:34:30.455344 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:34:30.455344 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:34:30.455344 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:34:30.455344 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:34:30.455344 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:34:30.455344 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:34:30.456229 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:34:30.456229 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:34:30.456229 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:34:30.456229 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:34:30.456229 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:34:30.456229 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:34:30.456229 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:34:30.456229 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:34:30.456229 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:34:30.456229 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:34:30.456229 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:34:30.456229 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application with Lock( Aug 24 05:34:30.456229 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:34:30.456229 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:34:30.456229 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:34:30.456229 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:34:30.458925 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:34:30.458925 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:34:30.458925 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:34:30.458925 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:34:30.458925 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:34:30.458925 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:34:30.458925 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:34:30.458925 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:34:30.458925 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:34:30.458925 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:34:30.458925 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 05:34:30.458925 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Aug 24 05:34:30.459567 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9958cef7-493b-415e-bf8a-787db1de8382 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:30.459567 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9958cef7-493b-415e-bf8a-787db1de8382 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:30.459567 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9958cef7-493b-415e-bf8a-787db1de8382 None admin] PATH_INFO: `/v3/users` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:30.459760 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 531/1071] 10.222.0.26 () {56 vars in 1096 bytes} [Wed Aug 24 05:34:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:34:30.459842 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9958cef7-493b-415e-bf8a-787db1de8382 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:34:30.459842 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9958cef7-493b-415e-bf8a-787db1de8382 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:34:30.459842 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9958cef7-493b-415e-bf8a-787db1de8382 None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:34:30.462203 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a531e44-88c6-4f8f-9ff2-bc82b6f1924d None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:34:30.478404 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 541/1072] 10.222.0.26 () {56 vars in 1133 bytes} [Wed Aug 24 05:34:30 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:34:30.483916 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9958cef7-493b-415e-bf8a-787db1de8382 None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:34:30.517213 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:34:30.563420 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:34:30.579277 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a531e44-88c6-4f8f-9ff2-bc82b6f1924d None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:34:30.594238 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9958cef7-493b-415e-bf8a-787db1de8382 None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:34:30.614413 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f458db-a3e7-4933-b5c3-97c087f70198 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:34:30.615009 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f458db-a3e7-4933-b5c3-97c087f70198 None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:30.615285 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f458db-a3e7-4933-b5c3-97c087f70198 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:30.615552 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f458db-a3e7-4933-b5c3-97c087f70198 None admin] PATH_INFO: `/v3/roles` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:30.616209 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f458db-a3e7-4933-b5c3-97c087f70198 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:34:30.616506 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f458db-a3e7-4933-b5c3-97c087f70198 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:34:30.617863 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f458db-a3e7-4933-b5c3-97c087f70198 None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:34:30.625544 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 532/1073] 10.222.0.26 () {56 vars in 1099 bytes} [Wed Aug 24 05:34:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:34:30.626343 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f458db-a3e7-4933-b5c3-97c087f70198 None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:34:30.631879 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0c15f8-56a9-475a-ba0c-5506bf43ea7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:34:30.632509 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0c15f8-56a9-475a-ba0c-5506bf43ea7e None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:30.632787 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0c15f8-56a9-475a-ba0c-5506bf43ea7e None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:30.633057 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0c15f8-56a9-475a-ba0c-5506bf43ea7e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:30.643659 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0c15f8-56a9-475a-ba0c-5506bf43ea7e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:34:30.645100 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0c15f8-56a9-475a-ba0c-5506bf43ea7e None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:34:30.660305 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application [None req-2d0c15f8-56a9-475a-ba0c-5506bf43ea7e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:34:30.660305 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:34:30.660305 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:34:30.660305 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:34:30.660305 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:34:30.660305 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:34:30.660305 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:34:30.660305 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:34:30.660305 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:34:30.660305 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:34:30.660305 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:34:30.660305 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:34:30.660305 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 05:34:30.660305 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 05:34:30.660305 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 05:34:30.660305 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 05:34:30.661322 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:34:30.661322 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:34:30.661322 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:34:30.661322 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:34:30.661322 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:34:30.661322 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:34:30.661322 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:34:30.661322 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application with Lock( Aug 24 05:34:30.661322 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:34:30.661322 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:34:30.661322 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:34:30.661322 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:34:30.661322 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:34:30.661322 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:34:30.661322 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:34:30.661322 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:34:30.661322 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 05:34:30.662950 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 05:34:30.662950 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:34:30.662950 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Aug 24 05:34:30.662950 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 542/1074] 10.222.0.26 () {56 vars in 1108 bytes} [Wed Aug 24 05:34:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 05:34:30.662950 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0c15f8-56a9-475a-ba0c-5506bf43ea7e None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:34:30.731578 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f458db-a3e7-4933-b5c3-97c087f70198 None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:34:30.740187 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:34:30.776352 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0c15f8-56a9-475a-ba0c-5506bf43ea7e None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:34:30.779257 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d1c113-ec74-468a-b9fe-7a9dce4e39df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:34:30.779953 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d1c113-ec74-468a-b9fe-7a9dce4e39df None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:30.780334 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d1c113-ec74-468a-b9fe-7a9dce4e39df None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:30.780718 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d1c113-ec74-468a-b9fe-7a9dce4e39df None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:30.799994 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:34:30.812111 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c04d18-a37b-409c-967c-dd92dba9ba8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:34:30.812734 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c04d18-a37b-409c-967c-dd92dba9ba8f None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:30.813012 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c04d18-a37b-409c-967c-dd92dba9ba8f None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:30.813280 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c04d18-a37b-409c-967c-dd92dba9ba8f None admin] PATH_INFO: `/v3/users/5bbc74901dea40269dfbc782d3bb1a1f` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:30.814425 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c04d18-a37b-409c-967c-dd92dba9ba8f None admin] RBAC: Authorizing `identity:get_user(user_id=5bbc74901dea40269dfbc782d3bb1a1f)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:34:30.816091 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c04d18-a37b-409c-967c-dd92dba9ba8f None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:34:30.817661 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 543/1075] 10.222.0.26 () {56 vars in 1177 bytes} [Wed Aug 24 05:34:30 2022] GET /identity/v3/users/5bbc74901dea40269dfbc782d3bb1a1f => generated 285 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:34:30.818439 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c04d18-a37b-409c-967c-dd92dba9ba8f None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:34:30.847780 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d1c113-ec74-468a-b9fe-7a9dce4e39df None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:34:30.849225 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d1c113-ec74-468a-b9fe-7a9dce4e39df None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:34:30.921757 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c04d18-a37b-409c-967c-dd92dba9ba8f None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:34:30.946995 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 533/1076] 10.222.0.26 () {58 vars in 1282 bytes} [Wed Aug 24 05:34:30 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 05:34:30.947832 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d1c113-ec74-468a-b9fe-7a9dce4e39df None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:34:30.957819 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:34:30.960967 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569a1a09-0c4f-4f93-b9fb-eb38b8d24bb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:34:30.961659 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569a1a09-0c4f-4f93-b9fb-eb38b8d24bb0 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:30.961964 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569a1a09-0c4f-4f93-b9fb-eb38b8d24bb0 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:30.962246 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569a1a09-0c4f-4f93-b9fb-eb38b8d24bb0 None admin] PATH_INFO: `/v3/domains` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:30.962885 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569a1a09-0c4f-4f93-b9fb-eb38b8d24bb0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:34:30.963193 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569a1a09-0c4f-4f93-b9fb-eb38b8d24bb0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:34:30.964622 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569a1a09-0c4f-4f93-b9fb-eb38b8d24bb0 None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:34:30.976815 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 544/1077] 10.222.0.26 () {56 vars in 1109 bytes} [Wed Aug 24 05:34:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:34:30.977603 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569a1a09-0c4f-4f93-b9fb-eb38b8d24bb0 None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:34:31.029773 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:34:31.046682 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d1c113-ec74-468a-b9fe-7a9dce4e39df None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:34:31.076188 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569a1a09-0c4f-4f93-b9fb-eb38b8d24bb0 None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:34:31.079311 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745d6506-01bd-4332-b724-cb8bdf1f5fd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:34:31.079934 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745d6506-01bd-4332-b724-cb8bdf1f5fd1 None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:31.080212 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745d6506-01bd-4332-b724-cb8bdf1f5fd1 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:31.080483 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745d6506-01bd-4332-b724-cb8bdf1f5fd1 None admin] PATH_INFO: `/v3/projects/c4b04f714c5f4e9f96d74e914d3722f4` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:31.081585 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745d6506-01bd-4332-b724-cb8bdf1f5fd1 None admin] RBAC: Authorizing `identity:get_project(project_id=c4b04f714c5f4e9f96d74e914d3722f4)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:34:31.083050 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745d6506-01bd-4332-b724-cb8bdf1f5fd1 None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:34:31.084676 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 534/1078] 10.222.0.26 () {56 vars in 1186 bytes} [Wed Aug 24 05:34:30 2022] GET /identity/v3/projects/c4b04f714c5f4e9f96d74e914d3722f4 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:34:31.085429 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745d6506-01bd-4332-b724-cb8bdf1f5fd1 None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:34:31.114664 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa14ad5f-4ecd-4835-8aa0-09bdccd0696c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:34:31.115283 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa14ad5f-4ecd-4835-8aa0-09bdccd0696c None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:31.115558 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa14ad5f-4ecd-4835-8aa0-09bdccd0696c None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:31.115824 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa14ad5f-4ecd-4835-8aa0-09bdccd0696c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:31.125498 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa14ad5f-4ecd-4835-8aa0-09bdccd0696c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:34:31.126958 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa14ad5f-4ecd-4835-8aa0-09bdccd0696c None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:34:31.142096 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application [None req-fa14ad5f-4ecd-4835-8aa0-09bdccd0696c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:34:31.142096 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:34:31.142096 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:34:31.142096 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:34:31.142096 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:34:31.142096 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:34:31.142096 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:34:31.142096 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:34:31.142096 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:34:31.142096 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:34:31.142096 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:34:31.142096 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:34:31.142096 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 05:34:31.142096 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 05:34:31.142096 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 05:34:31.142096 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 05:34:31.143051 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:34:31.143051 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:34:31.143051 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:34:31.143051 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:34:31.143051 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:34:31.143051 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:34:31.143051 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:34:31.143051 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application with Lock( Aug 24 05:34:31.143051 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:34:31.143051 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:34:31.143051 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:34:31.143051 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:34:31.143051 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:34:31.143051 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:34:31.143051 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:34:31.143051 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:34:31.143051 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 05:34:31.144041 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 05:34:31.144041 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:34:31.144041 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Aug 24 05:34:31.144041 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 545/1079] 10.222.0.26 () {56 vars in 1108 bytes} [Wed Aug 24 05:34:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:34:31.144041 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa14ad5f-4ecd-4835-8aa0-09bdccd0696c None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:34:31.161663 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:34:31.184143 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745d6506-01bd-4332-b724-cb8bdf1f5fd1 None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:34:31.218693 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46504d68-1ed9-423e-ac85-fba8ef7a1b76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:34:31.219313 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46504d68-1ed9-423e-ac85-fba8ef7a1b76 None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:31.219592 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46504d68-1ed9-423e-ac85-fba8ef7a1b76 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:31.219861 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46504d68-1ed9-423e-ac85-fba8ef7a1b76 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:31.227399 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46504d68-1ed9-423e-ac85-fba8ef7a1b76 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:34:31.228830 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46504d68-1ed9-423e-ac85-fba8ef7a1b76 None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:34:31.239601 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application [None req-46504d68-1ed9-423e-ac85-fba8ef7a1b76 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 05:34:31.239601 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:34:31.239601 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:34:31.239601 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:34:31.239601 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:34:31.239601 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:34:31.239601 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:34:31.239601 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:34:31.239601 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:34:31.239601 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:34:31.239601 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:34:31.239601 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:34:31.239601 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 05:34:31.239601 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 05:34:31.239601 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 05:34:31.240504 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 05:34:31.240504 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:34:31.240504 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:34:31.240504 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:34:31.240504 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:34:31.240504 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:34:31.240504 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:34:31.240504 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:34:31.240504 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application with Lock( Aug 24 05:34:31.240504 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:34:31.240504 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:34:31.240504 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:34:31.240504 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:34:31.240504 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:34:31.240504 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:34:31.240504 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:34:31.240504 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:34:31.241411 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 05:34:31.241411 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 05:34:31.241411 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 05:34:31.241411 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 05:34:31.241411 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 05:34:31.241411 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 05:34:31.241411 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 05:34:31.241411 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Aug 24 05:34:31.241411 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 535/1080] 10.222.0.26 () {56 vars in 1111 bytes} [Wed Aug 24 05:34:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:34:31.241411 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46504d68-1ed9-423e-ac85-fba8ef7a1b76 None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:34:31.247068 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa14ad5f-4ecd-4835-8aa0-09bdccd0696c None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:34:31.250117 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:34:31.281994 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04fe979-8690-4780-84b9-093dabdd0594 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:34:31.282645 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04fe979-8690-4780-84b9-093dabdd0594 None admin] REQUEST_METHOD: `PUT` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:31.282923 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04fe979-8690-4780-84b9-093dabdd0594 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:31.283190 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04fe979-8690-4780-84b9-093dabdd0594 None admin] PATH_INFO: `/v3/projects/c4b04f714c5f4e9f96d74e914d3722f4/users/5bbc74901dea40269dfbc782d3bb1a1f/roles/640bda0879494e60b72680ee505285f0` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:31.285082 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04fe979-8690-4780-84b9-093dabdd0594 None admin] RBAC: Authorizing `identity:create_grant(project_id=c4b04f714c5f4e9f96d74e914d3722f4, user_id=5bbc74901dea40269dfbc782d3bb1a1f, role_id=640bda0879494e60b72680ee505285f0)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:34:31.286550 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04fe979-8690-4780-84b9-093dabdd0594 None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:34:31.298799 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 546/1081] 10.222.0.26 () {58 vars in 1439 bytes} [Wed Aug 24 05:34:31 2022] PUT /identity/v3/projects/c4b04f714c5f4e9f96d74e914d3722f4/users/5bbc74901dea40269dfbc782d3bb1a1f/roles/640bda0879494e60b72680ee505285f0 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:34:31.310107 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04fe979-8690-4780-84b9-093dabdd0594 None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:34:31.351246 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46504d68-1ed9-423e-ac85-fba8ef7a1b76 None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:34:31.391271 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee576c95-0e5e-42f5-981c-22bccd4b8199 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:34:31.391899 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee576c95-0e5e-42f5-981c-22bccd4b8199 None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:31.392176 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee576c95-0e5e-42f5-981c-22bccd4b8199 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:31.392445 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee576c95-0e5e-42f5-981c-22bccd4b8199 None admin] PATH_INFO: `/v3/domains` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:31.393101 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee576c95-0e5e-42f5-981c-22bccd4b8199 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:34:31.393398 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee576c95-0e5e-42f5-981c-22bccd4b8199 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:34:31.394965 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee576c95-0e5e-42f5-981c-22bccd4b8199 None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:34:31.397678 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:34:31.418004 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 536/1082] 10.222.0.26 () {56 vars in 1109 bytes} [Wed Aug 24 05:34:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:34:31.433680 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04fe979-8690-4780-84b9-093dabdd0594 None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:34:31.476108 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699187f9-c12a-4d75-a376-9b9d8bc57afd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:34:31.476734 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699187f9-c12a-4d75-a376-9b9d8bc57afd None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:31.477012 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699187f9-c12a-4d75-a376-9b9d8bc57afd None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:31.477280 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699187f9-c12a-4d75-a376-9b9d8bc57afd None admin] PATH_INFO: `/v3/projects` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:31.478017 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699187f9-c12a-4d75-a376-9b9d8bc57afd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:34:31.478421 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699187f9-c12a-4d75-a376-9b9d8bc57afd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:34:31.479780 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699187f9-c12a-4d75-a376-9b9d8bc57afd None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:34:31.498083 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 547/1083] 10.222.0.26 () {56 vars in 1148 bytes} [Wed Aug 24 05:34:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:34:31.500561 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee576c95-0e5e-42f5-981c-22bccd4b8199 None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:34:31.616906 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee576c95-0e5e-42f5-981c-22bccd4b8199 None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:34:31.651246 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841fc90d-5730-423d-8efd-56136229dba8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:34:31.651909 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841fc90d-5730-423d-8efd-56136229dba8 None admin] REQUEST_METHOD: `PUT` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:31.652188 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841fc90d-5730-423d-8efd-56136229dba8 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:31.652457 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841fc90d-5730-423d-8efd-56136229dba8 None admin] PATH_INFO: `/v3/projects/ded4fe81d4dc43188dd84e53025ee783/users/7b633e1aec6c4269bce13aa9c89e911a/roles/bc599913e28e42089c8030b72de2de1f` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:31.655176 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841fc90d-5730-423d-8efd-56136229dba8 None admin] RBAC: Authorizing `identity:create_grant(project_id=ded4fe81d4dc43188dd84e53025ee783, user_id=7b633e1aec6c4269bce13aa9c89e911a, role_id=bc599913e28e42089c8030b72de2de1f)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:34:31.656602 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841fc90d-5730-423d-8efd-56136229dba8 None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:34:31.671303 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 537/1084] 10.222.0.26 () {58 vars in 1439 bytes} [Wed Aug 24 05:34:31 2022] PUT /identity/v3/projects/ded4fe81d4dc43188dd84e53025ee783/users/7b633e1aec6c4269bce13aa9c89e911a/roles/bc599913e28e42089c8030b72de2de1f => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:34:33.217715 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f54707-d7b9-44cc-9989-3ec8e9d8b93c None None] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:33.218330 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f54707-d7b9-44cc-9989-3ec8e9d8b93c None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:33.218330 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f54707-d7b9-44cc-9989-3ec8e9d8b93c None None] PATH_INFO: `/` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:33.219647 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 548/1085] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 24 05:34:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:34:33.224964 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051ab157-cec6-4924-87d6-e89c1f67f040 None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:33.225366 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051ab157-cec6-4924-87d6-e89c1f67f040 None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:33.225505 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051ab157-cec6-4924-87d6-e89c1f67f040 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:33.244096 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-051ab157-cec6-4924-87d6-e89c1f67f040 None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:34:33.245272 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-051ab157-cec6-4924-87d6-e89c1f67f040 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:34:33.295487 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:34:33.312279 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 538/1086] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 24 05:34:33 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 05:34:33.568036 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1089d93e-9469-432e-a265-8af3999f6327 None None] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:33.568327 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1089d93e-9469-432e-a265-8af3999f6327 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:33.568605 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1089d93e-9469-432e-a265-8af3999f6327 None None] PATH_INFO: `/` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:33.569931 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 549/1087] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 24 05:34:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:34:33.575259 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c93c3c-211a-408e-af08-c05f14c97bbc None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:33.576159 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c93c3c-211a-408e-af08-c05f14c97bbc None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:33.576491 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c93c3c-211a-408e-af08-c05f14c97bbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:33.584330 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1089d93e-9469-432e-a265-8af3999f6327 None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:34:33.594739 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-23c93c3c-211a-408e-af08-c05f14c97bbc None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:34:33.595908 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-23c93c3c-211a-408e-af08-c05f14c97bbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:34:33.609160 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:34:33.663102 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 539/1088] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 24 05:34:33 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 05:34:33.684883 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1089d93e-9469-432e-a265-8af3999f6327 None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:34:33.718547 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac34fe9-0178-4275-a181-d7b7debc9e62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:34:33.719163 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac34fe9-0178-4275-a181-d7b7debc9e62 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:33.719445 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac34fe9-0178-4275-a181-d7b7debc9e62 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:33.719720 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac34fe9-0178-4275-a181-d7b7debc9e62 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:33.729648 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac34fe9-0178-4275-a181-d7b7debc9e62 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:34:33.734358 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application [None req-eac34fe9-0178-4275-a181-d7b7debc9e62 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 05:34:33.734358 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:34:33.734358 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:34:33.734358 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:34:33.734358 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:34:33.734358 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:34:33.734358 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:34:33.734358 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:34:33.734358 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:34:33.734358 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:34:33.734358 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:34:33.734358 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:34:33.734358 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:34:33.734358 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:34:33.734358 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:34:33.734358 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:34:33.735453 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:34:33.735453 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:34:33.735453 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:34:33.735453 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:34:33.735453 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:34:33.735453 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:34:33.735453 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:34:33.735453 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:34:33.735453 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:34:33.735453 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:34:33.735453 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:34:33.735453 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application with Lock( Aug 24 05:34:33.735453 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:34:33.735453 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:34:33.735453 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:34:33.735453 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:34:33.736491 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:34:33.736491 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:34:33.736491 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:34:33.736491 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:34:33.736491 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:34:33.736491 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:34:33.736491 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:34:33.736491 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:34:33.736491 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:34:33.736491 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:34:33.736491 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 05:34:33.736491 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Aug 24 05:34:33.736491 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 550/1089] 10.222.0.26 () {56 vars in 1096 bytes} [Wed Aug 24 05:34:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 05:34:33.741331 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c93c3c-211a-408e-af08-c05f14c97bbc None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:34:33.838565 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c93c3c-211a-408e-af08-c05f14c97bbc None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:34:33.854036 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:34:33.871316 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85eb8947-0aad-4ed8-819a-2c09e5bb99fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:34:33.871916 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85eb8947-0aad-4ed8-819a-2c09e5bb99fb None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:33.872190 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85eb8947-0aad-4ed8-819a-2c09e5bb99fb None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:33.872947 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85eb8947-0aad-4ed8-819a-2c09e5bb99fb None admin] PATH_INFO: `/v3/roles` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:33.873600 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85eb8947-0aad-4ed8-819a-2c09e5bb99fb None admin] RBAC: Adding query filter params (name=admin) {{(pid=88112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:34:33.873897 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85eb8947-0aad-4ed8-819a-2c09e5bb99fb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:34:33.875270 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85eb8947-0aad-4ed8-819a-2c09e5bb99fb None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:34:33.882956 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 540/1090] 10.222.0.26 () {56 vars in 1099 bytes} [Wed Aug 24 05:34:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:34:33.889335 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac34fe9-0178-4275-a181-d7b7debc9e62 None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:34:33.936389 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85eb8947-0aad-4ed8-819a-2c09e5bb99fb None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:34:33.973615 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:34:33.989963 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac34fe9-0178-4275-a181-d7b7debc9e62 None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:34:34.023713 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67c85ca-2b9a-4630-b9d3-58d85938cece None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:34:34.024331 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67c85ca-2b9a-4630-b9d3-58d85938cece None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:34.024609 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67c85ca-2b9a-4630-b9d3-58d85938cece None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:34.024879 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67c85ca-2b9a-4630-b9d3-58d85938cece None admin] PATH_INFO: `/v3/users/5bbc74901dea40269dfbc782d3bb1a1f` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:34.026016 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67c85ca-2b9a-4630-b9d3-58d85938cece None admin] RBAC: Authorizing `identity:get_user(user_id=5bbc74901dea40269dfbc782d3bb1a1f)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:34:34.027446 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67c85ca-2b9a-4630-b9d3-58d85938cece None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:34:34.029029 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 551/1091] 10.222.0.26 () {56 vars in 1177 bytes} [Wed Aug 24 05:34:33 2022] GET /identity/v3/users/5bbc74901dea40269dfbc782d3bb1a1f => generated 285 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:34:34.034845 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67c85ca-2b9a-4630-b9d3-58d85938cece None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:34:34.035130 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85eb8947-0aad-4ed8-819a-2c09e5bb99fb None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:34:34.068321 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fe5607-4bd3-476a-9aa1-09ee4f05af1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:34:34.068943 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fe5607-4bd3-476a-9aa1-09ee4f05af1b None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:34.069217 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fe5607-4bd3-476a-9aa1-09ee4f05af1b None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:34.069486 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fe5607-4bd3-476a-9aa1-09ee4f05af1b None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:34.079938 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fe5607-4bd3-476a-9aa1-09ee4f05af1b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:34:34.084920 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application [None req-18fe5607-4bd3-476a-9aa1-09ee4f05af1b None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 05:34:34.084920 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:34:34.084920 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:34:34.084920 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:34:34.084920 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:34:34.084920 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:34:34.084920 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:34:34.084920 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:34:34.084920 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:34:34.084920 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:34:34.084920 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:34:34.084920 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:34:34.084920 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:34:34.084920 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:34:34.084920 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:34:34.084920 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:34:34.086152 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:34:34.086152 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:34:34.086152 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:34:34.086152 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:34:34.086152 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:34:34.086152 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:34:34.086152 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:34:34.086152 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:34:34.086152 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:34:34.086152 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:34:34.086152 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:34:34.086152 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application with Lock( Aug 24 05:34:34.086152 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:34:34.086152 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:34:34.086152 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:34:34.086152 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:34:34.087026 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:34:34.087026 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:34:34.087026 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:34:34.087026 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:34:34.087026 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:34:34.087026 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:34:34.087026 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:34:34.087026 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:34:34.087026 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:34:34.087026 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:34:34.087026 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 05:34:34.087026 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Aug 24 05:34:34.087026 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 541/1092] 10.222.0.26 () {56 vars in 1120 bytes} [Wed Aug 24 05:34:33 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 05:34:34.091955 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fe5607-4bd3-476a-9aa1-09ee4f05af1b None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:34:34.130417 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:34:34.134425 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67c85ca-2b9a-4630-b9d3-58d85938cece None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:34:34.168449 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef8d0d8-ce93-4e6f-b225-03e82e9304e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:34:34.169049 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef8d0d8-ce93-4e6f-b225-03e82e9304e2 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:34.169861 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef8d0d8-ce93-4e6f-b225-03e82e9304e2 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:34.170157 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef8d0d8-ce93-4e6f-b225-03e82e9304e2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:34.189069 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fe5607-4bd3-476a-9aa1-09ee4f05af1b None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:34:34.191235 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:34:34.223035 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13e194b-37d2-4704-a766-65a172166e76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:34:34.223630 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13e194b-37d2-4704-a766-65a172166e76 None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:34.223901 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13e194b-37d2-4704-a766-65a172166e76 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:34.224166 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13e194b-37d2-4704-a766-65a172166e76 None admin] PATH_INFO: `/v3/roles` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:34.224829 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13e194b-37d2-4704-a766-65a172166e76 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=88112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:34:34.225124 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13e194b-37d2-4704-a766-65a172166e76 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:34:34.226504 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13e194b-37d2-4704-a766-65a172166e76 None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:34:34.234807 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 542/1093] 10.222.0.26 () {56 vars in 1115 bytes} [Wed Aug 24 05:34:34 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:34:34.238287 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef8d0d8-ce93-4e6f-b225-03e82e9304e2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:34:34.239871 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef8d0d8-ce93-4e6f-b225-03e82e9304e2 None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:34:34.240345 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13e194b-37d2-4704-a766-65a172166e76 None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:34:34.333998 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:34:34.335895 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 552/1094] 10.222.0.26 () {58 vars in 1282 bytes} [Wed Aug 24 05:34:34 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 24 05:34:34.340235 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13e194b-37d2-4704-a766-65a172166e76 None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:34:34.341739 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef8d0d8-ce93-4e6f-b225-03e82e9304e2 None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:34:34.371569 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e467029-91f6-4f07-b3c3-0438fd0c9670 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:34:34.372124 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e467029-91f6-4f07-b3c3-0438fd0c9670 None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:34.372996 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e467029-91f6-4f07-b3c3-0438fd0c9670 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:34.373267 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e467029-91f6-4f07-b3c3-0438fd0c9670 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:34.383351 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e467029-91f6-4f07-b3c3-0438fd0c9670 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:34:34.384773 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e467029-91f6-4f07-b3c3-0438fd0c9670 None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:34:34.393447 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:34:34.398295 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application [None req-5e467029-91f6-4f07-b3c3-0438fd0c9670 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:34:34.398295 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:34:34.398295 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:34:34.398295 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:34:34.398295 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:34:34.398295 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:34:34.398295 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:34:34.398295 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:34:34.398295 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:34:34.398295 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:34:34.398295 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:34:34.398295 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:34:34.398295 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 05:34:34.398295 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 05:34:34.398295 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 05:34:34.398295 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 05:34:34.399386 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:34:34.399386 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:34:34.399386 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:34:34.399386 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:34:34.399386 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:34:34.399386 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:34:34.399386 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:34:34.399386 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application with Lock( Aug 24 05:34:34.399386 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:34:34.399386 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:34:34.399386 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:34:34.399386 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:34:34.399386 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:34:34.399386 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:34:34.399386 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:34:34.399386 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:34:34.399386 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 05:34:34.400313 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 05:34:34.400313 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:34:34.400313 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Aug 24 05:34:34.400313 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 543/1095] 10.222.0.26 () {56 vars in 1108 bytes} [Wed Aug 24 05:34:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 05:34:34.405230 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e467029-91f6-4f07-b3c3-0438fd0c9670 None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:34:34.440300 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef8d0d8-ce93-4e6f-b225-03e82e9304e2 None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:34:34.473804 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646bd9b6-1e35-42f9-82ac-d4dae612169a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:34:34.474454 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646bd9b6-1e35-42f9-82ac-d4dae612169a None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:34.474728 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646bd9b6-1e35-42f9-82ac-d4dae612169a None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:34.474995 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646bd9b6-1e35-42f9-82ac-d4dae612169a None admin] PATH_INFO: `/v3/projects/c4b04f714c5f4e9f96d74e914d3722f4` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:34.476093 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646bd9b6-1e35-42f9-82ac-d4dae612169a None admin] RBAC: Authorizing `identity:get_project(project_id=c4b04f714c5f4e9f96d74e914d3722f4)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:34:34.477532 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646bd9b6-1e35-42f9-82ac-d4dae612169a None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:34:34.479167 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 553/1096] 10.222.0.26 () {56 vars in 1186 bytes} [Wed Aug 24 05:34:34 2022] GET /identity/v3/projects/c4b04f714c5f4e9f96d74e914d3722f4 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:34:34.485711 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646bd9b6-1e35-42f9-82ac-d4dae612169a None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:34:34.503870 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e467029-91f6-4f07-b3c3-0438fd0c9670 None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:34:34.537863 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac576f19-d484-4652-a0d4-8288535a4afb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:34:34.538497 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac576f19-d484-4652-a0d4-8288535a4afb None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:34.538772 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac576f19-d484-4652-a0d4-8288535a4afb None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:34.539039 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac576f19-d484-4652-a0d4-8288535a4afb None admin] PATH_INFO: `/v3/domains` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:34.539677 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac576f19-d484-4652-a0d4-8288535a4afb None admin] RBAC: Adding query filter params (name=Default) {{(pid=88112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:34:34.539974 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac576f19-d484-4652-a0d4-8288535a4afb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:34:34.541337 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac576f19-d484-4652-a0d4-8288535a4afb None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:34:34.553478 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 544/1097] 10.222.0.26 () {56 vars in 1109 bytes} [Wed Aug 24 05:34:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:34:34.559003 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac576f19-d484-4652-a0d4-8288535a4afb None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:34:34.573246 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:34:34.590178 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646bd9b6-1e35-42f9-82ac-d4dae612169a None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:34:34.611089 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:34:34.626136 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e72385-9fbd-40a2-95d5-1c67f65473a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:34:34.626675 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e72385-9fbd-40a2-95d5-1c67f65473a0 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:34.626953 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e72385-9fbd-40a2-95d5-1c67f65473a0 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:34.627223 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e72385-9fbd-40a2-95d5-1c67f65473a0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:34.627945 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e72385-9fbd-40a2-95d5-1c67f65473a0 None admin] RBAC: Adding query filter params (role.id=640bda0879494e60b72680ee505285f0, scope.project.id=c4b04f714c5f4e9f96d74e914d3722f4, user.id=5bbc74901dea40269dfbc782d3bb1a1f) {{(pid=88113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:34:34.628249 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e72385-9fbd-40a2-95d5-1c67f65473a0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:34:34.629666 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e72385-9fbd-40a2-95d5-1c67f65473a0 None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:34:34.635279 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 554/1098] 10.222.0.26 () {56 vars in 1374 bytes} [Wed Aug 24 05:34:34 2022] GET /identity/v3/role_assignments?user.id=5bbc74901dea40269dfbc782d3bb1a1f&scope.project.id=c4b04f714c5f4e9f96d74e914d3722f4&role.id=640bda0879494e60b72680ee505285f0 => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:34:34.661197 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac576f19-d484-4652-a0d4-8288535a4afb None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:34:34.699219 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2599841-3e8d-487d-82ee-cafe679525f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:34:34.699863 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2599841-3e8d-487d-82ee-cafe679525f2 None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:34.700145 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2599841-3e8d-487d-82ee-cafe679525f2 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:34.700416 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2599841-3e8d-487d-82ee-cafe679525f2 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:34.708246 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2599841-3e8d-487d-82ee-cafe679525f2 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:34:34.709729 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2599841-3e8d-487d-82ee-cafe679525f2 None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:34:34.722665 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application [None req-b2599841-3e8d-487d-82ee-cafe679525f2 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 05:34:34.722665 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:34:34.722665 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:34:34.722665 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:34:34.722665 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:34:34.722665 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:34:34.722665 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:34:34.722665 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:34:34.722665 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:34:34.722665 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:34:34.722665 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:34:34.722665 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:34:34.722665 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 05:34:34.722665 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 05:34:34.722665 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 05:34:34.722665 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 05:34:34.723844 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:34:34.723844 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:34:34.723844 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 05:34:34.723844 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 05:34:34.723844 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 05:34:34.723844 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 05:34:34.723844 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:34:34.723844 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:34:34.723844 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:34:34.723844 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:34:34.723844 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:34:34.723844 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application with Lock( Aug 24 05:34:34.723844 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:34:34.723844 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:34:34.723844 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:34:34.723844 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:34:34.723844 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:34:34.723844 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:34:34.724817 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:34:34.724817 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:34:34.724817 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 05:34:34.724817 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 05:34:34.724817 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 05:34:34.724817 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 05:34:34.724817 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 05:34:34.724817 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 05:34:34.724817 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 05:34:34.724817 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Aug 24 05:34:34.724817 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 545/1099] 10.222.0.26 () {56 vars in 1093 bytes} [Wed Aug 24 05:34:34 2022] GET /identity/v3/users/nova => generated 82 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 05:34:34.729790 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e72385-9fbd-40a2-95d5-1c67f65473a0 None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:34:34.834117 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e72385-9fbd-40a2-95d5-1c67f65473a0 None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:34:34.867092 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bec398-4f0a-475c-9dcd-cf38c6514e13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:34:34.867684 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bec398-4f0a-475c-9dcd-cf38c6514e13 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:34.867963 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bec398-4f0a-475c-9dcd-cf38c6514e13 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:34.868228 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bec398-4f0a-475c-9dcd-cf38c6514e13 None admin] PATH_INFO: `/v3/users` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:34.868943 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bec398-4f0a-475c-9dcd-cf38c6514e13 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:34:34.869244 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bec398-4f0a-475c-9dcd-cf38c6514e13 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:34:34.870693 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bec398-4f0a-475c-9dcd-cf38c6514e13 None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:34:34.887259 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 555/1100] 10.222.0.26 () {56 vars in 1133 bytes} [Wed Aug 24 05:34:34 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:34:34.893577 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2599841-3e8d-487d-82ee-cafe679525f2 None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:34:34.963766 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:34:34.993826 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2599841-3e8d-487d-82ee-cafe679525f2 None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:34:35.026777 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ffcf44-4eab-4aab-801e-9067224f16f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:34:35.027376 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ffcf44-4eab-4aab-801e-9067224f16f9 None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:35.027652 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ffcf44-4eab-4aab-801e-9067224f16f9 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:35.027919 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ffcf44-4eab-4aab-801e-9067224f16f9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:35.093863 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ffcf44-4eab-4aab-801e-9067224f16f9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:34:35.095334 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ffcf44-4eab-4aab-801e-9067224f16f9 None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:34:35.161216 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:34:35.191157 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 546/1101] 10.222.0.26 () {58 vars in 1282 bytes} [Wed Aug 24 05:34:34 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 05:34:35.196831 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bec398-4f0a-475c-9dcd-cf38c6514e13 None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:34:35.239132 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:34:35.293210 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bec398-4f0a-475c-9dcd-cf38c6514e13 None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:34:35.327366 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a4cca0-20a3-483f-9ccc-ce2c801899a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:34:35.327988 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a4cca0-20a3-483f-9ccc-ce2c801899a5 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:35.328262 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a4cca0-20a3-483f-9ccc-ce2c801899a5 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:35.328529 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a4cca0-20a3-483f-9ccc-ce2c801899a5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:35.338072 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a4cca0-20a3-483f-9ccc-ce2c801899a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:34:35.339499 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a4cca0-20a3-483f-9ccc-ce2c801899a5 None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:34:35.353262 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application [None req-22a4cca0-20a3-483f-9ccc-ce2c801899a5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:34:35.353262 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:34:35.353262 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:34:35.353262 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:34:35.353262 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:34:35.353262 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:34:35.353262 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:34:35.353262 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:34:35.353262 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:34:35.353262 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:34:35.353262 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:34:35.353262 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:34:35.353262 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 05:34:35.353262 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 05:34:35.353262 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 05:34:35.353262 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 05:34:35.354483 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:34:35.354483 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:34:35.354483 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:34:35.354483 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:34:35.354483 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:34:35.354483 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:34:35.354483 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:34:35.354483 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application with Lock( Aug 24 05:34:35.354483 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:34:35.354483 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:34:35.354483 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:34:35.354483 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:34:35.354483 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:34:35.354483 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:34:35.354483 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:34:35.354483 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:34:35.354483 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 05:34:35.355410 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 05:34:35.355410 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:34:35.355410 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Aug 24 05:34:35.355410 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 556/1102] 10.222.0.26 () {56 vars in 1108 bytes} [Wed Aug 24 05:34:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:34:35.360172 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ffcf44-4eab-4aab-801e-9067224f16f9 None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:34:35.456430 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ffcf44-4eab-4aab-801e-9067224f16f9 None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:34:35.488411 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225ad7b9-dccc-4be9-8399-a061f4302468 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:34:35.489010 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225ad7b9-dccc-4be9-8399-a061f4302468 None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:35.489290 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225ad7b9-dccc-4be9-8399-a061f4302468 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:35.489558 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225ad7b9-dccc-4be9-8399-a061f4302468 None admin] PATH_INFO: `/v3/domains` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:35.490221 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225ad7b9-dccc-4be9-8399-a061f4302468 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:34:35.490523 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225ad7b9-dccc-4be9-8399-a061f4302468 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:34:35.491867 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225ad7b9-dccc-4be9-8399-a061f4302468 None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:34:35.503443 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 547/1103] 10.222.0.26 () {56 vars in 1109 bytes} [Wed Aug 24 05:34:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:34:35.509169 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a4cca0-20a3-483f-9ccc-ce2c801899a5 None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:34:35.601837 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:34:35.609785 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a4cca0-20a3-483f-9ccc-ce2c801899a5 None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:34:35.643150 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed55f84d-eec2-48d2-b9c7-57daf2344dfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:34:35.643777 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed55f84d-eec2-48d2-b9c7-57daf2344dfc None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:35.644059 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed55f84d-eec2-48d2-b9c7-57daf2344dfc None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:35.644332 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed55f84d-eec2-48d2-b9c7-57daf2344dfc None admin] PATH_INFO: `/v3/projects/service` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:35.651031 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed55f84d-eec2-48d2-b9c7-57daf2344dfc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:34:35.652472 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed55f84d-eec2-48d2-b9c7-57daf2344dfc None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:34:35.663493 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application [None req-ed55f84d-eec2-48d2-b9c7-57daf2344dfc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 05:34:35.663493 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:34:35.663493 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:34:35.663493 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:34:35.663493 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:34:35.663493 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:34:35.663493 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:34:35.663493 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:34:35.663493 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:34:35.663493 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:34:35.663493 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:34:35.663493 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:34:35.663493 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 05:34:35.663493 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 05:34:35.663493 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 05:34:35.664553 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 05:34:35.664553 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:34:35.664553 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:34:35.664553 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:34:35.664553 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:34:35.664553 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:34:35.664553 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:34:35.664553 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:34:35.664553 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application with Lock( Aug 24 05:34:35.664553 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:34:35.664553 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:34:35.664553 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:34:35.664553 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:34:35.664553 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:34:35.664553 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:34:35.664553 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:34:35.664553 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:34:35.671000 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 05:34:35.671000 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 05:34:35.671000 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 05:34:35.671000 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 05:34:35.671000 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 05:34:35.671000 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 05:34:35.671000 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 05:34:35.671000 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Aug 24 05:34:35.671000 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 557/1104] 10.222.0.26 () {56 vars in 1111 bytes} [Wed Aug 24 05:34:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:34:35.671491 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225ad7b9-dccc-4be9-8399-a061f4302468 None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:34:35.702422 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:34:35.771987 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225ad7b9-dccc-4be9-8399-a061f4302468 None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:34:35.804354 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb60599-e963-483d-a37f-db89e3e7fb3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:34:35.804946 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb60599-e963-483d-a37f-db89e3e7fb3b None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:35.805221 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb60599-e963-483d-a37f-db89e3e7fb3b None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:35.805485 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb60599-e963-483d-a37f-db89e3e7fb3b None admin] PATH_INFO: `/v3/projects` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:35.806206 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb60599-e963-483d-a37f-db89e3e7fb3b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:34:35.806505 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb60599-e963-483d-a37f-db89e3e7fb3b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:34:35.807902 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb60599-e963-483d-a37f-db89e3e7fb3b None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:34:35.820117 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 548/1105] 10.222.0.26 () {56 vars in 1148 bytes} [Wed Aug 24 05:34:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:34:35.826094 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed55f84d-eec2-48d2-b9c7-57daf2344dfc None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:34:35.923073 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed55f84d-eec2-48d2-b9c7-57daf2344dfc None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:34:35.955839 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b22ba3-8cf3-4c1b-bc19-f152c98dac84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:34:35.956429 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b22ba3-8cf3-4c1b-bc19-f152c98dac84 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:35.956710 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b22ba3-8cf3-4c1b-bc19-f152c98dac84 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:35.956981 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b22ba3-8cf3-4c1b-bc19-f152c98dac84 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:35.957700 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b22ba3-8cf3-4c1b-bc19-f152c98dac84 None admin] RBAC: Adding query filter params (role.id=bc599913e28e42089c8030b72de2de1f, scope.project.id=ded4fe81d4dc43188dd84e53025ee783, user.id=7b633e1aec6c4269bce13aa9c89e911a) {{(pid=88113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:34:35.958045 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b22ba3-8cf3-4c1b-bc19-f152c98dac84 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:34:35.959481 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b22ba3-8cf3-4c1b-bc19-f152c98dac84 None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:34:35.965094 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 558/1106] 10.222.0.26 () {56 vars in 1374 bytes} [Wed Aug 24 05:34:35 2022] GET /identity/v3/role_assignments?user.id=7b633e1aec6c4269bce13aa9c89e911a&scope.project.id=ded4fe81d4dc43188dd84e53025ee783&role.id=bc599913e28e42089c8030b72de2de1f => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:34:36.571023 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a0c2f4-299a-4619-b189-03ea5bc1156d None None] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:36.571523 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a0c2f4-299a-4619-b189-03ea5bc1156d None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:36.571609 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a0c2f4-299a-4619-b189-03ea5bc1156d None None] PATH_INFO: `/` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:36.572893 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 549/1107] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 24 05:34:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:34:36.578256 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f829acb2-f264-4181-9e51-7f73304796d6 None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:36.578707 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f829acb2-f264-4181-9e51-7f73304796d6 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:36.578819 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f829acb2-f264-4181-9e51-7f73304796d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:36.596873 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-f829acb2-f264-4181-9e51-7f73304796d6 None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:34:36.598102 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-f829acb2-f264-4181-9e51-7f73304796d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:34:36.612068 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:34:36.667210 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 559/1108] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 24 05:34:36 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 05:34:36.937180 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a0c2f4-299a-4619-b189-03ea5bc1156d None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:34:37.026689 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:34:37.037151 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a0c2f4-299a-4619-b189-03ea5bc1156d None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:34:37.070322 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490730d6-e681-4eb0-9bba-d5164193c680 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:34:37.070939 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490730d6-e681-4eb0-9bba-d5164193c680 None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:37.071220 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490730d6-e681-4eb0-9bba-d5164193c680 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:37.071489 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490730d6-e681-4eb0-9bba-d5164193c680 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:37.072595 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490730d6-e681-4eb0-9bba-d5164193c680 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:34:37.074038 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490730d6-e681-4eb0-9bba-d5164193c680 None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:34:37.075601 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 550/1109] 10.222.0.26 () {56 vars in 1108 bytes} [Wed Aug 24 05:34:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:34:37.081238 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f829acb2-f264-4181-9e51-7f73304796d6 None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:34:37.175813 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f829acb2-f264-4181-9e51-7f73304796d6 None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:34:37.208131 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5917e18-6f46-4299-a950-2f99fede33a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:34:37.208743 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5917e18-6f46-4299-a950-2f99fede33a4 None admin] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:37.209016 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5917e18-6f46-4299-a950-2f99fede33a4 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:37.209279 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5917e18-6f46-4299-a950-2f99fede33a4 None admin] PATH_INFO: `/v3/users` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:37.209915 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5917e18-6f46-4299-a950-2f99fede33a4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:34:37.211357 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5917e18-6f46-4299-a950-2f99fede33a4 None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:34:37.231984 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 560/1110] 10.222.0.26 () {60 vars in 1132 bytes} [Wed Aug 24 05:34:37 2022] POST /identity/v3/users => generated 286 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:34:39.138683 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe3360d-f3de-452b-a4c6-22f2ffe5e8a0 None None] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:39.139241 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe3360d-f3de-452b-a4c6-22f2ffe5e8a0 None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:39.139336 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe3360d-f3de-452b-a4c6-22f2ffe5e8a0 None None] PATH_INFO: `/` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:39.140608 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 551/1111] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 24 05:34:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:34:39.145989 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b45665-327c-43ae-8d43-0d8346ba95e7 None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:39.146387 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b45665-327c-43ae-8d43-0d8346ba95e7 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:39.146566 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b45665-327c-43ae-8d43-0d8346ba95e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:39.153676 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:34:39.164699 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-66b45665-327c-43ae-8d43-0d8346ba95e7 None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:34:39.165863 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-66b45665-327c-43ae-8d43-0d8346ba95e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:34:39.230886 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 561/1112] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 24 05:34:39 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 05:34:39.496687 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe3360d-f3de-452b-a4c6-22f2ffe5e8a0 None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:34:39.593896 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe3360d-f3de-452b-a4c6-22f2ffe5e8a0 None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:34:39.626767 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af67358a-4556-4239-8f9b-bb0b6daaf6aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:34:39.627383 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af67358a-4556-4239-8f9b-bb0b6daaf6aa None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:39.627662 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af67358a-4556-4239-8f9b-bb0b6daaf6aa None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:39.627932 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af67358a-4556-4239-8f9b-bb0b6daaf6aa None admin] PATH_INFO: `/v3/roles/109c3556f4644bd291e81b0aa7fe2598` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:39.629301 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af67358a-4556-4239-8f9b-bb0b6daaf6aa None admin] RBAC: Authorizing `identity:get_role(role_id=109c3556f4644bd291e81b0aa7fe2598)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:34:39.630680 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af67358a-4556-4239-8f9b-bb0b6daaf6aa None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:34:39.631982 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 552/1113] 10.222.0.26 () {56 vars in 1177 bytes} [Wed Aug 24 05:34:39 2022] GET /identity/v3/roles/109c3556f4644bd291e81b0aa7fe2598 => generated 223 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:34:39.637817 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b45665-327c-43ae-8d43-0d8346ba95e7 None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:34:39.732510 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b45665-327c-43ae-8d43-0d8346ba95e7 None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:34:39.764137 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02ae44d-0e6b-4047-8ec5-840de9f8f6f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:34:39.764686 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02ae44d-0e6b-4047-8ec5-840de9f8f6f5 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:39.764961 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02ae44d-0e6b-4047-8ec5-840de9f8f6f5 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:39.765232 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02ae44d-0e6b-4047-8ec5-840de9f8f6f5 None admin] PATH_INFO: `/v3/users/98a9fcfb56fd42b9a6ec5f5716a52bf0` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:39.767053 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:34:39.779361 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02ae44d-0e6b-4047-8ec5-840de9f8f6f5 None admin] RBAC: Authorizing `identity:get_user(user_id=98a9fcfb56fd42b9a6ec5f5716a52bf0)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:34:39.780783 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02ae44d-0e6b-4047-8ec5-840de9f8f6f5 None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:34:39.782430 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 562/1114] 10.222.0.26 () {56 vars in 1177 bytes} [Wed Aug 24 05:34:39 2022] GET /identity/v3/users/98a9fcfb56fd42b9a6ec5f5716a52bf0 => generated 286 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:34:39.788000 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af67358a-4556-4239-8f9b-bb0b6daaf6aa None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:34:39.815471 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:34:39.884850 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af67358a-4556-4239-8f9b-bb0b6daaf6aa None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:34:39.917561 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a54a5d-3522-4a08-b1ff-1574717012c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:34:39.918354 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a54a5d-3522-4a08-b1ff-1574717012c5 None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:39.918638 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a54a5d-3522-4a08-b1ff-1574717012c5 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:39.919611 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a54a5d-3522-4a08-b1ff-1574717012c5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:39.985617 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a54a5d-3522-4a08-b1ff-1574717012c5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:34:39.987072 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a54a5d-3522-4a08-b1ff-1574717012c5 None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:34:40.012091 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:34:40.081051 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 553/1115] 10.222.0.26 () {58 vars in 1282 bytes} [Wed Aug 24 05:34:39 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 05:34:40.086913 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02ae44d-0e6b-4047-8ec5-840de9f8f6f5 None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:34:40.183453 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02ae44d-0e6b-4047-8ec5-840de9f8f6f5 None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:34:40.216668 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbda89b6-a428-4546-9d93-5c53f537c624 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:34:40.217276 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbda89b6-a428-4546-9d93-5c53f537c624 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:40.217553 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbda89b6-a428-4546-9d93-5c53f537c624 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:40.217821 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbda89b6-a428-4546-9d93-5c53f537c624 None admin] PATH_INFO: `/v3/projects/c4b04f714c5f4e9f96d74e914d3722f4` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:40.218937 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbda89b6-a428-4546-9d93-5c53f537c624 None admin] RBAC: Authorizing `identity:get_project(project_id=c4b04f714c5f4e9f96d74e914d3722f4)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:34:40.220338 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbda89b6-a428-4546-9d93-5c53f537c624 None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:34:40.221912 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 563/1116] 10.222.0.26 () {56 vars in 1186 bytes} [Wed Aug 24 05:34:40 2022] GET /identity/v3/projects/c4b04f714c5f4e9f96d74e914d3722f4 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:34:40.227924 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a54a5d-3522-4a08-b1ff-1574717012c5 None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:34:40.322795 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a54a5d-3522-4a08-b1ff-1574717012c5 None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:34:40.348748 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:34:40.356718 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfd9ebd-4f13-42a4-bfd3-937461260a7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:34:40.357306 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfd9ebd-4f13-42a4-bfd3-937461260a7b None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:40.357581 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfd9ebd-4f13-42a4-bfd3-937461260a7b None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:40.357846 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfd9ebd-4f13-42a4-bfd3-937461260a7b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:40.358582 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfd9ebd-4f13-42a4-bfd3-937461260a7b None admin] RBAC: Adding query filter params (role.id=109c3556f4644bd291e81b0aa7fe2598, scope.project.id=c4b04f714c5f4e9f96d74e914d3722f4, user.id=98a9fcfb56fd42b9a6ec5f5716a52bf0) {{(pid=88112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:34:40.358884 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfd9ebd-4f13-42a4-bfd3-937461260a7b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:34:40.360293 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfd9ebd-4f13-42a4-bfd3-937461260a7b None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:34:40.365390 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 554/1117] 10.222.0.26 () {56 vars in 1374 bytes} [Wed Aug 24 05:34:40 2022] GET /identity/v3/role_assignments?user.id=98a9fcfb56fd42b9a6ec5f5716a52bf0&scope.project.id=c4b04f714c5f4e9f96d74e914d3722f4&role.id=109c3556f4644bd291e81b0aa7fe2598 => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:34:42.208729 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e653bce-c8cf-4fff-8ed7-39706c55e696 None None] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:42.209259 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e653bce-c8cf-4fff-8ed7-39706c55e696 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:42.209259 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e653bce-c8cf-4fff-8ed7-39706c55e696 None None] PATH_INFO: `/` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:42.210628 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 564/1118] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 24 05:34:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:34:42.216151 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c94fae-f1e0-46fd-b5f1-e5819c880ee1 None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:42.216522 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c94fae-f1e0-46fd-b5f1-e5819c880ee1 None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:42.216692 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c94fae-f1e0-46fd-b5f1-e5819c880ee1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:42.234874 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-a3c94fae-f1e0-46fd-b5f1-e5819c880ee1 None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:34:42.236300 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-a3c94fae-f1e0-46fd-b5f1-e5819c880ee1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:34:42.300111 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 555/1119] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 24 05:34:42 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 05:34:42.568524 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e653bce-c8cf-4fff-8ed7-39706c55e696 None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:34:42.627322 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:34:42.667616 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e653bce-c8cf-4fff-8ed7-39706c55e696 None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:34:42.701413 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb5b59e-0eb4-437b-8afa-a648e2c3d484 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:34:42.702055 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb5b59e-0eb4-437b-8afa-a648e2c3d484 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:42.702340 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb5b59e-0eb4-437b-8afa-a648e2c3d484 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:42.702614 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb5b59e-0eb4-437b-8afa-a648e2c3d484 None admin] PATH_INFO: `/v3/roles/109c3556f4644bd291e81b0aa7fe2598` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:42.703998 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb5b59e-0eb4-437b-8afa-a648e2c3d484 None admin] RBAC: Authorizing `identity:get_role(role_id=109c3556f4644bd291e81b0aa7fe2598)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:34:42.705364 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb5b59e-0eb4-437b-8afa-a648e2c3d484 None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:34:42.706692 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 565/1120] 10.222.0.26 () {56 vars in 1177 bytes} [Wed Aug 24 05:34:42 2022] GET /identity/v3/roles/109c3556f4644bd291e81b0aa7fe2598 => generated 223 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:34:42.712527 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c94fae-f1e0-46fd-b5f1-e5819c880ee1 None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:34:42.807981 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c94fae-f1e0-46fd-b5f1-e5819c880ee1 None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:34:42.829298 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:34:42.841292 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26360f0a-7fc9-4810-9ca8-f50514547c72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:34:42.841906 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26360f0a-7fc9-4810-9ca8-f50514547c72 None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:42.842208 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26360f0a-7fc9-4810-9ca8-f50514547c72 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:42.842476 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26360f0a-7fc9-4810-9ca8-f50514547c72 None admin] PATH_INFO: `/v3/users/98a9fcfb56fd42b9a6ec5f5716a52bf0` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:42.843571 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26360f0a-7fc9-4810-9ca8-f50514547c72 None admin] RBAC: Authorizing `identity:get_user(user_id=98a9fcfb56fd42b9a6ec5f5716a52bf0)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:34:42.844986 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26360f0a-7fc9-4810-9ca8-f50514547c72 None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:34:42.846576 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 556/1121] 10.222.0.26 () {56 vars in 1177 bytes} [Wed Aug 24 05:34:42 2022] GET /identity/v3/users/98a9fcfb56fd42b9a6ec5f5716a52bf0 => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:34:42.852314 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb5b59e-0eb4-437b-8afa-a648e2c3d484 None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:34:42.954183 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb5b59e-0eb4-437b-8afa-a648e2c3d484 None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:34:42.979978 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:34:42.988563 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ec3716-7caf-4378-bf4d-3ea1242f7f2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:34:42.989187 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ec3716-7caf-4378-bf4d-3ea1242f7f2f None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:42.989468 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ec3716-7caf-4378-bf4d-3ea1242f7f2f None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:42.989740 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ec3716-7caf-4378-bf4d-3ea1242f7f2f None admin] PATH_INFO: `/v3/projects/c4b04f714c5f4e9f96d74e914d3722f4` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:42.990874 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ec3716-7caf-4378-bf4d-3ea1242f7f2f None admin] RBAC: Authorizing `identity:get_project(project_id=c4b04f714c5f4e9f96d74e914d3722f4)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:34:42.992305 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ec3716-7caf-4378-bf4d-3ea1242f7f2f None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:34:42.993919 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 566/1122] 10.222.0.26 () {56 vars in 1186 bytes} [Wed Aug 24 05:34:42 2022] GET /identity/v3/projects/c4b04f714c5f4e9f96d74e914d3722f4 => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:34:42.999819 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26360f0a-7fc9-4810-9ca8-f50514547c72 None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:34:43.095510 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26360f0a-7fc9-4810-9ca8-f50514547c72 None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:34:43.127675 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb4f6b2-a360-4996-ad4a-3dcf63e33341 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:34:43.128316 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb4f6b2-a360-4996-ad4a-3dcf63e33341 None admin] REQUEST_METHOD: `PUT` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:43.128596 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb4f6b2-a360-4996-ad4a-3dcf63e33341 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:43.128870 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb4f6b2-a360-4996-ad4a-3dcf63e33341 None admin] PATH_INFO: `/v3/projects/c4b04f714c5f4e9f96d74e914d3722f4/users/98a9fcfb56fd42b9a6ec5f5716a52bf0/roles/109c3556f4644bd291e81b0aa7fe2598` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:43.131005 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb4f6b2-a360-4996-ad4a-3dcf63e33341 None admin] RBAC: Authorizing `identity:create_grant(project_id=c4b04f714c5f4e9f96d74e914d3722f4, user_id=98a9fcfb56fd42b9a6ec5f5716a52bf0, role_id=109c3556f4644bd291e81b0aa7fe2598)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:34:43.132420 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb4f6b2-a360-4996-ad4a-3dcf63e33341 None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:34:43.145376 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 557/1123] 10.222.0.26 () {58 vars in 1439 bytes} [Wed Aug 24 05:34:42 2022] PUT /identity/v3/projects/c4b04f714c5f4e9f96d74e914d3722f4/users/98a9fcfb56fd42b9a6ec5f5716a52bf0/roles/109c3556f4644bd291e81b0aa7fe2598 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:34:44.983069 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a76299-fc2e-46d3-aec9-868e7dce5dc5 None None] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:44.984678 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a76299-fc2e-46d3-aec9-868e7dce5dc5 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:44.984678 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a76299-fc2e-46d3-aec9-868e7dce5dc5 None None] PATH_INFO: `/` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:44.985140 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 567/1124] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 24 05:34:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:34:44.990410 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd0e108-8332-4b35-a8dd-a661a5edf82b None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:44.990875 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd0e108-8332-4b35-a8dd-a661a5edf82b None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:44.990980 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd0e108-8332-4b35-a8dd-a661a5edf82b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:45.009128 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-8bd0e108-8332-4b35-a8dd-a661a5edf82b None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:34:45.010328 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-8bd0e108-8332-4b35-a8dd-a661a5edf82b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:34:45.054089 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:34:45.076014 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 558/1125] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 24 05:34:44 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 05:34:45.339333 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a76299-fc2e-46d3-aec9-868e7dce5dc5 None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:34:45.437259 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a76299-fc2e-46d3-aec9-868e7dce5dc5 None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:34:45.469297 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d1fba8-82c0-4b7d-b730-93906838b0dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:34:45.469907 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d1fba8-82c0-4b7d-b730-93906838b0dc None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:45.470216 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d1fba8-82c0-4b7d-b730-93906838b0dc None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:45.470490 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d1fba8-82c0-4b7d-b730-93906838b0dc None admin] PATH_INFO: `/v3/roles/109c3556f4644bd291e81b0aa7fe2598` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:45.471861 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d1fba8-82c0-4b7d-b730-93906838b0dc None admin] RBAC: Authorizing `identity:get_role(role_id=109c3556f4644bd291e81b0aa7fe2598)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:34:45.473218 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d1fba8-82c0-4b7d-b730-93906838b0dc None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:34:45.474543 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 568/1126] 10.222.0.26 () {56 vars in 1177 bytes} [Wed Aug 24 05:34:45 2022] GET /identity/v3/roles/109c3556f4644bd291e81b0aa7fe2598 => generated 223 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:34:45.480265 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd0e108-8332-4b35-a8dd-a661a5edf82b None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:34:45.574958 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd0e108-8332-4b35-a8dd-a661a5edf82b None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:34:45.607191 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec34fe0-1b95-4226-9719-4098dbf72b59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:34:45.607752 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec34fe0-1b95-4226-9719-4098dbf72b59 None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:45.608029 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec34fe0-1b95-4226-9719-4098dbf72b59 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:45.608293 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec34fe0-1b95-4226-9719-4098dbf72b59 None admin] PATH_INFO: `/v3/users/98a9fcfb56fd42b9a6ec5f5716a52bf0` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:45.609385 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec34fe0-1b95-4226-9719-4098dbf72b59 None admin] RBAC: Authorizing `identity:get_user(user_id=98a9fcfb56fd42b9a6ec5f5716a52bf0)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:34:45.610933 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec34fe0-1b95-4226-9719-4098dbf72b59 None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:34:45.612479 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 559/1127] 10.222.0.26 () {56 vars in 1177 bytes} [Wed Aug 24 05:34:45 2022] GET /identity/v3/users/98a9fcfb56fd42b9a6ec5f5716a52bf0 => generated 286 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:34:45.618190 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d1fba8-82c0-4b7d-b730-93906838b0dc None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:34:45.678919 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:34:45.716091 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d1fba8-82c0-4b7d-b730-93906838b0dc None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:34:45.748686 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da036f2f-e565-4826-bdde-2651df1dc094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:34:45.749281 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da036f2f-e565-4826-bdde-2651df1dc094 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:45.749558 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da036f2f-e565-4826-bdde-2651df1dc094 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:45.749822 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da036f2f-e565-4826-bdde-2651df1dc094 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:45.813648 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da036f2f-e565-4826-bdde-2651df1dc094 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:34:45.815107 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da036f2f-e565-4826-bdde-2651df1dc094 None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:34:45.872731 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:34:45.909964 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 569/1128] 10.222.0.26 () {58 vars in 1282 bytes} [Wed Aug 24 05:34:45 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 05:34:45.915718 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec34fe0-1b95-4226-9719-4098dbf72b59 None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:34:45.964348 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:34:46.013871 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec34fe0-1b95-4226-9719-4098dbf72b59 None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:34:46.047131 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972e3030-c56b-4db7-9647-0ffb87b89df5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:34:46.047748 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972e3030-c56b-4db7-9647-0ffb87b89df5 None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:46.048029 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972e3030-c56b-4db7-9647-0ffb87b89df5 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:46.048303 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972e3030-c56b-4db7-9647-0ffb87b89df5 None admin] PATH_INFO: `/v3/projects/c4b04f714c5f4e9f96d74e914d3722f4` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:46.049413 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972e3030-c56b-4db7-9647-0ffb87b89df5 None admin] RBAC: Authorizing `identity:get_project(project_id=c4b04f714c5f4e9f96d74e914d3722f4)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:34:46.050859 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972e3030-c56b-4db7-9647-0ffb87b89df5 None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:34:46.052462 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 560/1129] 10.222.0.26 () {56 vars in 1186 bytes} [Wed Aug 24 05:34:45 2022] GET /identity/v3/projects/c4b04f714c5f4e9f96d74e914d3722f4 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:34:46.058518 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da036f2f-e565-4826-bdde-2651df1dc094 None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:34:46.154441 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da036f2f-e565-4826-bdde-2651df1dc094 None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:34:46.186275 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32320803-258a-4e57-b3ad-8aabf02d6031 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:34:46.186863 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32320803-258a-4e57-b3ad-8aabf02d6031 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:46.187142 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32320803-258a-4e57-b3ad-8aabf02d6031 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:46.187412 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32320803-258a-4e57-b3ad-8aabf02d6031 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:46.188126 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32320803-258a-4e57-b3ad-8aabf02d6031 None admin] RBAC: Adding query filter params (role.id=109c3556f4644bd291e81b0aa7fe2598, scope.project.id=c4b04f714c5f4e9f96d74e914d3722f4, user.id=98a9fcfb56fd42b9a6ec5f5716a52bf0) {{(pid=88113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:34:46.188432 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32320803-258a-4e57-b3ad-8aabf02d6031 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:34:46.189847 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32320803-258a-4e57-b3ad-8aabf02d6031 None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:34:46.195640 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 570/1130] 10.222.0.26 () {56 vars in 1374 bytes} [Wed Aug 24 05:34:46 2022] GET /identity/v3/role_assignments?user.id=98a9fcfb56fd42b9a6ec5f5716a52bf0&scope.project.id=c4b04f714c5f4e9f96d74e914d3722f4&role.id=109c3556f4644bd291e81b0aa7fe2598 => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:34:48.064268 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a3d86d-d573-4b89-b8d7-070642a65905 None None] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:48.064796 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a3d86d-d573-4b89-b8d7-070642a65905 None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:48.064921 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a3d86d-d573-4b89-b8d7-070642a65905 None None] PATH_INFO: `/` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:48.066523 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 561/1131] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 24 05:34:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:34:48.071671 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075165ac-d182-4e00-a927-0d5b26f27a2b None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:48.072093 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075165ac-d182-4e00-a927-0d5b26f27a2b None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:48.072199 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075165ac-d182-4e00-a927-0d5b26f27a2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:48.089766 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-075165ac-d182-4e00-a927-0d5b26f27a2b None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:34:48.091476 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-075165ac-d182-4e00-a927-0d5b26f27a2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:34:48.113770 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:34:48.157006 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 571/1132] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 24 05:34:48 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 05:34:48.420263 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a3d86d-d573-4b89-b8d7-070642a65905 None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:34:48.519305 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a3d86d-d573-4b89-b8d7-070642a65905 None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:34:48.535695 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:34:48.553905 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df00a046-1b85-4495-ab11-ce4cbce3bfbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:34:48.554552 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df00a046-1b85-4495-ab11-ce4cbce3bfbb None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:48.554832 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df00a046-1b85-4495-ab11-ce4cbce3bfbb None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:48.555103 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df00a046-1b85-4495-ab11-ce4cbce3bfbb None admin] PATH_INFO: `/v3/domains/default` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:48.556204 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df00a046-1b85-4495-ab11-ce4cbce3bfbb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:34:48.557626 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df00a046-1b85-4495-ab11-ce4cbce3bfbb None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:34:48.559785 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 562/1133] 10.222.0.26 () {56 vars in 1108 bytes} [Wed Aug 24 05:34:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:34:48.565760 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075165ac-d182-4e00-a927-0d5b26f27a2b None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:34:48.662299 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075165ac-d182-4e00-a927-0d5b26f27a2b None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:34:48.695948 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0137d6-6871-43b9-8cea-5e4a03c4b38c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:34:48.696546 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0137d6-6871-43b9-8cea-5e4a03c4b38c None admin] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:48.696827 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0137d6-6871-43b9-8cea-5e4a03c4b38c None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:48.697099 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0137d6-6871-43b9-8cea-5e4a03c4b38c None admin] PATH_INFO: `/v3/projects` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:48.697745 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0137d6-6871-43b9-8cea-5e4a03c4b38c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:34:48.699206 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0137d6-6871-43b9-8cea-5e4a03c4b38c None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:34:48.725217 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 572/1134] 10.222.0.26 () {60 vars in 1141 bytes} [Wed Aug 24 05:34:48 2022] POST /identity/v3/projects => generated 311 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:34:50.660764 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3828c61-919a-46a6-b788-837d12802b03 None None] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:50.661309 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3828c61-919a-46a6-b788-837d12802b03 None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:50.661309 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3828c61-919a-46a6-b788-837d12802b03 None None] PATH_INFO: `/` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:50.662679 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 563/1135] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 24 05:34:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:34:50.667834 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a54e13-841f-4961-bb54-ca24338f6110 None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:50.668297 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a54e13-841f-4961-bb54-ca24338f6110 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:50.668478 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a54e13-841f-4961-bb54-ca24338f6110 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:50.685932 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-27a54e13-841f-4961-bb54-ca24338f6110 None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:34:50.687121 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-27a54e13-841f-4961-bb54-ca24338f6110 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:34:50.689772 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:34:50.752873 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 573/1136] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 24 05:34:50 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 05:34:51.036173 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3828c61-919a-46a6-b788-837d12802b03 None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:34:51.133632 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3828c61-919a-46a6-b788-837d12802b03 None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:34:51.165886 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cae4cc-2406-4523-ba81-bbcf3fb27ced None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:34:51.166527 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cae4cc-2406-4523-ba81-bbcf3fb27ced None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:51.166807 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cae4cc-2406-4523-ba81-bbcf3fb27ced None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:51.167075 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cae4cc-2406-4523-ba81-bbcf3fb27ced None admin] PATH_INFO: `/v3/domains/default` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:51.168193 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cae4cc-2406-4523-ba81-bbcf3fb27ced None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:34:51.169600 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cae4cc-2406-4523-ba81-bbcf3fb27ced None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:34:51.171163 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 564/1137] 10.222.0.26 () {56 vars in 1108 bytes} [Wed Aug 24 05:34:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:34:51.176644 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a54e13-841f-4961-bb54-ca24338f6110 None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:34:51.271750 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a54e13-841f-4961-bb54-ca24338f6110 None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:34:51.303528 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c6489f-184d-4471-a88c-c583cc545b71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:34:51.304058 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c6489f-184d-4471-a88c-c583cc545b71 None admin] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:51.304333 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c6489f-184d-4471-a88c-c583cc545b71 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:51.304598 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c6489f-184d-4471-a88c-c583cc545b71 None admin] PATH_INFO: `/v3/users` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:51.305222 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c6489f-184d-4471-a88c-c583cc545b71 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:34:51.306672 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c6489f-184d-4471-a88c-c583cc545b71 None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:34:51.317847 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:34:51.329316 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 574/1138] 10.222.0.26 () {60 vars in 1132 bytes} [Wed Aug 24 05:34:51 2022] POST /identity/v3/users => generated 286 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:34:53.271462 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598e9699-e467-4077-a3a7-47b30e3f10ec None None] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:53.271995 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598e9699-e467-4077-a3a7-47b30e3f10ec None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:53.271995 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598e9699-e467-4077-a3a7-47b30e3f10ec None None] PATH_INFO: `/` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:53.273337 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 565/1139] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 24 05:34:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:34:53.278648 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17cd716-7e5a-48f8-9f97-5a47f3d7f359 None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:53.279087 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17cd716-7e5a-48f8-9f97-5a47f3d7f359 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:53.279182 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17cd716-7e5a-48f8-9f97-5a47f3d7f359 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:53.296854 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-e17cd716-7e5a-48f8-9f97-5a47f3d7f359 None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:34:53.298053 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-e17cd716-7e5a-48f8-9f97-5a47f3d7f359 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:34:53.361825 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 575/1140] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 24 05:34:53 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 05:34:53.628379 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598e9699-e467-4077-a3a7-47b30e3f10ec None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:34:53.680260 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:34:53.726115 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598e9699-e467-4077-a3a7-47b30e3f10ec None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:34:53.759066 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15001ee8-bd2d-443b-bc94-16d0f43001d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:34:53.759668 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15001ee8-bd2d-443b-bc94-16d0f43001d9 None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:53.759947 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15001ee8-bd2d-443b-bc94-16d0f43001d9 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:53.760217 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15001ee8-bd2d-443b-bc94-16d0f43001d9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:53.769882 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15001ee8-bd2d-443b-bc94-16d0f43001d9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:34:53.774510 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application [None req-15001ee8-bd2d-443b-bc94-16d0f43001d9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 05:34:53.774510 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:34:53.774510 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:34:53.774510 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:34:53.774510 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:34:53.774510 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:34:53.774510 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:34:53.774510 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:34:53.774510 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:34:53.774510 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:34:53.774510 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:34:53.774510 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:34:53.774510 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:34:53.774510 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:34:53.774510 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:34:53.774510 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:34:53.775653 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:34:53.775653 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:34:53.775653 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:34:53.775653 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:34:53.775653 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:34:53.775653 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:34:53.775653 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:34:53.775653 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:34:53.775653 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:34:53.775653 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:34:53.775653 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:34:53.775653 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application with Lock( Aug 24 05:34:53.775653 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:34:53.775653 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:34:53.775653 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:34:53.775653 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:34:53.776737 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:34:53.776737 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:34:53.776737 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:34:53.776737 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:34:53.776737 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:34:53.776737 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:34:53.776737 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:34:53.776737 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:34:53.776737 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:34:53.776737 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:34:53.776737 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 05:34:53.776737 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Aug 24 05:34:53.776737 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 566/1141] 10.222.0.26 () {56 vars in 1096 bytes} [Wed Aug 24 05:34:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:34:53.781468 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17cd716-7e5a-48f8-9f97-5a47f3d7f359 None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:34:53.876317 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17cd716-7e5a-48f8-9f97-5a47f3d7f359 None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:34:53.900240 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:34:53.909117 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d113c861-9dda-41a2-9ddd-a4f610311d22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:34:53.909726 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d113c861-9dda-41a2-9ddd-a4f610311d22 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:53.910027 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d113c861-9dda-41a2-9ddd-a4f610311d22 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:53.910296 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d113c861-9dda-41a2-9ddd-a4f610311d22 None admin] PATH_INFO: `/v3/roles` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:53.910950 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d113c861-9dda-41a2-9ddd-a4f610311d22 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:34:53.911249 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d113c861-9dda-41a2-9ddd-a4f610311d22 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:34:53.912634 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d113c861-9dda-41a2-9ddd-a4f610311d22 None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:34:53.921309 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 576/1142] 10.222.0.26 () {56 vars in 1099 bytes} [Wed Aug 24 05:34:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:34:53.927793 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15001ee8-bd2d-443b-bc94-16d0f43001d9 None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:34:54.024257 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15001ee8-bd2d-443b-bc94-16d0f43001d9 None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:34:54.037396 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:34:54.058379 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3da9d8-006d-41ca-bfbd-efaa7afa1777 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:34:54.059043 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3da9d8-006d-41ca-bfbd-efaa7afa1777 None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:54.059337 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3da9d8-006d-41ca-bfbd-efaa7afa1777 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:54.059613 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3da9d8-006d-41ca-bfbd-efaa7afa1777 None admin] PATH_INFO: `/v3/users/1eebd0aba24d42c89e9809c95da3da4f` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:54.072203 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3da9d8-006d-41ca-bfbd-efaa7afa1777 None admin] RBAC: Authorizing `identity:get_user(user_id=1eebd0aba24d42c89e9809c95da3da4f)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:34:54.073621 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3da9d8-006d-41ca-bfbd-efaa7afa1777 None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:34:54.075270 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 567/1143] 10.222.0.26 () {56 vars in 1177 bytes} [Wed Aug 24 05:34:53 2022] GET /identity/v3/users/1eebd0aba24d42c89e9809c95da3da4f => generated 286 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:34:54.081045 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d113c861-9dda-41a2-9ddd-a4f610311d22 None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:34:54.178626 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d113c861-9dda-41a2-9ddd-a4f610311d22 None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:34:54.210353 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563d1bcd-aeb2-453e-b6a8-d545257a6261 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:34:54.210941 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563d1bcd-aeb2-453e-b6a8-d545257a6261 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:54.211220 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563d1bcd-aeb2-453e-b6a8-d545257a6261 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:54.211490 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563d1bcd-aeb2-453e-b6a8-d545257a6261 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:54.264053 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:34:54.276141 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563d1bcd-aeb2-453e-b6a8-d545257a6261 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:34:54.278116 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563d1bcd-aeb2-453e-b6a8-d545257a6261 None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:34:54.372682 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 577/1144] 10.222.0.26 () {58 vars in 1282 bytes} [Wed Aug 24 05:34:54 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 05:34:54.378471 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3da9d8-006d-41ca-bfbd-efaa7afa1777 None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:34:54.473408 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3da9d8-006d-41ca-bfbd-efaa7afa1777 None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:34:54.505199 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259bca5d-1134-4147-93cc-43e36ccaf4e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:34:54.505820 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259bca5d-1134-4147-93cc-43e36ccaf4e4 None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:54.506130 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259bca5d-1134-4147-93cc-43e36ccaf4e4 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:54.506404 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259bca5d-1134-4147-93cc-43e36ccaf4e4 None admin] PATH_INFO: `/v3/projects/15673e29a80448ccb883a27aedb0047b` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:54.507506 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259bca5d-1134-4147-93cc-43e36ccaf4e4 None admin] RBAC: Authorizing `identity:get_project(project_id=15673e29a80448ccb883a27aedb0047b)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:34:54.508927 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259bca5d-1134-4147-93cc-43e36ccaf4e4 None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:34:54.510566 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 568/1145] 10.222.0.26 () {56 vars in 1186 bytes} [Wed Aug 24 05:34:54 2022] GET /identity/v3/projects/15673e29a80448ccb883a27aedb0047b => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:34:54.517029 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563d1bcd-aeb2-453e-b6a8-d545257a6261 None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:34:54.603506 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:34:54.615624 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563d1bcd-aeb2-453e-b6a8-d545257a6261 None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:34:54.648442 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed183348-8f00-43dd-8155-be5208d89d04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:34:54.649035 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed183348-8f00-43dd-8155-be5208d89d04 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:54.649311 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed183348-8f00-43dd-8155-be5208d89d04 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:54.649578 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed183348-8f00-43dd-8155-be5208d89d04 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:54.650327 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed183348-8f00-43dd-8155-be5208d89d04 None admin] RBAC: Adding query filter params (role.id=640bda0879494e60b72680ee505285f0, scope.project.id=15673e29a80448ccb883a27aedb0047b, user.id=1eebd0aba24d42c89e9809c95da3da4f) {{(pid=88113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:34:54.650636 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed183348-8f00-43dd-8155-be5208d89d04 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:34:54.652056 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed183348-8f00-43dd-8155-be5208d89d04 None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:34:54.657831 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 578/1146] 10.222.0.26 () {56 vars in 1374 bytes} [Wed Aug 24 05:34:54 2022] GET /identity/v3/role_assignments?user.id=1eebd0aba24d42c89e9809c95da3da4f&scope.project.id=15673e29a80448ccb883a27aedb0047b&role.id=640bda0879494e60b72680ee505285f0 => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:34:56.515046 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b78547-7495-4b3f-82f5-25f902b0264b None None] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:56.515566 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b78547-7495-4b3f-82f5-25f902b0264b None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:56.515566 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b78547-7495-4b3f-82f5-25f902b0264b None None] PATH_INFO: `/` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:56.516923 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 569/1147] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 24 05:34:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:34:56.522118 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2134ccde-2fb3-470b-8fa9-6208946956b3 None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:56.522523 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2134ccde-2fb3-470b-8fa9-6208946956b3 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:56.522668 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2134ccde-2fb3-470b-8fa9-6208946956b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:56.540813 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-2134ccde-2fb3-470b-8fa9-6208946956b3 None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:34:56.542013 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-2134ccde-2fb3-470b-8fa9-6208946956b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:34:56.607210 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 579/1148] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 24 05:34:56 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 05:34:56.875270 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b78547-7495-4b3f-82f5-25f902b0264b None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:34:56.914330 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:34:56.974228 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b78547-7495-4b3f-82f5-25f902b0264b None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:34:57.007423 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb16700b-15d1-44b6-a1a4-a5bb7d8f325c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:34:57.008041 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb16700b-15d1-44b6-a1a4-a5bb7d8f325c None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:57.008314 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb16700b-15d1-44b6-a1a4-a5bb7d8f325c None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:57.008585 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb16700b-15d1-44b6-a1a4-a5bb7d8f325c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:57.018316 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb16700b-15d1-44b6-a1a4-a5bb7d8f325c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:34:57.022813 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application [None req-bb16700b-15d1-44b6-a1a4-a5bb7d8f325c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 05:34:57.022813 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:34:57.022813 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:34:57.022813 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:34:57.022813 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:34:57.022813 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:34:57.022813 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:34:57.022813 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:34:57.022813 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:34:57.022813 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:34:57.022813 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:34:57.022813 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:34:57.022813 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:34:57.022813 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:34:57.022813 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:34:57.022813 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:34:57.023925 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:34:57.023925 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:34:57.023925 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:34:57.023925 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:34:57.023925 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:34:57.023925 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:34:57.023925 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:34:57.023925 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:34:57.023925 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:34:57.023925 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:34:57.023925 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:34:57.023925 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application with Lock( Aug 24 05:34:57.023925 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:34:57.023925 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:34:57.023925 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:34:57.023925 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:34:57.024991 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:34:57.024991 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:34:57.024991 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:34:57.024991 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:34:57.024991 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:34:57.024991 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:34:57.024991 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:34:57.024991 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:34:57.024991 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:34:57.024991 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:34:57.024991 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 05:34:57.024991 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Aug 24 05:34:57.024991 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 570/1149] 10.222.0.26 () {56 vars in 1096 bytes} [Wed Aug 24 05:34:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:34:57.030524 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2134ccde-2fb3-470b-8fa9-6208946956b3 None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:34:57.108376 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:34:57.126273 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2134ccde-2fb3-470b-8fa9-6208946956b3 None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:34:57.158355 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60738dc6-5d84-4294-a463-2de20c7f542f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:34:57.158940 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60738dc6-5d84-4294-a463-2de20c7f542f None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:57.159213 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60738dc6-5d84-4294-a463-2de20c7f542f None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:57.159477 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60738dc6-5d84-4294-a463-2de20c7f542f None admin] PATH_INFO: `/v3/roles` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:57.160125 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60738dc6-5d84-4294-a463-2de20c7f542f None admin] RBAC: Adding query filter params (name=admin) {{(pid=88113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:34:57.160420 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60738dc6-5d84-4294-a463-2de20c7f542f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:34:57.161865 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60738dc6-5d84-4294-a463-2de20c7f542f None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:34:57.170208 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 580/1150] 10.222.0.26 () {56 vars in 1099 bytes} [Wed Aug 24 05:34:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:34:57.175925 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb16700b-15d1-44b6-a1a4-a5bb7d8f325c None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:34:57.268156 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:34:57.272022 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb16700b-15d1-44b6-a1a4-a5bb7d8f325c None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:34:57.304545 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e61840-0492-4adf-b952-c61f6c02e193 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:34:57.305144 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e61840-0492-4adf-b952-c61f6c02e193 None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:57.305418 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e61840-0492-4adf-b952-c61f6c02e193 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:57.305686 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e61840-0492-4adf-b952-c61f6c02e193 None admin] PATH_INFO: `/v3/users/1eebd0aba24d42c89e9809c95da3da4f` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:57.306810 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e61840-0492-4adf-b952-c61f6c02e193 None admin] RBAC: Authorizing `identity:get_user(user_id=1eebd0aba24d42c89e9809c95da3da4f)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:34:57.308219 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e61840-0492-4adf-b952-c61f6c02e193 None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:34:57.309769 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 571/1151] 10.222.0.26 () {56 vars in 1177 bytes} [Wed Aug 24 05:34:57 2022] GET /identity/v3/users/1eebd0aba24d42c89e9809c95da3da4f => generated 286 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:34:57.315634 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60738dc6-5d84-4294-a463-2de20c7f542f None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:34:57.410972 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60738dc6-5d84-4294-a463-2de20c7f542f None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:34:57.442618 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530c5ee7-d52d-4b16-94c4-ec270404e5cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:34:57.443240 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530c5ee7-d52d-4b16-94c4-ec270404e5cc None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:57.443519 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530c5ee7-d52d-4b16-94c4-ec270404e5cc None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:57.443790 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530c5ee7-d52d-4b16-94c4-ec270404e5cc None admin] PATH_INFO: `/v3/projects/15673e29a80448ccb883a27aedb0047b` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:57.444924 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530c5ee7-d52d-4b16-94c4-ec270404e5cc None admin] RBAC: Authorizing `identity:get_project(project_id=15673e29a80448ccb883a27aedb0047b)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:34:57.446380 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530c5ee7-d52d-4b16-94c4-ec270404e5cc None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:34:57.447969 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 581/1152] 10.222.0.26 () {56 vars in 1186 bytes} [Wed Aug 24 05:34:57 2022] GET /identity/v3/projects/15673e29a80448ccb883a27aedb0047b => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:34:57.454233 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e61840-0492-4adf-b952-c61f6c02e193 None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:34:57.549612 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e61840-0492-4adf-b952-c61f6c02e193 None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:34:57.581807 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988b538c-f686-4de2-9faa-e68bb0de55ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:34:57.582475 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988b538c-f686-4de2-9faa-e68bb0de55ec None admin] REQUEST_METHOD: `PUT` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:57.582752 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988b538c-f686-4de2-9faa-e68bb0de55ec None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:57.583020 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988b538c-f686-4de2-9faa-e68bb0de55ec None admin] PATH_INFO: `/v3/projects/15673e29a80448ccb883a27aedb0047b/users/1eebd0aba24d42c89e9809c95da3da4f/roles/640bda0879494e60b72680ee505285f0` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:57.584860 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988b538c-f686-4de2-9faa-e68bb0de55ec None admin] RBAC: Authorizing `identity:create_grant(project_id=15673e29a80448ccb883a27aedb0047b, user_id=1eebd0aba24d42c89e9809c95da3da4f, role_id=640bda0879494e60b72680ee505285f0)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:34:57.586296 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988b538c-f686-4de2-9faa-e68bb0de55ec None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:34:57.599532 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 572/1153] 10.222.0.26 () {58 vars in 1439 bytes} [Wed Aug 24 05:34:57 2022] PUT /identity/v3/projects/15673e29a80448ccb883a27aedb0047b/users/1eebd0aba24d42c89e9809c95da3da4f/roles/640bda0879494e60b72680ee505285f0 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:34:59.452790 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4a7494-1156-459e-9722-382eeb461c87 None None] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:59.453348 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4a7494-1156-459e-9722-382eeb461c87 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:59.453348 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4a7494-1156-459e-9722-382eeb461c87 None None] PATH_INFO: `/` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:59.454695 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 582/1154] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 24 05:34:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:34:59.459966 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ed056c-fca5-49ed-a2cf-3774d7c66f8d None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:59.460377 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ed056c-fca5-49ed-a2cf-3774d7c66f8d None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:59.460518 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ed056c-fca5-49ed-a2cf-3774d7c66f8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:59.478156 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-27ed056c-fca5-49ed-a2cf-3774d7c66f8d None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:34:59.479337 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-27ed056c-fca5-49ed-a2cf-3774d7c66f8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:34:59.499616 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:34:59.546482 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 573/1155] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 24 05:34:59 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 05:34:59.812738 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4a7494-1156-459e-9722-382eeb461c87 None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:34:59.828352 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:34:59.910941 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4a7494-1156-459e-9722-382eeb461c87 None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:34:59.942950 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09164c0c-d20f-4cc4-9d19-88c3dad9c893 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:34:59.943553 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09164c0c-d20f-4cc4-9d19-88c3dad9c893 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:34:59.943829 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09164c0c-d20f-4cc4-9d19-88c3dad9c893 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:34:59.944096 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09164c0c-d20f-4cc4-9d19-88c3dad9c893 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:34:59.954657 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09164c0c-d20f-4cc4-9d19-88c3dad9c893 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:34:59.959219 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application [None req-09164c0c-d20f-4cc4-9d19-88c3dad9c893 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 05:34:59.959219 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:34:59.959219 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:34:59.959219 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:34:59.959219 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:34:59.959219 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:34:59.959219 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:34:59.959219 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:34:59.959219 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:34:59.959219 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:34:59.959219 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:34:59.959219 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:34:59.959219 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:34:59.959219 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:34:59.959219 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:34:59.959219 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:34:59.960294 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:34:59.960294 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:34:59.960294 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:34:59.960294 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:34:59.960294 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:34:59.960294 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:34:59.960294 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:34:59.960294 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:34:59.960294 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:34:59.960294 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:34:59.960294 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:34:59.960294 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application with Lock( Aug 24 05:34:59.960294 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:34:59.960294 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:34:59.960294 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:34:59.960294 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:34:59.961128 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:34:59.961128 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:34:59.961128 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:34:59.961128 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:34:59.961128 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:34:59.961128 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:34:59.961128 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:34:59.961128 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:34:59.961128 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:34:59.961128 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:34:59.961128 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 05:34:59.961128 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Aug 24 05:34:59.961128 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 583/1156] 10.222.0.26 () {56 vars in 1096 bytes} [Wed Aug 24 05:34:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:34:59.966841 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ed056c-fca5-49ed-a2cf-3774d7c66f8d None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:35:00.060957 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ed056c-fca5-49ed-a2cf-3774d7c66f8d None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:35:00.094013 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66058501-f98e-4774-b58c-b1c6d68aeb7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:35:00.094565 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66058501-f98e-4774-b58c-b1c6d68aeb7f None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:35:00.094846 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66058501-f98e-4774-b58c-b1c6d68aeb7f None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:35:00.095115 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66058501-f98e-4774-b58c-b1c6d68aeb7f None admin] PATH_INFO: `/v3/roles` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:35:00.095770 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66058501-f98e-4774-b58c-b1c6d68aeb7f None admin] RBAC: Adding query filter params (name=admin) {{(pid=88112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:35:00.096072 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66058501-f98e-4774-b58c-b1c6d68aeb7f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:35:00.097425 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66058501-f98e-4774-b58c-b1c6d68aeb7f None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:35:00.105788 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 574/1157] 10.222.0.26 () {56 vars in 1099 bytes} [Wed Aug 24 05:34:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:35:00.111451 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09164c0c-d20f-4cc4-9d19-88c3dad9c893 None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:35:00.177851 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:35:00.206870 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09164c0c-d20f-4cc4-9d19-88c3dad9c893 None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:35:00.239289 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2e3d28-bacc-46e1-b184-e4d57c114961 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:35:00.239893 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2e3d28-bacc-46e1-b184-e4d57c114961 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:35:00.240172 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2e3d28-bacc-46e1-b184-e4d57c114961 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:35:00.240439 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2e3d28-bacc-46e1-b184-e4d57c114961 None admin] PATH_INFO: `/v3/users/1eebd0aba24d42c89e9809c95da3da4f` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:35:00.241516 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2e3d28-bacc-46e1-b184-e4d57c114961 None admin] RBAC: Authorizing `identity:get_user(user_id=1eebd0aba24d42c89e9809c95da3da4f)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:35:00.242952 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2e3d28-bacc-46e1-b184-e4d57c114961 None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:35:00.244472 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 584/1158] 10.222.0.26 () {56 vars in 1177 bytes} [Wed Aug 24 05:35:00 2022] GET /identity/v3/users/1eebd0aba24d42c89e9809c95da3da4f => generated 286 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:35:00.250243 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66058501-f98e-4774-b58c-b1c6d68aeb7f None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:35:00.268892 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:35:00.346675 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66058501-f98e-4774-b58c-b1c6d68aeb7f None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:35:00.378408 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a859c504-a904-48a4-bbc6-3011c48a5971 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:35:00.379004 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a859c504-a904-48a4-bbc6-3011c48a5971 None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:35:00.379287 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a859c504-a904-48a4-bbc6-3011c48a5971 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:35:00.379561 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a859c504-a904-48a4-bbc6-3011c48a5971 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:35:00.444213 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a859c504-a904-48a4-bbc6-3011c48a5971 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:35:00.445633 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a859c504-a904-48a4-bbc6-3011c48a5971 None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:35:00.463295 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:35:00.541039 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 575/1159] 10.222.0.26 () {58 vars in 1282 bytes} [Wed Aug 24 05:35:00 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 05:35:00.546849 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2e3d28-bacc-46e1-b184-e4d57c114961 None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:35:00.643269 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2e3d28-bacc-46e1-b184-e4d57c114961 None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:35:00.675375 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509d3834-5b1b-4120-86fc-d6425822ba8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:35:00.675988 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509d3834-5b1b-4120-86fc-d6425822ba8c None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:35:00.676268 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509d3834-5b1b-4120-86fc-d6425822ba8c None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:35:00.676541 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509d3834-5b1b-4120-86fc-d6425822ba8c None admin] PATH_INFO: `/v3/projects/15673e29a80448ccb883a27aedb0047b` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:35:00.677635 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509d3834-5b1b-4120-86fc-d6425822ba8c None admin] RBAC: Authorizing `identity:get_project(project_id=15673e29a80448ccb883a27aedb0047b)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:35:00.679105 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509d3834-5b1b-4120-86fc-d6425822ba8c None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:35:00.680699 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 585/1160] 10.222.0.26 () {56 vars in 1186 bytes} [Wed Aug 24 05:35:00 2022] GET /identity/v3/projects/15673e29a80448ccb883a27aedb0047b => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:35:00.687175 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a859c504-a904-48a4-bbc6-3011c48a5971 None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:35:00.782345 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a859c504-a904-48a4-bbc6-3011c48a5971 None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:35:00.798636 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:35:00.816199 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6f351e-c0ea-4452-8893-77ee08b79e32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:35:00.817034 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6f351e-c0ea-4452-8893-77ee08b79e32 None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:35:00.817624 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6f351e-c0ea-4452-8893-77ee08b79e32 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:35:00.817624 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6f351e-c0ea-4452-8893-77ee08b79e32 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:35:00.818351 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6f351e-c0ea-4452-8893-77ee08b79e32 None admin] RBAC: Adding query filter params (role.id=640bda0879494e60b72680ee505285f0, scope.project.id=15673e29a80448ccb883a27aedb0047b, user.id=1eebd0aba24d42c89e9809c95da3da4f) {{(pid=88112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:35:00.818752 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6f351e-c0ea-4452-8893-77ee08b79e32 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:35:00.820174 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6f351e-c0ea-4452-8893-77ee08b79e32 None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:35:00.826473 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 576/1161] 10.222.0.26 () {56 vars in 1374 bytes} [Wed Aug 24 05:35:00 2022] GET /identity/v3/role_assignments?user.id=1eebd0aba24d42c89e9809c95da3da4f&scope.project.id=15673e29a80448ccb883a27aedb0047b&role.id=640bda0879494e60b72680ee505285f0 => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:35:02.720566 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828de001-8dab-4be0-abab-0c7575d55817 None None] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:35:02.721075 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828de001-8dab-4be0-abab-0c7575d55817 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:35:02.721198 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828de001-8dab-4be0-abab-0c7575d55817 None None] PATH_INFO: `/` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:35:02.722620 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 586/1162] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 24 05:35:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:35:02.727856 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92f6303-7130-4271-8145-8ad092d0ab06 None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:35:02.728265 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92f6303-7130-4271-8145-8ad092d0ab06 None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:35:02.728411 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92f6303-7130-4271-8145-8ad092d0ab06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:35:02.745994 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-d92f6303-7130-4271-8145-8ad092d0ab06 None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:35:02.747199 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-d92f6303-7130-4271-8145-8ad092d0ab06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:35:02.811081 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 577/1163] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 24 05:35:02 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 05:35:03.078298 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828de001-8dab-4be0-abab-0c7575d55817 None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:35:03.089546 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:35:03.178048 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828de001-8dab-4be0-abab-0c7575d55817 None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:35:03.211212 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a84122-5cf0-4025-9cb6-0bb8aed36f45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:35:03.211805 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a84122-5cf0-4025-9cb6-0bb8aed36f45 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:35:03.212087 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a84122-5cf0-4025-9cb6-0bb8aed36f45 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:35:03.212359 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a84122-5cf0-4025-9cb6-0bb8aed36f45 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:35:03.276542 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a84122-5cf0-4025-9cb6-0bb8aed36f45 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:35:03.278007 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a84122-5cf0-4025-9cb6-0bb8aed36f45 None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:35:03.287243 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:35:03.373681 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 587/1164] 10.222.0.26 () {58 vars in 1282 bytes} [Wed Aug 24 05:35:03 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 05:35:03.379563 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92f6303-7130-4271-8145-8ad092d0ab06 None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:35:03.474588 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92f6303-7130-4271-8145-8ad092d0ab06 None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:35:03.487654 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:35:03.508920 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8ca533-398f-489f-b16f-d7737958185a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:35:03.509546 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8ca533-398f-489f-b16f-d7737958185a None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:35:03.509821 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8ca533-398f-489f-b16f-d7737958185a None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:35:03.510133 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8ca533-398f-489f-b16f-d7737958185a None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:35:03.516802 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8ca533-398f-489f-b16f-d7737958185a None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:35:03.518260 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8ca533-398f-489f-b16f-d7737958185a None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:35:03.529151 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application [None req-2e8ca533-398f-489f-b16f-d7737958185a None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 24 05:35:03.529151 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:35:03.529151 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 24 05:35:03.529151 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 24 05:35:03.529151 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 05:35:03.529151 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 05:35:03.529151 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 05:35:03.529151 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 05:35:03.529151 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Aug 24 05:35:03.529151 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Aug 24 05:35:03.529151 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 05:35:03.529151 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Aug 24 05:35:03.529151 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:35:03.529151 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:35:03.529151 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:35:03.529151 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:35:03.529151 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:35:03.530387 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:35:03.530387 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:35:03.530387 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:35:03.530387 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:35:03.530387 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:35:03.530387 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:35:03.530387 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 05:35:03.530387 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 05:35:03.530387 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 05:35:03.530387 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 05:35:03.530387 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:35:03.530387 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:35:03.530387 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:35:03.530387 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:35:03.530387 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:35:03.530387 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:35:03.531433 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:35:03.531433 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application with Lock( Aug 24 05:35:03.531433 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:35:03.531433 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:35:03.531433 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:35:03.531433 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:35:03.531433 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:35:03.531433 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:35:03.531433 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:35:03.531433 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:35:03.531433 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 24 05:35:03.531433 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 05:35:03.531433 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 24 05:35:03.531433 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Aug 24 05:35:03.531433 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 578/1165] 10.222.0.26 () {56 vars in 1117 bytes} [Wed Aug 24 05:35:03 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:35:03.536421 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a84122-5cf0-4025-9cb6-0bb8aed36f45 None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:35:03.632519 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a84122-5cf0-4025-9cb6-0bb8aed36f45 None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:35:03.641345 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:35:03.665003 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8564ce7d-6006-41b6-ae1e-f0c3da03b361 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:35:03.665598 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8564ce7d-6006-41b6-ae1e-f0c3da03b361 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:35:03.665874 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8564ce7d-6006-41b6-ae1e-f0c3da03b361 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:35:03.666180 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8564ce7d-6006-41b6-ae1e-f0c3da03b361 None admin] PATH_INFO: `/v3/domains` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:35:03.666813 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8564ce7d-6006-41b6-ae1e-f0c3da03b361 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=88113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:35:03.667112 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8564ce7d-6006-41b6-ae1e-f0c3da03b361 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:35:03.668469 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8564ce7d-6006-41b6-ae1e-f0c3da03b361 None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:35:03.675830 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 588/1166] 10.222.0.26 () {56 vars in 1115 bytes} [Wed Aug 24 05:35:03 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:35:05.534066 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee55b62-fbfe-419e-9c02-f1dfe855489f None None] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:35:05.534619 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee55b62-fbfe-419e-9c02-f1dfe855489f None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:35:05.534619 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee55b62-fbfe-419e-9c02-f1dfe855489f None None] PATH_INFO: `/` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:35:05.535961 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 579/1167] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 24 05:35:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:35:05.541272 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916c3add-012f-4d89-a979-084ae1d6d65a None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:35:05.541632 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916c3add-012f-4d89-a979-084ae1d6d65a None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:35:05.541826 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916c3add-012f-4d89-a979-084ae1d6d65a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:35:05.559990 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-916c3add-012f-4d89-a979-084ae1d6d65a None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:35:05.561164 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-916c3add-012f-4d89-a979-084ae1d6d65a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:35:05.625275 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 589/1168] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 24 05:35:05 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 05:35:05.888039 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee55b62-fbfe-419e-9c02-f1dfe855489f None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:35:05.986100 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee55b62-fbfe-419e-9c02-f1dfe855489f None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:35:06.019307 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648f1a69-a548-488f-9a88-c1c2d84830b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:35:06.019896 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648f1a69-a548-488f-9a88-c1c2d84830b3 None admin] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:35:06.020177 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648f1a69-a548-488f-9a88-c1c2d84830b3 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:35:06.020452 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648f1a69-a548-488f-9a88-c1c2d84830b3 None admin] PATH_INFO: `/v3/domains` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:35:06.021113 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648f1a69-a548-488f-9a88-c1c2d84830b3 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:35:06.022503 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648f1a69-a548-488f-9a88-c1c2d84830b3 None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:35:06.037563 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 580/1169] 10.222.0.26 () {60 vars in 1138 bytes} [Wed Aug 24 05:35:05 2022] POST /identity/v3/domains => generated 267 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:35:07.930101 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ca097f-3948-47b6-9b08-3b382c9b8fac None None] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:35:07.930601 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ca097f-3948-47b6-9b08-3b382c9b8fac None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:35:07.930601 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ca097f-3948-47b6-9b08-3b382c9b8fac None None] PATH_INFO: `/` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:35:07.931894 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 590/1170] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 24 05:35:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:35:07.937700 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758f0589-e281-488f-8f19-76967d6b6a02 None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:35:07.938173 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758f0589-e281-488f-8f19-76967d6b6a02 None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:35:07.938266 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758f0589-e281-488f-8f19-76967d6b6a02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:35:07.956129 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-758f0589-e281-488f-8f19-76967d6b6a02 None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:35:07.957316 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-758f0589-e281-488f-8f19-76967d6b6a02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:35:07.982489 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:35:08.023334 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 581/1171] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 24 05:35:07 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 05:35:08.290383 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ca097f-3948-47b6-9b08-3b382c9b8fac None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:35:08.389449 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ca097f-3948-47b6-9b08-3b382c9b8fac None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:35:08.390913 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:35:08.423658 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df6048d-ff7d-47b6-88e0-72f56989c49d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:35:08.424266 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df6048d-ff7d-47b6-88e0-72f56989c49d None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:35:08.424540 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df6048d-ff7d-47b6-88e0-72f56989c49d None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:35:08.424805 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df6048d-ff7d-47b6-88e0-72f56989c49d None admin] PATH_INFO: `/v3/domains/6c59e340b5db45e1ac8fa7c10ce378e2` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:35:08.434804 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df6048d-ff7d-47b6-88e0-72f56989c49d None admin] RBAC: Authorizing `identity:get_domain(domain_id=6c59e340b5db45e1ac8fa7c10ce378e2)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:35:08.436230 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df6048d-ff7d-47b6-88e0-72f56989c49d None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:35:08.437763 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 591/1172] 10.222.0.26 () {56 vars in 1183 bytes} [Wed Aug 24 05:35:08 2022] GET /identity/v3/domains/6c59e340b5db45e1ac8fa7c10ce378e2 => generated 267 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:35:08.443662 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758f0589-e281-488f-8f19-76967d6b6a02 None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:35:08.538082 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758f0589-e281-488f-8f19-76967d6b6a02 None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:35:08.570667 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e13c88-bad3-4e4d-9811-ee506c0ebd51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:35:08.571201 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e13c88-bad3-4e4d-9811-ee506c0ebd51 None admin] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:35:08.571476 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e13c88-bad3-4e4d-9811-ee506c0ebd51 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:35:08.571742 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e13c88-bad3-4e4d-9811-ee506c0ebd51 None admin] PATH_INFO: `/v3/projects` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:35:08.572376 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e13c88-bad3-4e4d-9811-ee506c0ebd51 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:35:08.573781 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e13c88-bad3-4e4d-9811-ee506c0ebd51 None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:35:08.600521 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 582/1173] 10.222.0.26 () {60 vars in 1141 bytes} [Wed Aug 24 05:35:08 2022] POST /identity/v3/projects => generated 361 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:35:10.490840 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d6992d-70e3-4eb6-a87b-ca0b8330dce0 None None] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:35:10.491370 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d6992d-70e3-4eb6-a87b-ca0b8330dce0 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:35:10.491370 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d6992d-70e3-4eb6-a87b-ca0b8330dce0 None None] PATH_INFO: `/` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:35:10.492694 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 592/1174] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 24 05:35:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:35:10.498516 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c7dd26-7ddb-4fa4-9d21-7d6bc7f5b1c1 None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:35:10.498954 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c7dd26-7ddb-4fa4-9d21-7d6bc7f5b1c1 None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:35:10.499055 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c7dd26-7ddb-4fa4-9d21-7d6bc7f5b1c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:35:10.517258 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-d1c7dd26-7ddb-4fa4-9d21-7d6bc7f5b1c1 None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:35:10.518453 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-d1c7dd26-7ddb-4fa4-9d21-7d6bc7f5b1c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:35:10.527492 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:35:10.583968 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 583/1175] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 24 05:35:10 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 05:35:10.854102 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d6992d-70e3-4eb6-a87b-ca0b8330dce0 None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:35:10.952810 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d6992d-70e3-4eb6-a87b-ca0b8330dce0 None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:35:10.984990 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248ba1bd-3749-402c-851c-90a64c4e5e65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:35:10.985607 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248ba1bd-3749-402c-851c-90a64c4e5e65 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:35:10.985887 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248ba1bd-3749-402c-851c-90a64c4e5e65 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:35:10.986186 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248ba1bd-3749-402c-851c-90a64c4e5e65 None admin] PATH_INFO: `/v3/domains/6c59e340b5db45e1ac8fa7c10ce378e2` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:35:10.987289 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248ba1bd-3749-402c-851c-90a64c4e5e65 None admin] RBAC: Authorizing `identity:get_domain(domain_id=6c59e340b5db45e1ac8fa7c10ce378e2)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:35:10.988715 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248ba1bd-3749-402c-851c-90a64c4e5e65 None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:35:10.990281 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 593/1176] 10.222.0.26 () {56 vars in 1183 bytes} [Wed Aug 24 05:35:10 2022] GET /identity/v3/domains/6c59e340b5db45e1ac8fa7c10ce378e2 => generated 267 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:35:10.996002 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c7dd26-7ddb-4fa4-9d21-7d6bc7f5b1c1 None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:35:11.090791 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c7dd26-7ddb-4fa4-9d21-7d6bc7f5b1c1 None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:35:11.123636 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae49aff6-1025-436d-aabf-a0eaa9403a4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:35:11.124172 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae49aff6-1025-436d-aabf-a0eaa9403a4a None admin] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:35:11.124448 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae49aff6-1025-436d-aabf-a0eaa9403a4a None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:35:11.124715 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae49aff6-1025-436d-aabf-a0eaa9403a4a None admin] PATH_INFO: `/v3/users` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:35:11.125342 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae49aff6-1025-436d-aabf-a0eaa9403a4a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:35:11.126788 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae49aff6-1025-436d-aabf-a0eaa9403a4a None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:35:11.142806 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:35:11.148253 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 584/1177] 10.222.0.26 () {60 vars in 1132 bytes} [Wed Aug 24 05:35:10 2022] POST /identity/v3/users => generated 311 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:35:13.052486 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52b8839-acdf-41b3-8053-312037fcc07c None None] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:35:13.053014 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52b8839-acdf-41b3-8053-312037fcc07c None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:35:13.053014 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52b8839-acdf-41b3-8053-312037fcc07c None None] PATH_INFO: `/` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:35:13.054389 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 594/1178] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 24 05:35:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:35:13.060055 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d067572b-be24-48a3-8901-7467294cc231 None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:35:13.060442 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d067572b-be24-48a3-8901-7467294cc231 None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:35:13.060598 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d067572b-be24-48a3-8901-7467294cc231 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:35:13.079266 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-d067572b-be24-48a3-8901-7467294cc231 None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:35:13.080437 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-d067572b-be24-48a3-8901-7467294cc231 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:35:13.143689 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 585/1179] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 24 05:35:13 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 05:35:13.408629 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52b8839-acdf-41b3-8053-312037fcc07c None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:35:13.439559 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:35:13.508619 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52b8839-acdf-41b3-8053-312037fcc07c None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:35:13.541213 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c184f8e1-0046-41cf-b4e9-fa44cb5e4589 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:35:13.542029 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c184f8e1-0046-41cf-b4e9-fa44cb5e4589 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:35:13.542308 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c184f8e1-0046-41cf-b4e9-fa44cb5e4589 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:35:13.542577 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c184f8e1-0046-41cf-b4e9-fa44cb5e4589 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:35:13.553347 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c184f8e1-0046-41cf-b4e9-fa44cb5e4589 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:35:13.557885 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application [None req-c184f8e1-0046-41cf-b4e9-fa44cb5e4589 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 05:35:13.557885 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:35:13.557885 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:35:13.557885 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:35:13.557885 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:35:13.557885 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:35:13.557885 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:35:13.557885 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:35:13.557885 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:35:13.557885 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:35:13.557885 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:35:13.557885 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:35:13.557885 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:35:13.557885 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:35:13.557885 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:35:13.557885 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:35:13.559075 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:35:13.559075 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:35:13.559075 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:35:13.559075 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:35:13.559075 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:35:13.559075 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:35:13.559075 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:35:13.559075 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:35:13.559075 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:35:13.559075 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:35:13.559075 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:35:13.559075 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application with Lock( Aug 24 05:35:13.559075 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:35:13.559075 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:35:13.559075 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:35:13.559075 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:35:13.560042 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:35:13.560042 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:35:13.560042 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:35:13.560042 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:35:13.560042 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:35:13.560042 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:35:13.560042 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:35:13.560042 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:35:13.560042 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:35:13.560042 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:35:13.560042 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 05:35:13.560042 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Aug 24 05:35:13.560042 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 595/1180] 10.222.0.26 () {56 vars in 1096 bytes} [Wed Aug 24 05:35:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:35:13.565304 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d067572b-be24-48a3-8901-7467294cc231 None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:35:13.659856 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d067572b-be24-48a3-8901-7467294cc231 None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:35:13.687074 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:35:13.693276 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43618ab-9b0b-4984-ba69-1e526fe3ac52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:35:13.693867 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43618ab-9b0b-4984-ba69-1e526fe3ac52 None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:35:13.694166 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43618ab-9b0b-4984-ba69-1e526fe3ac52 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:35:13.694436 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43618ab-9b0b-4984-ba69-1e526fe3ac52 None admin] PATH_INFO: `/v3/roles` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:35:13.695090 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43618ab-9b0b-4984-ba69-1e526fe3ac52 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:35:13.695397 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43618ab-9b0b-4984-ba69-1e526fe3ac52 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:35:13.696732 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43618ab-9b0b-4984-ba69-1e526fe3ac52 None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:35:13.704426 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 586/1181] 10.222.0.26 () {56 vars in 1099 bytes} [Wed Aug 24 05:35:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:35:13.710294 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c184f8e1-0046-41cf-b4e9-fa44cb5e4589 None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:35:13.798293 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:35:13.808069 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c184f8e1-0046-41cf-b4e9-fa44cb5e4589 None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:35:13.841283 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b186090b-4829-485b-b46f-32c185aa819a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:35:13.841892 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b186090b-4829-485b-b46f-32c185aa819a None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:35:13.842199 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b186090b-4829-485b-b46f-32c185aa819a None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:35:13.842472 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b186090b-4829-485b-b46f-32c185aa819a None admin] PATH_INFO: `/v3/users/50bf3ebc19fe497c8fe7862e8d7812c7` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:35:13.855004 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b186090b-4829-485b-b46f-32c185aa819a None admin] RBAC: Authorizing `identity:get_user(user_id=50bf3ebc19fe497c8fe7862e8d7812c7)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:35:13.856461 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b186090b-4829-485b-b46f-32c185aa819a None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:35:13.858024 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 596/1182] 10.222.0.26 () {56 vars in 1177 bytes} [Wed Aug 24 05:35:13 2022] GET /identity/v3/users/50bf3ebc19fe497c8fe7862e8d7812c7 => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:35:13.863843 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43618ab-9b0b-4984-ba69-1e526fe3ac52 None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:35:13.960569 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43618ab-9b0b-4984-ba69-1e526fe3ac52 None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:35:13.992382 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb0f680-10d6-41e0-ae6d-0f351d3936e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:35:13.992974 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb0f680-10d6-41e0-ae6d-0f351d3936e1 None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:35:13.993247 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb0f680-10d6-41e0-ae6d-0f351d3936e1 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:35:13.993514 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb0f680-10d6-41e0-ae6d-0f351d3936e1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:35:14.048522 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:35:14.057678 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb0f680-10d6-41e0-ae6d-0f351d3936e1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:35:14.059180 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb0f680-10d6-41e0-ae6d-0f351d3936e1 None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:35:14.152209 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 587/1183] 10.222.0.26 () {58 vars in 1282 bytes} [Wed Aug 24 05:35:13 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 05:35:14.158667 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b186090b-4829-485b-b46f-32c185aa819a None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:35:14.253790 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b186090b-4829-485b-b46f-32c185aa819a None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:35:14.286675 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cafeaf7-431a-413f-a259-1514436a6b7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:35:14.287292 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cafeaf7-431a-413f-a259-1514436a6b7d None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:35:14.287571 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cafeaf7-431a-413f-a259-1514436a6b7d None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:35:14.287840 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cafeaf7-431a-413f-a259-1514436a6b7d None admin] PATH_INFO: `/v3/projects/766ba21bf3904c148f49052c4075c7fc` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:35:14.288962 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cafeaf7-431a-413f-a259-1514436a6b7d None admin] RBAC: Authorizing `identity:get_project(project_id=766ba21bf3904c148f49052c4075c7fc)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:35:14.290416 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cafeaf7-431a-413f-a259-1514436a6b7d None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:35:14.292005 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 597/1184] 10.222.0.26 () {56 vars in 1186 bytes} [Wed Aug 24 05:35:14 2022] GET /identity/v3/projects/766ba21bf3904c148f49052c4075c7fc => generated 361 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:35:14.298454 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb0f680-10d6-41e0-ae6d-0f351d3936e1 None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:35:14.383837 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:35:14.392608 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb0f680-10d6-41e0-ae6d-0f351d3936e1 None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:35:14.425463 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe24b2d-b873-46a6-883e-b506e1a8a528 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:35:14.426081 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe24b2d-b873-46a6-883e-b506e1a8a528 None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:35:14.426361 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe24b2d-b873-46a6-883e-b506e1a8a528 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:35:14.426626 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe24b2d-b873-46a6-883e-b506e1a8a528 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:35:14.427331 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe24b2d-b873-46a6-883e-b506e1a8a528 None admin] RBAC: Adding query filter params (role.id=640bda0879494e60b72680ee505285f0, scope.project.id=766ba21bf3904c148f49052c4075c7fc, user.id=50bf3ebc19fe497c8fe7862e8d7812c7) {{(pid=88112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:35:14.427632 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe24b2d-b873-46a6-883e-b506e1a8a528 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:35:14.429032 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe24b2d-b873-46a6-883e-b506e1a8a528 None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:35:14.434249 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 588/1185] 10.222.0.26 () {56 vars in 1374 bytes} [Wed Aug 24 05:35:14 2022] GET /identity/v3/role_assignments?user.id=50bf3ebc19fe497c8fe7862e8d7812c7&scope.project.id=766ba21bf3904c148f49052c4075c7fc&role.id=640bda0879494e60b72680ee505285f0 => generated 259 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:35:16.267857 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e033105-d2c9-40c4-b4af-2149c0b81b34 None None] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:35:16.268416 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e033105-d2c9-40c4-b4af-2149c0b81b34 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:35:16.268416 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e033105-d2c9-40c4-b4af-2149c0b81b34 None None] PATH_INFO: `/` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:35:16.269730 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 598/1186] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 24 05:35:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:35:16.274828 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b5b2fb-7158-4ce2-ad15-302b39267389 None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:35:16.275193 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b5b2fb-7158-4ce2-ad15-302b39267389 None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:35:16.275365 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b5b2fb-7158-4ce2-ad15-302b39267389 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:35:16.293388 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-14b5b2fb-7158-4ce2-ad15-302b39267389 None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:35:16.294577 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-14b5b2fb-7158-4ce2-ad15-302b39267389 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:35:16.358312 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 589/1187] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 24 05:35:16 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 05:35:16.625836 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e033105-d2c9-40c4-b4af-2149c0b81b34 None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:35:16.644308 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:35:16.725766 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e033105-d2c9-40c4-b4af-2149c0b81b34 None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:35:16.758267 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccf151c-6818-40c5-a562-0adc3837bcef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:35:16.758884 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccf151c-6818-40c5-a562-0adc3837bcef None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:35:16.759165 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccf151c-6818-40c5-a562-0adc3837bcef None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:35:16.759435 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccf151c-6818-40c5-a562-0adc3837bcef None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:35:16.769665 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccf151c-6818-40c5-a562-0adc3837bcef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:35:16.774412 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application [None req-eccf151c-6818-40c5-a562-0adc3837bcef None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 05:35:16.774412 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:35:16.774412 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:35:16.774412 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:35:16.774412 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:35:16.774412 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:35:16.774412 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:35:16.774412 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:35:16.774412 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:35:16.774412 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:35:16.774412 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:35:16.774412 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:35:16.774412 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:35:16.774412 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:35:16.774412 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:35:16.774412 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:35:16.775502 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:35:16.775502 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:35:16.775502 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:35:16.775502 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:35:16.775502 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:35:16.775502 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:35:16.775502 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:35:16.775502 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:35:16.775502 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:35:16.775502 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:35:16.775502 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:35:16.775502 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application with Lock( Aug 24 05:35:16.775502 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:35:16.775502 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:35:16.775502 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:35:16.775502 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:35:16.776677 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:35:16.776677 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:35:16.776677 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:35:16.776677 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:35:16.776677 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:35:16.776677 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:35:16.776677 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:35:16.776677 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:35:16.776677 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:35:16.776677 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:35:16.776677 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 05:35:16.776677 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Aug 24 05:35:16.776677 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 599/1188] 10.222.0.26 () {56 vars in 1096 bytes} [Wed Aug 24 05:35:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:35:16.781442 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b5b2fb-7158-4ce2-ad15-302b39267389 None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:35:16.862525 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:35:16.879304 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b5b2fb-7158-4ce2-ad15-302b39267389 None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:35:16.911439 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a966b7c8-b873-455e-b190-1aa12a8bb750 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:35:16.912041 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a966b7c8-b873-455e-b190-1aa12a8bb750 None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:35:16.912319 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a966b7c8-b873-455e-b190-1aa12a8bb750 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:35:16.912588 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a966b7c8-b873-455e-b190-1aa12a8bb750 None admin] PATH_INFO: `/v3/roles` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:35:16.913251 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a966b7c8-b873-455e-b190-1aa12a8bb750 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:35:16.913552 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a966b7c8-b873-455e-b190-1aa12a8bb750 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:35:16.914939 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a966b7c8-b873-455e-b190-1aa12a8bb750 None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:35:16.923377 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 590/1189] 10.222.0.26 () {56 vars in 1099 bytes} [Wed Aug 24 05:35:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:35:16.929262 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccf151c-6818-40c5-a562-0adc3837bcef None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:35:17.004718 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:35:17.027318 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccf151c-6818-40c5-a562-0adc3837bcef None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:35:17.060658 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59690515-0e15-4f86-a0a9-1a7300edffeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:35:17.061264 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59690515-0e15-4f86-a0a9-1a7300edffeb None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:35:17.061538 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59690515-0e15-4f86-a0a9-1a7300edffeb None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:35:17.061801 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59690515-0e15-4f86-a0a9-1a7300edffeb None admin] PATH_INFO: `/v3/users/50bf3ebc19fe497c8fe7862e8d7812c7` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:35:17.062912 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59690515-0e15-4f86-a0a9-1a7300edffeb None admin] RBAC: Authorizing `identity:get_user(user_id=50bf3ebc19fe497c8fe7862e8d7812c7)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:35:17.064324 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59690515-0e15-4f86-a0a9-1a7300edffeb None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:35:17.066154 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 600/1190] 10.222.0.26 () {56 vars in 1177 bytes} [Wed Aug 24 05:35:16 2022] GET /identity/v3/users/50bf3ebc19fe497c8fe7862e8d7812c7 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:35:17.071989 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a966b7c8-b873-455e-b190-1aa12a8bb750 None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:35:17.167393 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a966b7c8-b873-455e-b190-1aa12a8bb750 None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:35:17.200174 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017ce2de-012f-48fb-8fbc-fee9ca97eede None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:35:17.200784 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017ce2de-012f-48fb-8fbc-fee9ca97eede None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:35:17.201063 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017ce2de-012f-48fb-8fbc-fee9ca97eede None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:35:17.201334 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017ce2de-012f-48fb-8fbc-fee9ca97eede None admin] PATH_INFO: `/v3/projects/766ba21bf3904c148f49052c4075c7fc` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:35:17.202456 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017ce2de-012f-48fb-8fbc-fee9ca97eede None admin] RBAC: Authorizing `identity:get_project(project_id=766ba21bf3904c148f49052c4075c7fc)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:35:17.203869 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017ce2de-012f-48fb-8fbc-fee9ca97eede None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:35:17.205452 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 591/1191] 10.222.0.26 () {56 vars in 1186 bytes} [Wed Aug 24 05:35:17 2022] GET /identity/v3/projects/766ba21bf3904c148f49052c4075c7fc => generated 361 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:35:17.211568 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59690515-0e15-4f86-a0a9-1a7300edffeb None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:35:17.308493 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59690515-0e15-4f86-a0a9-1a7300edffeb None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:35:17.341691 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1bc78e-6541-4f75-a22a-0b2ee85f480e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:35:17.342357 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1bc78e-6541-4f75-a22a-0b2ee85f480e None admin] REQUEST_METHOD: `PUT` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:35:17.342641 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1bc78e-6541-4f75-a22a-0b2ee85f480e None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:35:17.342915 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1bc78e-6541-4f75-a22a-0b2ee85f480e None admin] PATH_INFO: `/v3/projects/766ba21bf3904c148f49052c4075c7fc/users/50bf3ebc19fe497c8fe7862e8d7812c7/roles/640bda0879494e60b72680ee505285f0` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:35:17.344790 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1bc78e-6541-4f75-a22a-0b2ee85f480e None admin] RBAC: Authorizing `identity:create_grant(project_id=766ba21bf3904c148f49052c4075c7fc, user_id=50bf3ebc19fe497c8fe7862e8d7812c7, role_id=640bda0879494e60b72680ee505285f0)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:35:17.346229 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1bc78e-6541-4f75-a22a-0b2ee85f480e None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:35:17.358948 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 601/1192] 10.222.0.26 () {58 vars in 1439 bytes} [Wed Aug 24 05:35:17 2022] PUT /identity/v3/projects/766ba21bf3904c148f49052c4075c7fc/users/50bf3ebc19fe497c8fe7862e8d7812c7/roles/640bda0879494e60b72680ee505285f0 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:35:19.210086 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7148b1f-bc22-48ff-93dd-2d37b33ffe5e None None] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:35:19.210620 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7148b1f-bc22-48ff-93dd-2d37b33ffe5e None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:35:19.210620 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7148b1f-bc22-48ff-93dd-2d37b33ffe5e None None] PATH_INFO: `/` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:35:19.211978 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 592/1193] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 24 05:35:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:35:19.217937 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e326805c-6ed8-47bf-9d97-c4d25d8a2518 None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:35:19.218367 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e326805c-6ed8-47bf-9d97-c4d25d8a2518 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:35:19.218515 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e326805c-6ed8-47bf-9d97-c4d25d8a2518 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:35:19.225643 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:35:19.237151 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-e326805c-6ed8-47bf-9d97-c4d25d8a2518 None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:35:19.238365 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-e326805c-6ed8-47bf-9d97-c4d25d8a2518 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:35:19.302849 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 602/1194] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 24 05:35:19 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 05:35:19.571968 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7148b1f-bc22-48ff-93dd-2d37b33ffe5e None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:35:19.591444 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:35:19.671819 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7148b1f-bc22-48ff-93dd-2d37b33ffe5e None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:35:19.705065 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da07cdd-892a-4c6f-a710-47483ab210e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:35:19.705677 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da07cdd-892a-4c6f-a710-47483ab210e6 None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:35:19.705982 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da07cdd-892a-4c6f-a710-47483ab210e6 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:35:19.706257 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da07cdd-892a-4c6f-a710-47483ab210e6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:35:19.715974 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da07cdd-892a-4c6f-a710-47483ab210e6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:35:19.720556 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application [None req-5da07cdd-892a-4c6f-a710-47483ab210e6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 05:35:19.720556 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:35:19.720556 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:35:19.720556 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:35:19.720556 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:35:19.720556 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:35:19.720556 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:35:19.720556 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:35:19.720556 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:35:19.720556 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:35:19.720556 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:35:19.720556 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:35:19.720556 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:35:19.720556 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:35:19.720556 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:35:19.720556 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:35:19.721715 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:35:19.721715 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:35:19.721715 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:35:19.721715 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:35:19.721715 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:35:19.721715 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:35:19.721715 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:35:19.721715 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:35:19.721715 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:35:19.721715 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:35:19.721715 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:35:19.721715 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application with Lock( Aug 24 05:35:19.721715 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:35:19.721715 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:35:19.721715 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:35:19.721715 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:35:19.722788 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:35:19.722788 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:35:19.722788 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:35:19.722788 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:35:19.722788 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:35:19.722788 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:35:19.722788 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:35:19.722788 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:35:19.722788 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:35:19.722788 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:35:19.722788 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 05:35:19.722788 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Aug 24 05:35:19.722788 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 593/1195] 10.222.0.26 () {56 vars in 1096 bytes} [Wed Aug 24 05:35:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:35:19.727716 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e326805c-6ed8-47bf-9d97-c4d25d8a2518 None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:35:19.823440 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e326805c-6ed8-47bf-9d97-c4d25d8a2518 None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:35:19.857138 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8661db8e-3be0-4040-8c8f-f64b3159a41e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:35:19.857737 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8661db8e-3be0-4040-8c8f-f64b3159a41e None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:35:19.858045 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8661db8e-3be0-4040-8c8f-f64b3159a41e None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:35:19.858321 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8661db8e-3be0-4040-8c8f-f64b3159a41e None admin] PATH_INFO: `/v3/roles` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:35:19.858980 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8661db8e-3be0-4040-8c8f-f64b3159a41e None admin] RBAC: Adding query filter params (name=admin) {{(pid=88113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:35:19.859282 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8661db8e-3be0-4040-8c8f-f64b3159a41e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:35:19.860644 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8661db8e-3be0-4040-8c8f-f64b3159a41e None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:35:19.861994 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:35:19.869409 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 603/1196] 10.222.0.26 () {56 vars in 1099 bytes} [Wed Aug 24 05:35:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:35:19.875749 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da07cdd-892a-4c6f-a710-47483ab210e6 None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:35:19.951393 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:35:19.975973 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da07cdd-892a-4c6f-a710-47483ab210e6 None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:35:20.009351 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bd9a81-f92d-47aa-a352-6397b4b3c4ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:35:20.010000 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bd9a81-f92d-47aa-a352-6397b4b3c4ef None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:35:20.010289 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bd9a81-f92d-47aa-a352-6397b4b3c4ef None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:35:20.010563 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bd9a81-f92d-47aa-a352-6397b4b3c4ef None admin] PATH_INFO: `/v3/users/50bf3ebc19fe497c8fe7862e8d7812c7` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:35:20.011682 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bd9a81-f92d-47aa-a352-6397b4b3c4ef None admin] RBAC: Authorizing `identity:get_user(user_id=50bf3ebc19fe497c8fe7862e8d7812c7)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:35:20.013106 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bd9a81-f92d-47aa-a352-6397b4b3c4ef None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:35:20.014719 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 594/1197] 10.222.0.26 () {56 vars in 1177 bytes} [Wed Aug 24 05:35:19 2022] GET /identity/v3/users/50bf3ebc19fe497c8fe7862e8d7812c7 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:35:20.020557 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8661db8e-3be0-4040-8c8f-f64b3159a41e None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:35:20.118285 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8661db8e-3be0-4040-8c8f-f64b3159a41e None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:35:20.155851 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cabf6c1-77d5-4562-a0e4-bb2f2315096f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:35:20.156456 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cabf6c1-77d5-4562-a0e4-bb2f2315096f None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:35:20.156733 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cabf6c1-77d5-4562-a0e4-bb2f2315096f None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:35:20.157001 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cabf6c1-77d5-4562-a0e4-bb2f2315096f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:35:20.216037 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:35:20.222769 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cabf6c1-77d5-4562-a0e4-bb2f2315096f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:35:20.224210 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cabf6c1-77d5-4562-a0e4-bb2f2315096f None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:35:20.318438 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 604/1198] 10.222.0.26 () {58 vars in 1282 bytes} [Wed Aug 24 05:35:20 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 05:35:20.324445 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bd9a81-f92d-47aa-a352-6397b4b3c4ef None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:35:20.420664 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bd9a81-f92d-47aa-a352-6397b4b3c4ef None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:35:20.453993 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ad9015-d0ca-42b1-85a5-e84fe4d66a64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:35:20.454615 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ad9015-d0ca-42b1-85a5-e84fe4d66a64 None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:35:20.454895 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ad9015-d0ca-42b1-85a5-e84fe4d66a64 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:35:20.455167 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ad9015-d0ca-42b1-85a5-e84fe4d66a64 None admin] PATH_INFO: `/v3/projects/766ba21bf3904c148f49052c4075c7fc` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:35:20.456268 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ad9015-d0ca-42b1-85a5-e84fe4d66a64 None admin] RBAC: Authorizing `identity:get_project(project_id=766ba21bf3904c148f49052c4075c7fc)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:35:20.457682 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ad9015-d0ca-42b1-85a5-e84fe4d66a64 None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:35:20.459340 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 595/1199] 10.222.0.26 () {56 vars in 1186 bytes} [Wed Aug 24 05:35:20 2022] GET /identity/v3/projects/766ba21bf3904c148f49052c4075c7fc => generated 361 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:35:20.465293 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cabf6c1-77d5-4562-a0e4-bb2f2315096f None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:35:20.555370 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:35:20.562032 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cabf6c1-77d5-4562-a0e4-bb2f2315096f None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:35:20.595092 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3027e9ee-d2ee-4764-97c3-64f126f78e49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:35:20.595683 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3027e9ee-d2ee-4764-97c3-64f126f78e49 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:35:20.595958 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3027e9ee-d2ee-4764-97c3-64f126f78e49 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:35:20.596223 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3027e9ee-d2ee-4764-97c3-64f126f78e49 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:35:20.596936 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3027e9ee-d2ee-4764-97c3-64f126f78e49 None admin] RBAC: Adding query filter params (role.id=640bda0879494e60b72680ee505285f0, scope.project.id=766ba21bf3904c148f49052c4075c7fc, user.id=50bf3ebc19fe497c8fe7862e8d7812c7) {{(pid=88113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:35:20.597242 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3027e9ee-d2ee-4764-97c3-64f126f78e49 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:35:20.598686 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3027e9ee-d2ee-4764-97c3-64f126f78e49 None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:35:20.604234 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 605/1200] 10.222.0.26 () {56 vars in 1374 bytes} [Wed Aug 24 05:35:20 2022] GET /identity/v3/role_assignments?user.id=50bf3ebc19fe497c8fe7862e8d7812c7&scope.project.id=766ba21bf3904c148f49052c4075c7fc&role.id=640bda0879494e60b72680ee505285f0 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:35:30.449324 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=94 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:35:30.601733 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=20 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:36:15.131139 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9656a22-1385-4460-94f7-e7f3ef638f36 None None] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:36:15.131798 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9656a22-1385-4460-94f7-e7f3ef638f36 None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:36:15.131798 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9656a22-1385-4460-94f7-e7f3ef638f36 None None] PATH_INFO: `/` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:36:15.134914 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 596/1201] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 24 05:36:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:36:15.139446 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8acc41-61b1-4b12-ab36-f763ae1fa925 None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:36:15.139975 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8acc41-61b1-4b12-ab36-f763ae1fa925 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:36:15.139975 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8acc41-61b1-4b12-ab36-f763ae1fa925 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:36:15.169724 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-9b8acc41-61b1-4b12-ab36-f763ae1fa925 None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:36:15.171063 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-9b8acc41-61b1-4b12-ab36-f763ae1fa925 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:36:15.265995 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 606/1202] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 24 05:36:15 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 05:36:15.569294 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9656a22-1385-4460-94f7-e7f3ef638f36 None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:36:15.718685 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9656a22-1385-4460-94f7-e7f3ef638f36 None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:36:15.762197 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb8127a-132d-4e49-8ff8-3f02c4522475 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:36:15.763149 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb8127a-132d-4e49-8ff8-3f02c4522475 None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:36:15.763587 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb8127a-132d-4e49-8ff8-3f02c4522475 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:36:15.764017 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb8127a-132d-4e49-8ff8-3f02c4522475 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:36:15.780198 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb8127a-132d-4e49-8ff8-3f02c4522475 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:36:15.781714 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb8127a-132d-4e49-8ff8-3f02c4522475 None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:36:15.800914 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application [None req-0fb8127a-132d-4e49-8ff8-3f02c4522475 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:36:15.800914 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:36:15.800914 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:36:15.800914 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:36:15.800914 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:36:15.800914 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:36:15.800914 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:36:15.800914 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:36:15.800914 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:36:15.800914 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:36:15.800914 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:36:15.800914 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:36:15.800914 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 05:36:15.800914 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 05:36:15.800914 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 05:36:15.800914 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 05:36:15.802163 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:36:15.802163 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:36:15.802163 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:36:15.802163 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:36:15.802163 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:36:15.802163 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:36:15.802163 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:36:15.802163 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application with Lock( Aug 24 05:36:15.802163 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:36:15.802163 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:36:15.802163 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:36:15.802163 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:36:15.802163 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:36:15.802163 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:36:15.802163 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:36:15.802163 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:36:15.802163 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 05:36:15.803154 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 05:36:15.803154 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:36:15.803154 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Aug 24 05:36:15.803154 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 597/1203] 10.222.0.26 () {56 vars in 1108 bytes} [Wed Aug 24 05:36:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 05:36:15.810005 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8acc41-61b1-4b12-ab36-f763ae1fa925 None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:36:15.939373 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8acc41-61b1-4b12-ab36-f763ae1fa925 None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:36:15.975072 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:36:15.985081 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7197845-2a18-42e1-baba-88a8c11e633a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:36:15.986525 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7197845-2a18-42e1-baba-88a8c11e633a None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:36:15.987007 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7197845-2a18-42e1-baba-88a8c11e633a None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:36:15.987335 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7197845-2a18-42e1-baba-88a8c11e633a None admin] PATH_INFO: `/v3/domains` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:36:15.987916 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7197845-2a18-42e1-baba-88a8c11e633a None admin] RBAC: Adding query filter params (name=Default) {{(pid=88113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:36:15.988332 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7197845-2a18-42e1-baba-88a8c11e633a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:36:15.990098 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7197845-2a18-42e1-baba-88a8c11e633a None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:36:16.002181 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 607/1204] 10.222.0.26 () {56 vars in 1109 bytes} [Wed Aug 24 05:36:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:36:16.007919 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb8127a-132d-4e49-8ff8-3f02c4522475 None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:36:16.066937 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:36:16.126071 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb8127a-132d-4e49-8ff8-3f02c4522475 None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:36:16.167812 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913776d6-6b9d-44f1-974c-306b8eda4c92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:36:16.168503 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913776d6-6b9d-44f1-974c-306b8eda4c92 None admin] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:36:16.168788 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913776d6-6b9d-44f1-974c-306b8eda4c92 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:36:16.169054 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913776d6-6b9d-44f1-974c-306b8eda4c92 None admin] PATH_INFO: `/v3/users` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:36:16.169963 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913776d6-6b9d-44f1-974c-306b8eda4c92 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:36:16.171459 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913776d6-6b9d-44f1-974c-306b8eda4c92 None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:36:16.205984 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 598/1205] 10.222.0.26 () {60 vars in 1132 bytes} [Wed Aug 24 05:36:16 2022] POST /identity/v3/users => generated 251 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:36:18.281838 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d95bca-4cf4-464c-bad7-7cd26cc8d7d1 None None] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:36:18.282444 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d95bca-4cf4-464c-bad7-7cd26cc8d7d1 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:36:18.282444 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d95bca-4cf4-464c-bad7-7cd26cc8d7d1 None None] PATH_INFO: `/` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:36:18.283760 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 608/1206] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 24 05:36:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:36:18.293658 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28011ef6-d101-4106-9ce1-03dda6e09b82 None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:36:18.293658 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28011ef6-d101-4106-9ce1-03dda6e09b82 None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:36:18.293658 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28011ef6-d101-4106-9ce1-03dda6e09b82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:36:18.309897 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-28011ef6-d101-4106-9ce1-03dda6e09b82 None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:36:18.311270 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-28011ef6-d101-4106-9ce1-03dda6e09b82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:36:18.389727 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 599/1207] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 24 05:36:18 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 05:36:18.667784 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d95bca-4cf4-464c-bad7-7cd26cc8d7d1 None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:36:18.792732 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d95bca-4cf4-464c-bad7-7cd26cc8d7d1 None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:36:18.834288 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8229f26-b3ab-4d9a-9d67-649d240cd0a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:36:18.834962 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8229f26-b3ab-4d9a-9d67-649d240cd0a3 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:36:18.835294 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8229f26-b3ab-4d9a-9d67-649d240cd0a3 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:36:18.835571 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8229f26-b3ab-4d9a-9d67-649d240cd0a3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:36:18.852359 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8229f26-b3ab-4d9a-9d67-649d240cd0a3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:36:18.857583 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application [None req-c8229f26-b3ab-4d9a-9d67-649d240cd0a3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 05:36:18.857583 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:36:18.857583 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:36:18.857583 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:36:18.857583 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:36:18.857583 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:36:18.857583 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:36:18.857583 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:36:18.857583 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:36:18.857583 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:36:18.857583 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:36:18.857583 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:36:18.857583 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:36:18.857583 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:36:18.857583 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:36:18.857583 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:36:18.858594 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:36:18.858594 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:36:18.858594 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:36:18.858594 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:36:18.858594 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:36:18.858594 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:36:18.858594 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:36:18.858594 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:36:18.858594 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:36:18.858594 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:36:18.858594 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:36:18.858594 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application with Lock( Aug 24 05:36:18.858594 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:36:18.858594 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:36:18.858594 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:36:18.858594 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:36:18.859935 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:36:18.859935 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:36:18.859935 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:36:18.859935 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:36:18.859935 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:36:18.859935 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:36:18.859935 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:36:18.859935 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:36:18.859935 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:36:18.859935 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:36:18.859935 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 05:36:18.859935 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Aug 24 05:36:18.863808 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 609/1208] 10.222.0.26 () {56 vars in 1102 bytes} [Wed Aug 24 05:36:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 05:36:18.865436 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28011ef6-d101-4106-9ce1-03dda6e09b82 None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:36:18.911119 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:36:18.985225 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28011ef6-d101-4106-9ce1-03dda6e09b82 None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:36:19.026270 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98fb93e-4866-4ade-bc56-aa6c92c747c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:36:19.026893 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98fb93e-4866-4ade-bc56-aa6c92c747c0 None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:36:19.027177 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98fb93e-4866-4ade-bc56-aa6c92c747c0 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:36:19.027453 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98fb93e-4866-4ade-bc56-aa6c92c747c0 None admin] PATH_INFO: `/v3/roles` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:36:19.028128 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98fb93e-4866-4ade-bc56-aa6c92c747c0 None admin] RBAC: Adding query filter params (name=service) {{(pid=88112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:36:19.028432 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98fb93e-4866-4ade-bc56-aa6c92c747c0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:36:19.029806 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98fb93e-4866-4ade-bc56-aa6c92c747c0 None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:36:19.039030 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 600/1209] 10.222.0.26 () {56 vars in 1103 bytes} [Wed Aug 24 05:36:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:36:19.045496 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8229f26-b3ab-4d9a-9d67-649d240cd0a3 None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:36:19.104232 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:36:19.171074 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8229f26-b3ab-4d9a-9d67-649d240cd0a3 None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:36:19.213466 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdaee29-a255-4b5e-b134-be4459312d6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:36:19.214126 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdaee29-a255-4b5e-b134-be4459312d6c None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:36:19.214486 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdaee29-a255-4b5e-b134-be4459312d6c None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:36:19.214675 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdaee29-a255-4b5e-b134-be4459312d6c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:36:19.228425 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdaee29-a255-4b5e-b134-be4459312d6c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:36:19.229871 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdaee29-a255-4b5e-b134-be4459312d6c None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:36:19.244907 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application [None req-bbdaee29-a255-4b5e-b134-be4459312d6c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:36:19.244907 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:36:19.244907 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:36:19.244907 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:36:19.244907 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:36:19.244907 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:36:19.244907 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:36:19.244907 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:36:19.244907 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:36:19.244907 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:36:19.244907 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:36:19.244907 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:36:19.244907 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 05:36:19.244907 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 05:36:19.244907 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 05:36:19.244907 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 05:36:19.247086 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:36:19.247086 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:36:19.247086 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:36:19.247086 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:36:19.247086 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:36:19.247086 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:36:19.247086 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:36:19.247086 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application with Lock( Aug 24 05:36:19.247086 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:36:19.247086 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:36:19.247086 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:36:19.247086 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:36:19.247086 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:36:19.247086 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:36:19.247086 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:36:19.247086 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:36:19.247086 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 05:36:19.247962 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 05:36:19.247962 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:36:19.247962 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Aug 24 05:36:19.247962 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 610/1210] 10.222.0.26 () {56 vars in 1108 bytes} [Wed Aug 24 05:36:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:36:19.251969 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98fb93e-4866-4ade-bc56-aa6c92c747c0 None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:36:19.367818 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:36:19.371470 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98fb93e-4866-4ade-bc56-aa6c92c747c0 None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:36:19.410736 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2336c2-ba66-4c77-a38a-7541f30b5df7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:36:19.411331 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2336c2-ba66-4c77-a38a-7541f30b5df7 None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:36:19.411633 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2336c2-ba66-4c77-a38a-7541f30b5df7 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:36:19.411892 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2336c2-ba66-4c77-a38a-7541f30b5df7 None admin] PATH_INFO: `/v3/domains` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:36:19.412535 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2336c2-ba66-4c77-a38a-7541f30b5df7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:36:19.412832 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2336c2-ba66-4c77-a38a-7541f30b5df7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:36:19.414218 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2336c2-ba66-4c77-a38a-7541f30b5df7 None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:36:19.426654 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 601/1211] 10.222.0.26 () {56 vars in 1109 bytes} [Wed Aug 24 05:36:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:36:19.432755 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdaee29-a255-4b5e-b134-be4459312d6c None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:36:19.539719 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdaee29-a255-4b5e-b134-be4459312d6c None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:36:19.541464 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:36:19.578875 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de97e5ab-cc46-4c3a-b5a2-bb6de6a1b4c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:36:19.579501 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de97e5ab-cc46-4c3a-b5a2-bb6de6a1b4c2 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:36:19.579779 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de97e5ab-cc46-4c3a-b5a2-bb6de6a1b4c2 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:36:19.580041 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de97e5ab-cc46-4c3a-b5a2-bb6de6a1b4c2 None admin] PATH_INFO: `/v3/users/placement` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:36:19.588334 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de97e5ab-cc46-4c3a-b5a2-bb6de6a1b4c2 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:36:19.589814 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de97e5ab-cc46-4c3a-b5a2-bb6de6a1b4c2 None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:36:19.601014 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application [None req-de97e5ab-cc46-4c3a-b5a2-bb6de6a1b4c2 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 24 05:36:19.601014 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:36:19.601014 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:36:19.601014 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:36:19.601014 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:36:19.601014 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:36:19.601014 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:36:19.601014 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:36:19.601014 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:36:19.601014 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:36:19.601014 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:36:19.601014 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:36:19.601014 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 05:36:19.601014 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 05:36:19.601014 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 05:36:19.601014 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 05:36:19.602502 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:36:19.602502 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:36:19.602502 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 05:36:19.602502 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 05:36:19.602502 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 05:36:19.602502 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 05:36:19.602502 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:36:19.602502 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:36:19.602502 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:36:19.602502 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:36:19.602502 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:36:19.602502 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application with Lock( Aug 24 05:36:19.602502 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:36:19.602502 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:36:19.602502 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:36:19.602502 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:36:19.602502 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:36:19.602502 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:36:19.604540 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:36:19.604540 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:36:19.604540 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 05:36:19.604540 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 05:36:19.604540 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 05:36:19.604540 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 05:36:19.604540 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 05:36:19.604540 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 05:36:19.604540 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 24 05:36:19.604540 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Aug 24 05:36:19.604540 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 611/1212] 10.222.0.26 () {56 vars in 1108 bytes} [Wed Aug 24 05:36:19 2022] GET /identity/v3/users/placement => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 05:36:19.608689 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2336c2-ba66-4c77-a38a-7541f30b5df7 None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:36:19.718210 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2336c2-ba66-4c77-a38a-7541f30b5df7 None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:36:19.757483 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319674c8-0bd5-4b07-ab57-57d33cb4b968 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:36:19.758132 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319674c8-0bd5-4b07-ab57-57d33cb4b968 None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:36:19.758414 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319674c8-0bd5-4b07-ab57-57d33cb4b968 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:36:19.758690 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319674c8-0bd5-4b07-ab57-57d33cb4b968 None admin] PATH_INFO: `/v3/users` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:36:19.759444 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319674c8-0bd5-4b07-ab57-57d33cb4b968 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:36:19.759748 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319674c8-0bd5-4b07-ab57-57d33cb4b968 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:36:19.761171 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319674c8-0bd5-4b07-ab57-57d33cb4b968 None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:36:19.780836 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 602/1213] 10.222.0.26 () {56 vars in 1143 bytes} [Wed Aug 24 05:36:19 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:36:19.786515 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de97e5ab-cc46-4c3a-b5a2-bb6de6a1b4c2 None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:36:19.908155 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de97e5ab-cc46-4c3a-b5a2-bb6de6a1b4c2 None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:36:19.947352 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea7a1a9-b8c6-4c7f-bcc0-8c7d36b011b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:36:19.948072 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea7a1a9-b8c6-4c7f-bcc0-8c7d36b011b4 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:36:19.948354 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea7a1a9-b8c6-4c7f-bcc0-8c7d36b011b4 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:36:19.948660 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea7a1a9-b8c6-4c7f-bcc0-8c7d36b011b4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:36:19.982832 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:36:20.022792 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea7a1a9-b8c6-4c7f-bcc0-8c7d36b011b4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:36:20.024247 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea7a1a9-b8c6-4c7f-bcc0-8c7d36b011b4 None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:36:20.131772 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 612/1214] 10.222.0.26 () {58 vars in 1282 bytes} [Wed Aug 24 05:36:19 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 24 05:36:20.138623 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319674c8-0bd5-4b07-ab57-57d33cb4b968 None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:36:20.160271 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:36:20.254029 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319674c8-0bd5-4b07-ab57-57d33cb4b968 None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:36:20.292950 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81dcf69-4406-4727-a302-fce309c4ae95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:36:20.293872 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81dcf69-4406-4727-a302-fce309c4ae95 None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:36:20.295289 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81dcf69-4406-4727-a302-fce309c4ae95 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:36:20.295289 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81dcf69-4406-4727-a302-fce309c4ae95 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:36:20.306272 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81dcf69-4406-4727-a302-fce309c4ae95 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:36:20.307761 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81dcf69-4406-4727-a302-fce309c4ae95 None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:36:20.324658 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application [None req-f81dcf69-4406-4727-a302-fce309c4ae95 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:36:20.324658 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:36:20.324658 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:36:20.324658 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:36:20.324658 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:36:20.324658 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:36:20.324658 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:36:20.324658 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:36:20.324658 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:36:20.324658 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:36:20.324658 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:36:20.324658 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:36:20.324658 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 05:36:20.324658 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 05:36:20.324658 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 05:36:20.324658 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 05:36:20.326475 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:36:20.326475 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:36:20.326475 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:36:20.326475 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:36:20.326475 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:36:20.326475 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:36:20.326475 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:36:20.326475 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application with Lock( Aug 24 05:36:20.326475 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:36:20.326475 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:36:20.326475 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:36:20.326475 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:36:20.326475 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:36:20.326475 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:36:20.326475 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:36:20.326475 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:36:20.326475 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 05:36:20.328130 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 05:36:20.328130 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:36:20.328130 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Aug 24 05:36:20.328130 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 603/1215] 10.222.0.26 () {56 vars in 1108 bytes} [Wed Aug 24 05:36:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:36:20.337996 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea7a1a9-b8c6-4c7f-bcc0-8c7d36b011b4 None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:36:20.394580 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:36:20.434296 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea7a1a9-b8c6-4c7f-bcc0-8c7d36b011b4 None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:36:20.468594 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0c3159-dd6a-476b-a1d5-5255897fafd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:36:20.469181 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0c3159-dd6a-476b-a1d5-5255897fafd5 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:36:20.469469 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0c3159-dd6a-476b-a1d5-5255897fafd5 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:36:20.469726 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0c3159-dd6a-476b-a1d5-5255897fafd5 None admin] PATH_INFO: `/v3/domains` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:36:20.470414 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0c3159-dd6a-476b-a1d5-5255897fafd5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:36:20.470695 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0c3159-dd6a-476b-a1d5-5255897fafd5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:36:20.472050 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0c3159-dd6a-476b-a1d5-5255897fafd5 None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:36:20.488473 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 613/1216] 10.222.0.26 () {56 vars in 1109 bytes} [Wed Aug 24 05:36:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:36:20.489993 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81dcf69-4406-4727-a302-fce309c4ae95 None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:36:20.570786 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:36:20.608046 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81dcf69-4406-4727-a302-fce309c4ae95 None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:36:20.658443 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b462fa69-8bf5-4bac-ac4d-36ced13c155f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:36:20.659118 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b462fa69-8bf5-4bac-ac4d-36ced13c155f None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:36:20.659398 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b462fa69-8bf5-4bac-ac4d-36ced13c155f None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:36:20.659670 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b462fa69-8bf5-4bac-ac4d-36ced13c155f None admin] PATH_INFO: `/v3/projects/service` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:36:20.667411 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b462fa69-8bf5-4bac-ac4d-36ced13c155f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:36:20.668846 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b462fa69-8bf5-4bac-ac4d-36ced13c155f None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:36:20.682685 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application [None req-b462fa69-8bf5-4bac-ac4d-36ced13c155f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 05:36:20.682685 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:36:20.682685 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:36:20.682685 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:36:20.682685 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:36:20.682685 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:36:20.682685 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:36:20.682685 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:36:20.682685 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:36:20.682685 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:36:20.682685 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:36:20.682685 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:36:20.682685 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 05:36:20.682685 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 05:36:20.682685 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 05:36:20.683871 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 05:36:20.683871 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:36:20.683871 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:36:20.683871 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:36:20.683871 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:36:20.683871 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:36:20.683871 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:36:20.683871 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:36:20.683871 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application with Lock( Aug 24 05:36:20.683871 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:36:20.683871 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:36:20.683871 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:36:20.683871 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:36:20.683871 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:36:20.683871 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:36:20.683871 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:36:20.683871 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:36:20.689928 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 05:36:20.689928 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 05:36:20.689928 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 05:36:20.689928 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 05:36:20.689928 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 05:36:20.689928 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 05:36:20.689928 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 05:36:20.689928 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Aug 24 05:36:20.689928 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 604/1217] 10.222.0.26 () {56 vars in 1111 bytes} [Wed Aug 24 05:36:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:36:20.690601 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0c3159-dd6a-476b-a1d5-5255897fafd5 None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:36:20.797528 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0c3159-dd6a-476b-a1d5-5255897fafd5 None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:36:20.822300 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:36:20.836027 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3d8627-6ffa-4343-b1f3-65c087b18812 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:36:20.836629 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3d8627-6ffa-4343-b1f3-65c087b18812 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:36:20.836911 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3d8627-6ffa-4343-b1f3-65c087b18812 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:36:20.837203 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3d8627-6ffa-4343-b1f3-65c087b18812 None admin] PATH_INFO: `/v3/projects` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:36:20.837897 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3d8627-6ffa-4343-b1f3-65c087b18812 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:36:20.838236 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3d8627-6ffa-4343-b1f3-65c087b18812 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:36:20.839659 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3d8627-6ffa-4343-b1f3-65c087b18812 None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:36:20.856544 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 614/1218] 10.222.0.26 () {56 vars in 1148 bytes} [Wed Aug 24 05:36:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:36:20.862251 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b462fa69-8bf5-4bac-ac4d-36ced13c155f None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:36:20.988657 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b462fa69-8bf5-4bac-ac4d-36ced13c155f None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:36:21.024237 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:36:21.032163 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec64d328-869e-488e-bc5f-3c3f62807671 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:36:21.033100 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec64d328-869e-488e-bc5f-3c3f62807671 None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:36:21.033743 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec64d328-869e-488e-bc5f-3c3f62807671 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:36:21.034077 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec64d328-869e-488e-bc5f-3c3f62807671 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:36:21.034815 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec64d328-869e-488e-bc5f-3c3f62807671 None admin] RBAC: Adding query filter params (role.id=59fa3749ca7f47e2ba1127945e13336c, scope.project.id=ded4fe81d4dc43188dd84e53025ee783, user.id=995ebe690b7748c9842bc0696415fc52) {{(pid=88112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:36:21.035125 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec64d328-869e-488e-bc5f-3c3f62807671 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:36:21.036551 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec64d328-869e-488e-bc5f-3c3f62807671 None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:36:21.043505 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 605/1219] 10.222.0.26 () {56 vars in 1374 bytes} [Wed Aug 24 05:36:20 2022] GET /identity/v3/role_assignments?user.id=995ebe690b7748c9842bc0696415fc52&scope.project.id=ded4fe81d4dc43188dd84e53025ee783&role.id=59fa3749ca7f47e2ba1127945e13336c => generated 259 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:36:23.113488 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c616688-a0e7-4674-b19b-82b608571b55 None None] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:36:23.114116 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c616688-a0e7-4674-b19b-82b608571b55 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:36:23.114237 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c616688-a0e7-4674-b19b-82b608571b55 None None] PATH_INFO: `/` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:36:23.115615 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 615/1220] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 24 05:36:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:36:23.121880 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea401347-bbff-4c12-a8f2-f3d0cbf8db34 None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:36:23.122359 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea401347-bbff-4c12-a8f2-f3d0cbf8db34 None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:36:23.122467 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea401347-bbff-4c12-a8f2-f3d0cbf8db34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:36:23.141865 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-ea401347-bbff-4c12-a8f2-f3d0cbf8db34 None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:36:23.143197 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-ea401347-bbff-4c12-a8f2-f3d0cbf8db34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:36:23.214484 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 606/1221] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 24 05:36:23 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 05:36:23.502087 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c616688-a0e7-4674-b19b-82b608571b55 None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:36:23.616125 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c616688-a0e7-4674-b19b-82b608571b55 None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:36:23.650452 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdb0c16-8265-440c-b031-397a14205efc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:36:23.651101 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdb0c16-8265-440c-b031-397a14205efc None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:36:23.651390 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdb0c16-8265-440c-b031-397a14205efc None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:36:23.651661 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdb0c16-8265-440c-b031-397a14205efc None admin] PATH_INFO: `/v3/roles/service` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:36:23.661962 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdb0c16-8265-440c-b031-397a14205efc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:36:23.666638 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application [None req-bbdb0c16-8265-440c-b031-397a14205efc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 05:36:23.666638 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:36:23.666638 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:36:23.666638 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:36:23.666638 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:36:23.666638 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:36:23.666638 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:36:23.666638 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:36:23.666638 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:36:23.666638 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:36:23.666638 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:36:23.666638 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:36:23.666638 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:36:23.666638 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:36:23.666638 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:36:23.666638 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:36:23.667750 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:36:23.667750 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:36:23.667750 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:36:23.667750 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:36:23.667750 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:36:23.667750 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:36:23.667750 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:36:23.667750 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:36:23.667750 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:36:23.667750 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:36:23.667750 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:36:23.667750 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application with Lock( Aug 24 05:36:23.667750 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:36:23.667750 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:36:23.667750 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:36:23.667750 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:36:23.668600 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:36:23.668600 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:36:23.668600 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:36:23.668600 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:36:23.668600 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:36:23.668600 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:36:23.668600 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:36:23.668600 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:36:23.668600 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:36:23.668600 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:36:23.668600 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 05:36:23.668600 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Aug 24 05:36:23.668600 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 616/1222] 10.222.0.26 () {56 vars in 1102 bytes} [Wed Aug 24 05:36:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:36:23.674271 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea401347-bbff-4c12-a8f2-f3d0cbf8db34 None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:36:23.781193 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea401347-bbff-4c12-a8f2-f3d0cbf8db34 None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:36:23.806302 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:36:23.819480 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7253218b-b037-43ba-a9d6-d7658f9e7e82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:36:23.820141 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7253218b-b037-43ba-a9d6-d7658f9e7e82 None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:36:23.820439 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7253218b-b037-43ba-a9d6-d7658f9e7e82 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:36:23.820713 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7253218b-b037-43ba-a9d6-d7658f9e7e82 None admin] PATH_INFO: `/v3/roles` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:36:23.821867 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7253218b-b037-43ba-a9d6-d7658f9e7e82 None admin] RBAC: Adding query filter params (name=service) {{(pid=88112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:36:23.822198 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7253218b-b037-43ba-a9d6-d7658f9e7e82 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:36:23.823538 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7253218b-b037-43ba-a9d6-d7658f9e7e82 None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:36:23.831375 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 607/1223] 10.222.0.26 () {56 vars in 1103 bytes} [Wed Aug 24 05:36:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:36:23.838043 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdb0c16-8265-440c-b031-397a14205efc None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:36:23.886496 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:36:23.953185 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdb0c16-8265-440c-b031-397a14205efc None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:36:23.995211 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439cfb1b-f4ae-42bd-997c-465b5e3fc671 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:36:23.995888 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439cfb1b-f4ae-42bd-997c-465b5e3fc671 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:36:23.996169 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439cfb1b-f4ae-42bd-997c-465b5e3fc671 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:36:23.996440 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439cfb1b-f4ae-42bd-997c-465b5e3fc671 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:36:24.009274 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439cfb1b-f4ae-42bd-997c-465b5e3fc671 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:36:24.011126 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439cfb1b-f4ae-42bd-997c-465b5e3fc671 None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:36:24.027256 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application [None req-439cfb1b-f4ae-42bd-997c-465b5e3fc671 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:36:24.027256 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:36:24.027256 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:36:24.027256 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:36:24.027256 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:36:24.027256 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:36:24.027256 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:36:24.027256 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:36:24.027256 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:36:24.027256 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:36:24.027256 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:36:24.027256 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:36:24.027256 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 05:36:24.027256 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 05:36:24.027256 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 05:36:24.027256 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 05:36:24.028484 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:36:24.028484 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:36:24.028484 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:36:24.028484 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:36:24.028484 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:36:24.028484 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:36:24.028484 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:36:24.028484 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application with Lock( Aug 24 05:36:24.028484 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:36:24.028484 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:36:24.028484 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:36:24.028484 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:36:24.028484 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:36:24.028484 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:36:24.028484 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:36:24.028484 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:36:24.028484 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 05:36:24.029623 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 05:36:24.029623 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:36:24.029623 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Aug 24 05:36:24.029623 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 617/1224] 10.222.0.26 () {56 vars in 1108 bytes} [Wed Aug 24 05:36:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:36:24.035011 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7253218b-b037-43ba-a9d6-d7658f9e7e82 None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:36:24.149764 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7253218b-b037-43ba-a9d6-d7658f9e7e82 None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:36:24.186978 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90138e3a-1fd3-4d0a-ba34-c910a1decd1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:36:24.187876 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90138e3a-1fd3-4d0a-ba34-c910a1decd1a None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:36:24.188160 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90138e3a-1fd3-4d0a-ba34-c910a1decd1a None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:36:24.188432 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90138e3a-1fd3-4d0a-ba34-c910a1decd1a None admin] PATH_INFO: `/v3/domains` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:36:24.189154 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90138e3a-1fd3-4d0a-ba34-c910a1decd1a None admin] RBAC: Adding query filter params (name=Default) {{(pid=88112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:36:24.189466 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90138e3a-1fd3-4d0a-ba34-c910a1decd1a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:36:24.190954 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90138e3a-1fd3-4d0a-ba34-c910a1decd1a None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:36:24.205049 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 608/1225] 10.222.0.26 () {56 vars in 1109 bytes} [Wed Aug 24 05:36:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:36:24.210742 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439cfb1b-f4ae-42bd-997c-465b5e3fc671 None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:36:24.316056 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:36:24.323782 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439cfb1b-f4ae-42bd-997c-465b5e3fc671 None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:36:24.358983 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f54d11-6eae-4720-8f7c-1ff36b550bad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:36:24.359612 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f54d11-6eae-4720-8f7c-1ff36b550bad None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:36:24.359902 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f54d11-6eae-4720-8f7c-1ff36b550bad None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:36:24.360149 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f54d11-6eae-4720-8f7c-1ff36b550bad None admin] PATH_INFO: `/v3/users/placement` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:36:24.368568 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f54d11-6eae-4720-8f7c-1ff36b550bad None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:36:24.370045 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f54d11-6eae-4720-8f7c-1ff36b550bad None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:36:24.381148 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application [None req-73f54d11-6eae-4720-8f7c-1ff36b550bad None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 24 05:36:24.381148 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:36:24.381148 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:36:24.381148 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:36:24.381148 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:36:24.381148 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:36:24.381148 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:36:24.381148 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:36:24.381148 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:36:24.381148 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:36:24.381148 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:36:24.381148 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:36:24.381148 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 05:36:24.381148 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 05:36:24.381148 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 05:36:24.381148 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 05:36:24.382449 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:36:24.382449 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:36:24.382449 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 05:36:24.382449 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 05:36:24.382449 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 05:36:24.382449 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 05:36:24.382449 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:36:24.382449 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:36:24.382449 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:36:24.382449 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:36:24.382449 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:36:24.382449 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application with Lock( Aug 24 05:36:24.382449 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:36:24.382449 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:36:24.382449 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:36:24.382449 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:36:24.382449 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:36:24.382449 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:36:24.383379 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:36:24.383379 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:36:24.383379 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 05:36:24.383379 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 05:36:24.383379 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 05:36:24.383379 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 05:36:24.383379 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 05:36:24.383379 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 05:36:24.383379 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 24 05:36:24.383379 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Aug 24 05:36:24.383379 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 618/1226] 10.222.0.26 () {56 vars in 1108 bytes} [Wed Aug 24 05:36:24 2022] GET /identity/v3/users/placement => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:36:24.388230 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90138e3a-1fd3-4d0a-ba34-c910a1decd1a None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:36:24.436897 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:36:24.492862 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90138e3a-1fd3-4d0a-ba34-c910a1decd1a None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:36:24.530553 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08b2ed0-73b9-44cb-aa86-7e503bbbe4d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:36:24.531303 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08b2ed0-73b9-44cb-aa86-7e503bbbe4d3 None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:36:24.531668 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08b2ed0-73b9-44cb-aa86-7e503bbbe4d3 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:36:24.532009 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08b2ed0-73b9-44cb-aa86-7e503bbbe4d3 None admin] PATH_INFO: `/v3/users` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:36:24.532879 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08b2ed0-73b9-44cb-aa86-7e503bbbe4d3 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:36:24.533188 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08b2ed0-73b9-44cb-aa86-7e503bbbe4d3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:36:24.535068 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08b2ed0-73b9-44cb-aa86-7e503bbbe4d3 None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:36:24.554898 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 609/1227] 10.222.0.26 () {56 vars in 1143 bytes} [Wed Aug 24 05:36:24 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:36:24.561171 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f54d11-6eae-4720-8f7c-1ff36b550bad None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:36:24.666170 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f54d11-6eae-4720-8f7c-1ff36b550bad None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:36:24.699824 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a84b5c-e237-451a-9b85-1e52a80b3de0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:36:24.700458 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a84b5c-e237-451a-9b85-1e52a80b3de0 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:36:24.700732 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a84b5c-e237-451a-9b85-1e52a80b3de0 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:36:24.700999 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a84b5c-e237-451a-9b85-1e52a80b3de0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:36:24.711546 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a84b5c-e237-451a-9b85-1e52a80b3de0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:36:24.713463 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a84b5c-e237-451a-9b85-1e52a80b3de0 None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:36:24.728827 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application [None req-b0a84b5c-e237-451a-9b85-1e52a80b3de0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:36:24.728827 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:36:24.728827 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:36:24.728827 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:36:24.728827 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:36:24.728827 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:36:24.728827 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:36:24.728827 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:36:24.728827 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:36:24.728827 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:36:24.728827 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:36:24.728827 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:36:24.728827 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 05:36:24.728827 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 05:36:24.728827 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 05:36:24.728827 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 05:36:24.729995 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:36:24.729995 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:36:24.729995 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:36:24.729995 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:36:24.729995 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:36:24.729995 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:36:24.729995 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:36:24.729995 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application with Lock( Aug 24 05:36:24.729995 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:36:24.729995 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:36:24.729995 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:36:24.729995 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:36:24.729995 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:36:24.729995 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:36:24.729995 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:36:24.729995 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:36:24.729995 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 05:36:24.731135 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 05:36:24.731135 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:36:24.731135 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Aug 24 05:36:24.734755 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 619/1228] 10.222.0.26 () {56 vars in 1108 bytes} [Wed Aug 24 05:36:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:36:24.736381 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08b2ed0-73b9-44cb-aa86-7e503bbbe4d3 None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:36:24.845749 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08b2ed0-73b9-44cb-aa86-7e503bbbe4d3 None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:36:24.848173 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:36:24.882675 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f940aeef-876a-449b-91df-851d8d022093 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:36:24.883418 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f940aeef-876a-449b-91df-851d8d022093 None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:36:24.883726 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f940aeef-876a-449b-91df-851d8d022093 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:36:24.883986 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f940aeef-876a-449b-91df-851d8d022093 None admin] PATH_INFO: `/v3/domains` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:36:24.884728 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f940aeef-876a-449b-91df-851d8d022093 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:36:24.885082 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f940aeef-876a-449b-91df-851d8d022093 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:36:24.886484 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f940aeef-876a-449b-91df-851d8d022093 None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:36:24.900215 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 610/1229] 10.222.0.26 () {56 vars in 1109 bytes} [Wed Aug 24 05:36:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:36:24.905918 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a84b5c-e237-451a-9b85-1e52a80b3de0 None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:36:24.916235 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:36:25.018930 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a84b5c-e237-451a-9b85-1e52a80b3de0 None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:36:25.056154 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31249a0-8dec-421a-a803-997f10ac5026 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:36:25.056872 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31249a0-8dec-421a-a803-997f10ac5026 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:36:25.057188 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31249a0-8dec-421a-a803-997f10ac5026 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:36:25.057462 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31249a0-8dec-421a-a803-997f10ac5026 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:36:25.064919 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31249a0-8dec-421a-a803-997f10ac5026 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:36:25.066546 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31249a0-8dec-421a-a803-997f10ac5026 None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:36:25.079684 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application [None req-d31249a0-8dec-421a-a803-997f10ac5026 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 05:36:25.079684 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:36:25.079684 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:36:25.079684 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:36:25.079684 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:36:25.079684 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:36:25.079684 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:36:25.079684 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:36:25.079684 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:36:25.079684 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:36:25.079684 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:36:25.079684 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:36:25.079684 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 05:36:25.079684 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 05:36:25.079684 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 05:36:25.080881 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 05:36:25.080881 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:36:25.080881 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:36:25.080881 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:36:25.080881 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:36:25.080881 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:36:25.080881 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:36:25.080881 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:36:25.080881 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application with Lock( Aug 24 05:36:25.080881 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:36:25.080881 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:36:25.080881 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:36:25.080881 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:36:25.080881 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:36:25.080881 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:36:25.080881 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:36:25.080881 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:36:25.082074 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 05:36:25.082074 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 05:36:25.082074 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 05:36:25.082074 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 05:36:25.082074 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 05:36:25.082074 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 05:36:25.082074 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 05:36:25.082074 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Aug 24 05:36:25.082074 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 620/1230] 10.222.0.26 () {56 vars in 1111 bytes} [Wed Aug 24 05:36:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:36:25.087311 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f940aeef-876a-449b-91df-851d8d022093 None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:36:25.200897 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f940aeef-876a-449b-91df-851d8d022093 None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:36:25.239310 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bc610b-4ce6-4b0d-b486-d141e22eef2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:36:25.239909 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bc610b-4ce6-4b0d-b486-d141e22eef2d None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:36:25.240182 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bc610b-4ce6-4b0d-b486-d141e22eef2d None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:36:25.240449 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bc610b-4ce6-4b0d-b486-d141e22eef2d None admin] PATH_INFO: `/v3/projects` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:36:25.241129 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bc610b-4ce6-4b0d-b486-d141e22eef2d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:36:25.241428 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bc610b-4ce6-4b0d-b486-d141e22eef2d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:36:25.243420 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bc610b-4ce6-4b0d-b486-d141e22eef2d None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:36:25.254956 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 611/1231] 10.222.0.26 () {56 vars in 1148 bytes} [Wed Aug 24 05:36:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:36:25.260998 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31249a0-8dec-421a-a803-997f10ac5026 None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:36:25.337102 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:36:25.376449 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31249a0-8dec-421a-a803-997f10ac5026 None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:36:25.412948 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07afcc58-94d9-4f81-8ce5-4b599aa8579f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:36:25.413606 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07afcc58-94d9-4f81-8ce5-4b599aa8579f None admin] REQUEST_METHOD: `PUT` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:36:25.413886 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07afcc58-94d9-4f81-8ce5-4b599aa8579f None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:36:25.415937 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07afcc58-94d9-4f81-8ce5-4b599aa8579f None admin] PATH_INFO: `/v3/projects/ded4fe81d4dc43188dd84e53025ee783/users/995ebe690b7748c9842bc0696415fc52/roles/59fa3749ca7f47e2ba1127945e13336c` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:36:25.431184 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07afcc58-94d9-4f81-8ce5-4b599aa8579f None admin] RBAC: Authorizing `identity:create_grant(project_id=ded4fe81d4dc43188dd84e53025ee783, user_id=995ebe690b7748c9842bc0696415fc52, role_id=59fa3749ca7f47e2ba1127945e13336c)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:36:25.432686 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07afcc58-94d9-4f81-8ce5-4b599aa8579f None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:36:25.445562 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 621/1232] 10.222.0.26 () {58 vars in 1439 bytes} [Wed Aug 24 05:36:25 2022] PUT /identity/v3/projects/ded4fe81d4dc43188dd84e53025ee783/users/995ebe690b7748c9842bc0696415fc52/roles/59fa3749ca7f47e2ba1127945e13336c => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:36:27.354991 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939bde62-2670-4558-b6f9-e7111260afc1 None None] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:36:27.355528 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939bde62-2670-4558-b6f9-e7111260afc1 None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:36:27.355528 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939bde62-2670-4558-b6f9-e7111260afc1 None None] PATH_INFO: `/` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:36:27.357010 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 612/1233] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 24 05:36:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:36:27.363834 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5866050-8064-433a-b436-692f1f47e588 None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:36:27.364295 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5866050-8064-433a-b436-692f1f47e588 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:36:27.364616 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5866050-8064-433a-b436-692f1f47e588 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:36:27.385277 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-d5866050-8064-433a-b436-692f1f47e588 None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:36:27.386482 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-d5866050-8064-433a-b436-692f1f47e588 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:36:27.465228 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 622/1234] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 24 05:36:27 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 05:36:27.752873 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939bde62-2670-4558-b6f9-e7111260afc1 None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:36:27.780778 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:36:27.866773 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939bde62-2670-4558-b6f9-e7111260afc1 None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:36:27.905110 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5376165-e488-441a-8df9-c2fba52e6f80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:36:27.905743 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5376165-e488-441a-8df9-c2fba52e6f80 None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:36:27.906062 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5376165-e488-441a-8df9-c2fba52e6f80 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:36:27.906396 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5376165-e488-441a-8df9-c2fba52e6f80 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:36:27.917974 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5376165-e488-441a-8df9-c2fba52e6f80 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:36:27.922591 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application [None req-b5376165-e488-441a-8df9-c2fba52e6f80 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 05:36:27.922591 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:36:27.922591 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:36:27.922591 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:36:27.922591 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:36:27.922591 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:36:27.922591 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:36:27.922591 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:36:27.922591 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:36:27.922591 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:36:27.922591 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:36:27.922591 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:36:27.922591 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:36:27.922591 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:36:27.922591 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:36:27.922591 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:36:27.923773 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:36:27.923773 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:36:27.923773 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:36:27.923773 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:36:27.923773 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:36:27.923773 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:36:27.923773 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:36:27.923773 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:36:27.923773 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:36:27.923773 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:36:27.923773 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:36:27.923773 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application with Lock( Aug 24 05:36:27.923773 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:36:27.923773 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:36:27.923773 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:36:27.923773 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:36:27.924797 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:36:27.924797 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:36:27.924797 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:36:27.924797 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:36:27.924797 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:36:27.924797 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:36:27.924797 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:36:27.924797 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:36:27.924797 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:36:27.924797 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:36:27.924797 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 05:36:27.924797 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Aug 24 05:36:27.924797 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 613/1235] 10.222.0.26 () {56 vars in 1102 bytes} [Wed Aug 24 05:36:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:36:27.930664 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5866050-8064-433a-b436-692f1f47e588 None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:36:27.987370 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:36:28.047359 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5866050-8064-433a-b436-692f1f47e588 None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:36:28.085354 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8946aedb-628d-413c-ae03-561bc439af5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:36:28.086015 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8946aedb-628d-413c-ae03-561bc439af5a None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:36:28.086267 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8946aedb-628d-413c-ae03-561bc439af5a None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:36:28.087115 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8946aedb-628d-413c-ae03-561bc439af5a None admin] PATH_INFO: `/v3/roles` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:36:28.087865 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8946aedb-628d-413c-ae03-561bc439af5a None admin] RBAC: Adding query filter params (name=service) {{(pid=88113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:36:28.088175 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8946aedb-628d-413c-ae03-561bc439af5a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:36:28.089674 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8946aedb-628d-413c-ae03-561bc439af5a None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:36:28.098512 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 623/1236] 10.222.0.26 () {56 vars in 1103 bytes} [Wed Aug 24 05:36:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:36:28.104506 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5376165-e488-441a-8df9-c2fba52e6f80 None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:36:28.199564 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:36:28.217202 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5376165-e488-441a-8df9-c2fba52e6f80 None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:36:28.254275 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2520026a-faf8-464b-a105-7a5183392448 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:36:28.254998 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2520026a-faf8-464b-a105-7a5183392448 None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:36:28.255337 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2520026a-faf8-464b-a105-7a5183392448 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:36:28.255667 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2520026a-faf8-464b-a105-7a5183392448 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:36:28.267104 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2520026a-faf8-464b-a105-7a5183392448 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:36:28.268757 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2520026a-faf8-464b-a105-7a5183392448 None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:36:28.283854 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application [None req-2520026a-faf8-464b-a105-7a5183392448 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:36:28.283854 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:36:28.283854 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:36:28.283854 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:36:28.283854 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:36:28.283854 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:36:28.283854 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:36:28.283854 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:36:28.283854 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:36:28.283854 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:36:28.283854 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:36:28.283854 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:36:28.283854 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 05:36:28.283854 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 05:36:28.283854 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 05:36:28.283854 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 05:36:28.285001 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:36:28.285001 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:36:28.285001 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:36:28.285001 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:36:28.285001 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:36:28.285001 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:36:28.285001 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:36:28.285001 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application with Lock( Aug 24 05:36:28.285001 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:36:28.285001 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:36:28.285001 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:36:28.285001 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:36:28.285001 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:36:28.285001 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:36:28.285001 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:36:28.285001 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:36:28.285001 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 05:36:28.285921 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 05:36:28.285921 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:36:28.285921 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Aug 24 05:36:28.285921 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 614/1237] 10.222.0.26 () {56 vars in 1108 bytes} [Wed Aug 24 05:36:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:36:28.291686 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8946aedb-628d-413c-ae03-561bc439af5a None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:36:28.406266 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8946aedb-628d-413c-ae03-561bc439af5a None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:36:28.416802 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:36:28.443982 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29900717-046e-45bd-a6ae-52fdff3bee91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:36:28.444668 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29900717-046e-45bd-a6ae-52fdff3bee91 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:36:28.444955 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29900717-046e-45bd-a6ae-52fdff3bee91 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:36:28.445230 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29900717-046e-45bd-a6ae-52fdff3bee91 None admin] PATH_INFO: `/v3/domains` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:36:28.446006 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29900717-046e-45bd-a6ae-52fdff3bee91 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:36:28.446356 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29900717-046e-45bd-a6ae-52fdff3bee91 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:36:28.448125 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29900717-046e-45bd-a6ae-52fdff3bee91 None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:36:28.461074 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 624/1238] 10.222.0.26 () {56 vars in 1109 bytes} [Wed Aug 24 05:36:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:36:28.467315 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2520026a-faf8-464b-a105-7a5183392448 None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:36:28.580606 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2520026a-faf8-464b-a105-7a5183392448 None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:36:28.618120 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f381c00-031b-4a63-bc76-480639f1ea89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:36:28.618751 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f381c00-031b-4a63-bc76-480639f1ea89 None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:36:28.619023 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f381c00-031b-4a63-bc76-480639f1ea89 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:36:28.619291 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f381c00-031b-4a63-bc76-480639f1ea89 None admin] PATH_INFO: `/v3/users/placement` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:36:28.622086 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:36:28.628410 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f381c00-031b-4a63-bc76-480639f1ea89 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:36:28.630384 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f381c00-031b-4a63-bc76-480639f1ea89 None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:36:28.643365 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application [None req-9f381c00-031b-4a63-bc76-480639f1ea89 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 24 05:36:28.643365 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:36:28.643365 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:36:28.643365 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:36:28.643365 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:36:28.643365 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:36:28.643365 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:36:28.643365 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:36:28.643365 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:36:28.643365 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:36:28.643365 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:36:28.643365 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:36:28.643365 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 05:36:28.643365 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 05:36:28.643365 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 05:36:28.643365 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 05:36:28.645567 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:36:28.645567 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:36:28.645567 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 05:36:28.645567 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 05:36:28.645567 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 05:36:28.645567 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 05:36:28.645567 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:36:28.645567 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:36:28.645567 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:36:28.645567 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:36:28.645567 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:36:28.645567 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application with Lock( Aug 24 05:36:28.645567 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:36:28.645567 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:36:28.645567 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:36:28.645567 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:36:28.645567 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:36:28.645567 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:36:28.646611 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:36:28.646611 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:36:28.646611 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 05:36:28.646611 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 05:36:28.646611 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 05:36:28.646611 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 05:36:28.646611 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 05:36:28.646611 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 05:36:28.646611 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 24 05:36:28.646611 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Aug 24 05:36:28.646611 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 615/1239] 10.222.0.26 () {56 vars in 1108 bytes} [Wed Aug 24 05:36:28 2022] GET /identity/v3/users/placement => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:36:28.650877 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29900717-046e-45bd-a6ae-52fdff3bee91 None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:36:28.759377 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29900717-046e-45bd-a6ae-52fdff3bee91 None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:36:28.804722 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582887e8-0747-4c19-8193-d81b94332558 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:36:28.805713 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582887e8-0747-4c19-8193-d81b94332558 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:36:28.806235 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582887e8-0747-4c19-8193-d81b94332558 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:36:28.806632 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582887e8-0747-4c19-8193-d81b94332558 None admin] PATH_INFO: `/v3/users` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:36:28.807670 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582887e8-0747-4c19-8193-d81b94332558 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:36:28.808150 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582887e8-0747-4c19-8193-d81b94332558 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:36:28.810755 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582887e8-0747-4c19-8193-d81b94332558 None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:36:28.835927 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 625/1240] 10.222.0.26 () {56 vars in 1143 bytes} [Wed Aug 24 05:36:28 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:36:28.842487 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f381c00-031b-4a63-bc76-480639f1ea89 None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:36:28.958837 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f381c00-031b-4a63-bc76-480639f1ea89 None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:36:28.996212 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb07bb2-bb4e-4c0d-b8ef-bc59d8e72eaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:36:28.996818 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb07bb2-bb4e-4c0d-b8ef-bc59d8e72eaa None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:36:28.997095 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb07bb2-bb4e-4c0d-b8ef-bc59d8e72eaa None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:36:28.997366 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb07bb2-bb4e-4c0d-b8ef-bc59d8e72eaa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:36:29.060924 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:36:29.068351 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb07bb2-bb4e-4c0d-b8ef-bc59d8e72eaa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:36:29.069888 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb07bb2-bb4e-4c0d-b8ef-bc59d8e72eaa None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:36:29.170984 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 616/1241] 10.222.0.26 () {58 vars in 1282 bytes} [Wed Aug 24 05:36:28 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 05:36:29.177034 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582887e8-0747-4c19-8193-d81b94332558 None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:36:29.206050 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:36:29.287636 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582887e8-0747-4c19-8193-d81b94332558 None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:36:29.328119 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626c03c6-0046-40af-abcf-cf7d91e811d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:36:29.328702 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626c03c6-0046-40af-abcf-cf7d91e811d0 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:36:29.328981 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626c03c6-0046-40af-abcf-cf7d91e811d0 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:36:29.329250 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626c03c6-0046-40af-abcf-cf7d91e811d0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:36:29.341541 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626c03c6-0046-40af-abcf-cf7d91e811d0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:36:29.343155 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626c03c6-0046-40af-abcf-cf7d91e811d0 None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:36:29.359808 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application [None req-626c03c6-0046-40af-abcf-cf7d91e811d0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:36:29.359808 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:36:29.359808 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:36:29.359808 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:36:29.359808 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:36:29.359808 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:36:29.359808 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:36:29.359808 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:36:29.359808 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:36:29.359808 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:36:29.359808 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:36:29.359808 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:36:29.359808 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 05:36:29.359808 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 05:36:29.359808 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 05:36:29.359808 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 05:36:29.360984 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:36:29.360984 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:36:29.360984 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:36:29.360984 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:36:29.360984 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:36:29.360984 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:36:29.360984 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:36:29.360984 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application with Lock( Aug 24 05:36:29.360984 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:36:29.360984 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:36:29.360984 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:36:29.360984 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:36:29.360984 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:36:29.360984 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:36:29.360984 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:36:29.360984 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:36:29.360984 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 05:36:29.362098 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 05:36:29.362098 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:36:29.362098 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Aug 24 05:36:29.362098 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 626/1242] 10.222.0.26 () {56 vars in 1108 bytes} [Wed Aug 24 05:36:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:36:29.367079 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb07bb2-bb4e-4c0d-b8ef-bc59d8e72eaa None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:36:29.472772 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:36:29.480366 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb07bb2-bb4e-4c0d-b8ef-bc59d8e72eaa None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:36:29.517090 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd079c7-c3b1-4805-a4a7-72c39c789ede None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:36:29.517699 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd079c7-c3b1-4805-a4a7-72c39c789ede None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:36:29.518002 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd079c7-c3b1-4805-a4a7-72c39c789ede None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:36:29.518309 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd079c7-c3b1-4805-a4a7-72c39c789ede None admin] PATH_INFO: `/v3/domains` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:36:29.518944 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd079c7-c3b1-4805-a4a7-72c39c789ede None admin] RBAC: Adding query filter params (name=Default) {{(pid=88112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:36:29.519241 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd079c7-c3b1-4805-a4a7-72c39c789ede None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:36:29.520582 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd079c7-c3b1-4805-a4a7-72c39c789ede None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:36:29.533871 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 617/1243] 10.222.0.26 () {56 vars in 1109 bytes} [Wed Aug 24 05:36:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:36:29.540302 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626c03c6-0046-40af-abcf-cf7d91e811d0 None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:36:29.627903 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:36:29.651550 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626c03c6-0046-40af-abcf-cf7d91e811d0 None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:36:29.686800 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6325d6d9-e50a-473e-9eed-ed24724566e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:36:29.687729 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6325d6d9-e50a-473e-9eed-ed24724566e9 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:36:29.687971 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6325d6d9-e50a-473e-9eed-ed24724566e9 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:36:29.688256 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6325d6d9-e50a-473e-9eed-ed24724566e9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:36:29.696744 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6325d6d9-e50a-473e-9eed-ed24724566e9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:36:29.698353 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6325d6d9-e50a-473e-9eed-ed24724566e9 None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:36:29.710750 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application [None req-6325d6d9-e50a-473e-9eed-ed24724566e9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 05:36:29.710750 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:36:29.710750 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:36:29.710750 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:36:29.710750 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:36:29.710750 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:36:29.710750 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:36:29.710750 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:36:29.710750 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:36:29.710750 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:36:29.710750 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:36:29.710750 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:36:29.710750 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 05:36:29.710750 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 05:36:29.710750 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 05:36:29.712340 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 05:36:29.712340 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:36:29.712340 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:36:29.712340 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:36:29.712340 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:36:29.712340 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:36:29.712340 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:36:29.712340 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:36:29.712340 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application with Lock( Aug 24 05:36:29.712340 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:36:29.712340 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:36:29.712340 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:36:29.712340 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:36:29.712340 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:36:29.712340 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:36:29.712340 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:36:29.712340 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:36:29.713230 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 05:36:29.713230 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 05:36:29.713230 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 05:36:29.713230 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 05:36:29.713230 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 05:36:29.713230 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 05:36:29.713230 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 05:36:29.713230 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Aug 24 05:36:29.713230 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 627/1244] 10.222.0.26 () {56 vars in 1111 bytes} [Wed Aug 24 05:36:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:36:29.718592 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd079c7-c3b1-4805-a4a7-72c39c789ede None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:36:29.822108 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd079c7-c3b1-4805-a4a7-72c39c789ede None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:36:29.856059 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7120ed-e071-4f50-989a-05fd8861aa0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:36:29.856683 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7120ed-e071-4f50-989a-05fd8861aa0f None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:36:29.856968 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7120ed-e071-4f50-989a-05fd8861aa0f None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:36:29.857207 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7120ed-e071-4f50-989a-05fd8861aa0f None admin] PATH_INFO: `/v3/projects` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:36:29.857885 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7120ed-e071-4f50-989a-05fd8861aa0f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:36:29.858212 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7120ed-e071-4f50-989a-05fd8861aa0f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:36:29.859650 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7120ed-e071-4f50-989a-05fd8861aa0f None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:36:29.871454 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 618/1245] 10.222.0.26 () {56 vars in 1148 bytes} [Wed Aug 24 05:36:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:36:29.877988 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6325d6d9-e50a-473e-9eed-ed24724566e9 None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:36:29.988660 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6325d6d9-e50a-473e-9eed-ed24724566e9 None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:36:30.026082 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7acc250-43fe-4b8c-b6da-549c113c9313 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:36:30.026683 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7acc250-43fe-4b8c-b6da-549c113c9313 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:36:30.026954 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7acc250-43fe-4b8c-b6da-549c113c9313 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:36:30.027219 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7acc250-43fe-4b8c-b6da-549c113c9313 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:36:30.027944 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7acc250-43fe-4b8c-b6da-549c113c9313 None admin] RBAC: Adding query filter params (role.id=59fa3749ca7f47e2ba1127945e13336c, scope.project.id=ded4fe81d4dc43188dd84e53025ee783, user.id=995ebe690b7748c9842bc0696415fc52) {{(pid=88113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:36:30.028248 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7acc250-43fe-4b8c-b6da-549c113c9313 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:36:30.029672 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7acc250-43fe-4b8c-b6da-549c113c9313 None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:36:30.035590 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 628/1246] 10.222.0.26 () {56 vars in 1374 bytes} [Wed Aug 24 05:36:29 2022] GET /identity/v3/role_assignments?user.id=995ebe690b7748c9842bc0696415fc52&scope.project.id=ded4fe81d4dc43188dd84e53025ee783&role.id=59fa3749ca7f47e2ba1127945e13336c => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:36:32.147380 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a463e2e3-4578-4a65-896d-0e336d2d3871 None None] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:36:32.147964 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a463e2e3-4578-4a65-896d-0e336d2d3871 None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:36:32.148119 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a463e2e3-4578-4a65-896d-0e336d2d3871 None None] PATH_INFO: `/` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:36:32.150066 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 619/1247] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 24 05:36:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:36:32.156542 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31450820-ac5a-42a0-a078-cf5d09224f1c None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:36:32.157053 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31450820-ac5a-42a0-a078-cf5d09224f1c None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:36:32.157144 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31450820-ac5a-42a0-a078-cf5d09224f1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:36:32.163831 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:36:32.176440 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-31450820-ac5a-42a0-a078-cf5d09224f1c None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:36:32.177634 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-31450820-ac5a-42a0-a078-cf5d09224f1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:36:32.251356 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 629/1248] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 24 05:36:32 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 05:36:32.520986 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a463e2e3-4578-4a65-896d-0e336d2d3871 None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:36:32.543965 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:36:32.639349 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a463e2e3-4578-4a65-896d-0e336d2d3871 None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:36:32.677388 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc046f8-b396-408b-8fa5-758954b7dabe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:36:32.678109 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc046f8-b396-408b-8fa5-758954b7dabe None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:36:32.679419 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc046f8-b396-408b-8fa5-758954b7dabe None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:36:32.679813 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc046f8-b396-408b-8fa5-758954b7dabe None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:36:32.691533 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc046f8-b396-408b-8fa5-758954b7dabe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:36:32.696229 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application [None req-acc046f8-b396-408b-8fa5-758954b7dabe None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 05:36:32.696229 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:36:32.696229 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:36:32.696229 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:36:32.696229 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:36:32.696229 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:36:32.696229 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:36:32.696229 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:36:32.696229 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:36:32.696229 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:36:32.696229 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:36:32.696229 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:36:32.696229 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:36:32.696229 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:36:32.696229 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:36:32.696229 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:36:32.697365 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:36:32.697365 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:36:32.697365 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:36:32.697365 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:36:32.697365 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:36:32.697365 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:36:32.697365 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:36:32.697365 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:36:32.697365 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:36:32.697365 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:36:32.697365 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:36:32.697365 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application with Lock( Aug 24 05:36:32.697365 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:36:32.697365 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:36:32.697365 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:36:32.697365 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:36:32.698466 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:36:32.698466 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:36:32.698466 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:36:32.698466 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:36:32.698466 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:36:32.698466 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:36:32.698466 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:36:32.698466 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:36:32.698466 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:36:32.698466 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:36:32.698466 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 05:36:32.698466 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Aug 24 05:36:32.698466 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 620/1249] 10.222.0.26 () {56 vars in 1096 bytes} [Wed Aug 24 05:36:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:36:32.703239 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31450820-ac5a-42a0-a078-cf5d09224f1c None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:36:32.831888 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31450820-ac5a-42a0-a078-cf5d09224f1c None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:36:32.864762 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:36:32.870893 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9c065b-de38-4657-98ea-a64b23822b9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:36:32.871491 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9c065b-de38-4657-98ea-a64b23822b9b None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:36:32.871766 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9c065b-de38-4657-98ea-a64b23822b9b None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:36:32.872031 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9c065b-de38-4657-98ea-a64b23822b9b None admin] PATH_INFO: `/v3/roles` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:36:32.872684 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9c065b-de38-4657-98ea-a64b23822b9b None admin] RBAC: Adding query filter params (name=admin) {{(pid=88113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:36:32.872983 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9c065b-de38-4657-98ea-a64b23822b9b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:36:32.874376 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9c065b-de38-4657-98ea-a64b23822b9b None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:36:32.883384 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 630/1250] 10.222.0.26 () {56 vars in 1099 bytes} [Wed Aug 24 05:36:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:36:32.890155 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc046f8-b396-408b-8fa5-758954b7dabe None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:36:32.979365 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:36:33.013922 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc046f8-b396-408b-8fa5-758954b7dabe None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:36:33.049845 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d61d3c6-0145-48c1-aeb8-ab3abaaeb74c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:36:33.050497 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d61d3c6-0145-48c1-aeb8-ab3abaaeb74c None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:36:33.050775 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d61d3c6-0145-48c1-aeb8-ab3abaaeb74c None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:36:33.051043 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d61d3c6-0145-48c1-aeb8-ab3abaaeb74c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:36:33.064283 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d61d3c6-0145-48c1-aeb8-ab3abaaeb74c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:36:33.066064 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d61d3c6-0145-48c1-aeb8-ab3abaaeb74c None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:36:33.082398 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application [None req-9d61d3c6-0145-48c1-aeb8-ab3abaaeb74c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:36:33.082398 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:36:33.082398 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:36:33.082398 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:36:33.082398 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:36:33.082398 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:36:33.082398 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:36:33.082398 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:36:33.082398 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:36:33.082398 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:36:33.082398 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:36:33.082398 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:36:33.082398 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 05:36:33.082398 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 05:36:33.082398 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 05:36:33.082398 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 05:36:33.083784 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:36:33.083784 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:36:33.083784 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:36:33.083784 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:36:33.083784 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:36:33.083784 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:36:33.083784 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:36:33.083784 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application with Lock( Aug 24 05:36:33.083784 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:36:33.083784 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:36:33.083784 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:36:33.083784 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:36:33.083784 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:36:33.083784 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:36:33.083784 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:36:33.083784 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:36:33.083784 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 05:36:33.084792 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 05:36:33.084792 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:36:33.084792 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Aug 24 05:36:33.084792 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 621/1251] 10.222.0.26 () {56 vars in 1108 bytes} [Wed Aug 24 05:36:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:36:33.090968 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9c065b-de38-4657-98ea-a64b23822b9b None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:36:33.206304 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9c065b-de38-4657-98ea-a64b23822b9b None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:36:33.248540 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e87381-0a3a-4194-a490-e656b5aaf5e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:36:33.249141 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e87381-0a3a-4194-a490-e656b5aaf5e0 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:36:33.249417 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e87381-0a3a-4194-a490-e656b5aaf5e0 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:36:33.249684 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e87381-0a3a-4194-a490-e656b5aaf5e0 None admin] PATH_INFO: `/v3/domains` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:36:33.250353 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e87381-0a3a-4194-a490-e656b5aaf5e0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:36:33.250655 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e87381-0a3a-4194-a490-e656b5aaf5e0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:36:33.251993 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e87381-0a3a-4194-a490-e656b5aaf5e0 None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:36:33.264478 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 631/1252] 10.222.0.26 () {56 vars in 1109 bytes} [Wed Aug 24 05:36:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:36:33.270053 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d61d3c6-0145-48c1-aeb8-ab3abaaeb74c None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:36:33.373000 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d61d3c6-0145-48c1-aeb8-ab3abaaeb74c None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:36:33.401214 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:36:33.410777 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd807d09-a58e-45e8-ae9e-eb41345a9a39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:36:33.411414 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd807d09-a58e-45e8-ae9e-eb41345a9a39 None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:36:33.411738 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd807d09-a58e-45e8-ae9e-eb41345a9a39 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:36:33.412212 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd807d09-a58e-45e8-ae9e-eb41345a9a39 None admin] PATH_INFO: `/v3/users/placement` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:36:33.422704 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd807d09-a58e-45e8-ae9e-eb41345a9a39 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:36:33.424584 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd807d09-a58e-45e8-ae9e-eb41345a9a39 None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:36:33.438354 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application [None req-fd807d09-a58e-45e8-ae9e-eb41345a9a39 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 24 05:36:33.438354 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:36:33.438354 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:36:33.438354 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:36:33.438354 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:36:33.438354 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:36:33.438354 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:36:33.438354 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:36:33.438354 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:36:33.438354 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:36:33.438354 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:36:33.438354 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:36:33.438354 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 05:36:33.438354 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 05:36:33.438354 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 05:36:33.438354 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 05:36:33.439880 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:36:33.439880 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:36:33.439880 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 05:36:33.439880 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 05:36:33.439880 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 05:36:33.439880 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 05:36:33.439880 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:36:33.439880 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:36:33.439880 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:36:33.439880 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:36:33.439880 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:36:33.439880 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application with Lock( Aug 24 05:36:33.439880 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:36:33.439880 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:36:33.439880 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:36:33.439880 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:36:33.439880 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:36:33.439880 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:36:33.440847 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:36:33.440847 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:36:33.440847 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 05:36:33.440847 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 05:36:33.440847 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 05:36:33.440847 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 05:36:33.440847 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 05:36:33.440847 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 05:36:33.440847 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 24 05:36:33.440847 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Aug 24 05:36:33.440847 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 622/1253] 10.222.0.26 () {56 vars in 1108 bytes} [Wed Aug 24 05:36:33 2022] GET /identity/v3/users/placement => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 05:36:33.445401 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e87381-0a3a-4194-a490-e656b5aaf5e0 None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:36:33.514117 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:36:33.567310 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e87381-0a3a-4194-a490-e656b5aaf5e0 None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:36:33.605572 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696632eb-e1a5-44f0-8b91-0146383d4e77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:36:33.606330 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696632eb-e1a5-44f0-8b91-0146383d4e77 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:36:33.606638 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696632eb-e1a5-44f0-8b91-0146383d4e77 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:36:33.606970 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696632eb-e1a5-44f0-8b91-0146383d4e77 None admin] PATH_INFO: `/v3/users` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:36:33.607799 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696632eb-e1a5-44f0-8b91-0146383d4e77 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:36:33.608127 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696632eb-e1a5-44f0-8b91-0146383d4e77 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:36:33.609697 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696632eb-e1a5-44f0-8b91-0146383d4e77 None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:36:33.630828 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 632/1254] 10.222.0.26 () {56 vars in 1143 bytes} [Wed Aug 24 05:36:33 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:36:33.636639 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd807d09-a58e-45e8-ae9e-eb41345a9a39 None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:36:33.752070 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd807d09-a58e-45e8-ae9e-eb41345a9a39 None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:36:33.790196 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1965fbc7-8e97-4a29-ad11-e8cfb11abf60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:36:33.790790 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1965fbc7-8e97-4a29-ad11-e8cfb11abf60 None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:36:33.791065 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1965fbc7-8e97-4a29-ad11-e8cfb11abf60 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:36:33.793096 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1965fbc7-8e97-4a29-ad11-e8cfb11abf60 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:36:33.854072 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:36:33.869611 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1965fbc7-8e97-4a29-ad11-e8cfb11abf60 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:36:33.871122 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1965fbc7-8e97-4a29-ad11-e8cfb11abf60 None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:36:34.001678 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 623/1255] 10.222.0.26 () {58 vars in 1282 bytes} [Wed Aug 24 05:36:33 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 05:36:34.003012 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696632eb-e1a5-44f0-8b91-0146383d4e77 None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:36:34.119838 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696632eb-e1a5-44f0-8b91-0146383d4e77 None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:36:34.133913 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:36:34.157331 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539d5da4-fbe7-415d-997d-c190953bacab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:36:34.157984 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539d5da4-fbe7-415d-997d-c190953bacab None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:36:34.158265 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539d5da4-fbe7-415d-997d-c190953bacab None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:36:34.158530 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539d5da4-fbe7-415d-997d-c190953bacab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:36:34.168777 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539d5da4-fbe7-415d-997d-c190953bacab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:36:34.170525 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539d5da4-fbe7-415d-997d-c190953bacab None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:36:34.185821 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application [None req-539d5da4-fbe7-415d-997d-c190953bacab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:36:34.185821 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:36:34.185821 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:36:34.185821 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:36:34.185821 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:36:34.185821 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:36:34.185821 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:36:34.185821 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:36:34.185821 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:36:34.185821 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:36:34.185821 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:36:34.185821 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:36:34.185821 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 05:36:34.185821 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 05:36:34.185821 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 05:36:34.185821 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 05:36:34.187038 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:36:34.187038 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:36:34.187038 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:36:34.187038 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:36:34.187038 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:36:34.187038 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:36:34.187038 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:36:34.187038 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application with Lock( Aug 24 05:36:34.187038 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:36:34.187038 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:36:34.187038 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:36:34.187038 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:36:34.187038 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:36:34.187038 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:36:34.187038 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:36:34.187038 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:36:34.187038 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 05:36:34.188436 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 05:36:34.188436 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:36:34.188436 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Aug 24 05:36:34.188436 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 633/1256] 10.222.0.26 () {56 vars in 1108 bytes} [Wed Aug 24 05:36:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:36:34.193372 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1965fbc7-8e97-4a29-ad11-e8cfb11abf60 None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:36:34.288351 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:36:34.301968 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1965fbc7-8e97-4a29-ad11-e8cfb11abf60 None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:36:34.338863 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0a8352-95c0-488f-aabc-f76c4b933098 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:36:34.339474 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0a8352-95c0-488f-aabc-f76c4b933098 None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:36:34.339757 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0a8352-95c0-488f-aabc-f76c4b933098 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:36:34.340018 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0a8352-95c0-488f-aabc-f76c4b933098 None admin] PATH_INFO: `/v3/domains` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:36:34.340699 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0a8352-95c0-488f-aabc-f76c4b933098 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:36:34.340990 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0a8352-95c0-488f-aabc-f76c4b933098 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:36:34.342551 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0a8352-95c0-488f-aabc-f76c4b933098 None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:36:34.356580 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 624/1257] 10.222.0.26 () {56 vars in 1109 bytes} [Wed Aug 24 05:36:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:36:34.362842 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539d5da4-fbe7-415d-997d-c190953bacab None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:36:34.470639 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539d5da4-fbe7-415d-997d-c190953bacab None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:36:34.507465 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c06921a-c0ce-4b7e-93a6-3ace7c51490b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:36:34.508131 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c06921a-c0ce-4b7e-93a6-3ace7c51490b None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:36:34.508407 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c06921a-c0ce-4b7e-93a6-3ace7c51490b None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:36:34.508705 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c06921a-c0ce-4b7e-93a6-3ace7c51490b None admin] PATH_INFO: `/v3/projects/service` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:36:34.515947 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c06921a-c0ce-4b7e-93a6-3ace7c51490b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:36:34.517404 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c06921a-c0ce-4b7e-93a6-3ace7c51490b None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:36:34.529795 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application [None req-7c06921a-c0ce-4b7e-93a6-3ace7c51490b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 05:36:34.529795 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:36:34.529795 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:36:34.529795 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:36:34.529795 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:36:34.529795 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:36:34.529795 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:36:34.529795 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:36:34.529795 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:36:34.529795 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:36:34.529795 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:36:34.529795 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:36:34.529795 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 05:36:34.529795 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 05:36:34.529795 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 05:36:34.530802 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 05:36:34.530802 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:36:34.530802 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:36:34.530802 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:36:34.530802 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:36:34.530802 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:36:34.530802 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:36:34.530802 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:36:34.530802 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application with Lock( Aug 24 05:36:34.530802 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:36:34.530802 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:36:34.530802 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:36:34.530802 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:36:34.530802 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:36:34.530802 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:36:34.530802 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:36:34.530802 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:36:34.531739 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 05:36:34.531739 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 05:36:34.531739 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 05:36:34.531739 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 05:36:34.531739 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 05:36:34.531739 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 05:36:34.531739 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 05:36:34.531739 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Aug 24 05:36:34.531739 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 634/1258] 10.222.0.26 () {56 vars in 1111 bytes} [Wed Aug 24 05:36:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:36:34.537056 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0a8352-95c0-488f-aabc-f76c4b933098 None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:36:34.639964 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0a8352-95c0-488f-aabc-f76c4b933098 None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:36:34.674848 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5545cdf-383f-4a43-928c-35592e935641 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:36:34.675466 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5545cdf-383f-4a43-928c-35592e935641 None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:36:34.675742 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5545cdf-383f-4a43-928c-35592e935641 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:36:34.676011 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5545cdf-383f-4a43-928c-35592e935641 None admin] PATH_INFO: `/v3/projects` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:36:34.676709 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5545cdf-383f-4a43-928c-35592e935641 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:36:34.677010 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5545cdf-383f-4a43-928c-35592e935641 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:36:34.678493 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5545cdf-383f-4a43-928c-35592e935641 None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:36:34.692560 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 625/1259] 10.222.0.26 () {56 vars in 1148 bytes} [Wed Aug 24 05:36:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:36:34.699440 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c06921a-c0ce-4b7e-93a6-3ace7c51490b None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:36:34.727934 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:36:34.803570 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c06921a-c0ce-4b7e-93a6-3ace7c51490b None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:36:34.837781 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a037d286-2cb7-4e84-a99f-3519972c0761 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:36:34.838414 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a037d286-2cb7-4e84-a99f-3519972c0761 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:36:34.838693 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a037d286-2cb7-4e84-a99f-3519972c0761 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:36:34.838961 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a037d286-2cb7-4e84-a99f-3519972c0761 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:36:34.839684 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a037d286-2cb7-4e84-a99f-3519972c0761 None admin] RBAC: Adding query filter params (role.id=640bda0879494e60b72680ee505285f0, scope.project.id=ded4fe81d4dc43188dd84e53025ee783, user.id=995ebe690b7748c9842bc0696415fc52) {{(pid=88113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:36:34.839989 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a037d286-2cb7-4e84-a99f-3519972c0761 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:36:34.841410 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a037d286-2cb7-4e84-a99f-3519972c0761 None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:36:34.846824 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 635/1260] 10.222.0.26 () {56 vars in 1374 bytes} [Wed Aug 24 05:36:34 2022] GET /identity/v3/role_assignments?user.id=995ebe690b7748c9842bc0696415fc52&scope.project.id=ded4fe81d4dc43188dd84e53025ee783&role.id=640bda0879494e60b72680ee505285f0 => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:36:36.727641 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f598e0-ccdd-4fba-a971-73b116e9cc7b None None] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:36:36.728156 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f598e0-ccdd-4fba-a971-73b116e9cc7b None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:36:36.728156 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f598e0-ccdd-4fba-a971-73b116e9cc7b None None] PATH_INFO: `/` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:36:36.729512 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 626/1261] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 24 05:36:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:36:36.734679 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e96c67-0f10-43ef-a911-1a921ff8edc2 None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:36:36.735107 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e96c67-0f10-43ef-a911-1a921ff8edc2 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:36:36.735235 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e96c67-0f10-43ef-a911-1a921ff8edc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:36:36.752991 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-e8e96c67-0f10-43ef-a911-1a921ff8edc2 None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:36:36.754213 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-e8e96c67-0f10-43ef-a911-1a921ff8edc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:36:36.819966 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 636/1262] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 24 05:36:36 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 05:36:37.088236 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f598e0-ccdd-4fba-a971-73b116e9cc7b None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:36:37.098970 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:36:37.186133 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f598e0-ccdd-4fba-a971-73b116e9cc7b None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:36:37.219801 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d51e6c-cd34-4bdc-b1a2-ad0a37a4d0e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:36:37.220415 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d51e6c-cd34-4bdc-b1a2-ad0a37a4d0e7 None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:36:37.220692 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d51e6c-cd34-4bdc-b1a2-ad0a37a4d0e7 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:36:37.220960 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d51e6c-cd34-4bdc-b1a2-ad0a37a4d0e7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:36:37.230799 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d51e6c-cd34-4bdc-b1a2-ad0a37a4d0e7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:36:37.235386 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application [None req-c1d51e6c-cd34-4bdc-b1a2-ad0a37a4d0e7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 05:36:37.235386 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:36:37.235386 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:36:37.235386 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:36:37.235386 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:36:37.235386 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:36:37.235386 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:36:37.235386 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:36:37.235386 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:36:37.235386 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:36:37.235386 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:36:37.235386 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:36:37.235386 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:36:37.235386 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:36:37.235386 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:36:37.235386 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:36:37.236543 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:36:37.236543 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:36:37.236543 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:36:37.236543 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:36:37.236543 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:36:37.236543 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:36:37.236543 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:36:37.236543 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:36:37.236543 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:36:37.236543 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:36:37.236543 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:36:37.236543 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application with Lock( Aug 24 05:36:37.236543 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:36:37.236543 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:36:37.236543 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:36:37.236543 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:36:37.237647 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:36:37.237647 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:36:37.237647 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:36:37.237647 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:36:37.237647 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:36:37.237647 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:36:37.237647 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:36:37.237647 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:36:37.237647 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:36:37.237647 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:36:37.237647 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 05:36:37.237647 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Aug 24 05:36:37.237647 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 627/1263] 10.222.0.26 () {56 vars in 1096 bytes} [Wed Aug 24 05:36:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:36:37.242441 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e96c67-0f10-43ef-a911-1a921ff8edc2 None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:36:37.261327 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:36:37.339551 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e96c67-0f10-43ef-a911-1a921ff8edc2 None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:36:37.371642 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8fca67-3dfe-48d6-87c0-3e6b443f6b6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:36:37.372239 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8fca67-3dfe-48d6-87c0-3e6b443f6b6e None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:36:37.372520 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8fca67-3dfe-48d6-87c0-3e6b443f6b6e None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:36:37.372791 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8fca67-3dfe-48d6-87c0-3e6b443f6b6e None admin] PATH_INFO: `/v3/roles` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:36:37.373452 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8fca67-3dfe-48d6-87c0-3e6b443f6b6e None admin] RBAC: Adding query filter params (name=admin) {{(pid=88113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:36:37.373755 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8fca67-3dfe-48d6-87c0-3e6b443f6b6e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:36:37.375148 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8fca67-3dfe-48d6-87c0-3e6b443f6b6e None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:36:37.383399 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 637/1264] 10.222.0.26 () {56 vars in 1099 bytes} [Wed Aug 24 05:36:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:36:37.388931 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d51e6c-cd34-4bdc-b1a2-ad0a37a4d0e7 None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:36:37.453642 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:36:37.486770 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d51e6c-cd34-4bdc-b1a2-ad0a37a4d0e7 None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:36:37.519986 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb7fe18-88fc-49d4-9d3a-71897f237c98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:36:37.520605 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb7fe18-88fc-49d4-9d3a-71897f237c98 None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:36:37.520883 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb7fe18-88fc-49d4-9d3a-71897f237c98 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:36:37.521151 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb7fe18-88fc-49d4-9d3a-71897f237c98 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:36:37.532345 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb7fe18-88fc-49d4-9d3a-71897f237c98 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:36:37.533773 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb7fe18-88fc-49d4-9d3a-71897f237c98 None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:36:37.547998 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application [None req-3cb7fe18-88fc-49d4-9d3a-71897f237c98 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:36:37.547998 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:36:37.547998 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:36:37.547998 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:36:37.547998 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:36:37.547998 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:36:37.547998 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:36:37.547998 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:36:37.547998 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:36:37.547998 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:36:37.547998 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:36:37.547998 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:36:37.547998 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 05:36:37.547998 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 05:36:37.547998 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 05:36:37.547998 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 05:36:37.548969 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:36:37.548969 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:36:37.548969 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:36:37.548969 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:36:37.548969 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:36:37.548969 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:36:37.548969 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:36:37.548969 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application with Lock( Aug 24 05:36:37.548969 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:36:37.548969 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:36:37.548969 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:36:37.548969 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:36:37.548969 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:36:37.548969 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:36:37.548969 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:36:37.548969 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:36:37.548969 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 05:36:37.549870 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 05:36:37.549870 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:36:37.549870 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Aug 24 05:36:37.549870 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 628/1265] 10.222.0.26 () {56 vars in 1108 bytes} [Wed Aug 24 05:36:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:36:37.554806 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8fca67-3dfe-48d6-87c0-3e6b443f6b6e None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:36:37.633080 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:36:37.652232 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8fca67-3dfe-48d6-87c0-3e6b443f6b6e None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:36:37.684498 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abf913b-e23e-496a-b437-0e7e5dd1835e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:36:37.685081 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abf913b-e23e-496a-b437-0e7e5dd1835e None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:36:37.685361 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abf913b-e23e-496a-b437-0e7e5dd1835e None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:36:37.685632 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abf913b-e23e-496a-b437-0e7e5dd1835e None admin] PATH_INFO: `/v3/domains` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:36:37.686301 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abf913b-e23e-496a-b437-0e7e5dd1835e None admin] RBAC: Adding query filter params (name=Default) {{(pid=88113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:36:37.686604 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abf913b-e23e-496a-b437-0e7e5dd1835e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:36:37.688216 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abf913b-e23e-496a-b437-0e7e5dd1835e None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:36:37.699502 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 638/1266] 10.222.0.26 () {56 vars in 1109 bytes} [Wed Aug 24 05:36:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:36:37.705087 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb7fe18-88fc-49d4-9d3a-71897f237c98 None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:36:37.802414 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb7fe18-88fc-49d4-9d3a-71897f237c98 None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:36:37.821741 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:36:37.835531 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6647de-c0db-46dc-8853-d962169ad73c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:36:37.836153 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6647de-c0db-46dc-8853-d962169ad73c None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:36:37.836438 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6647de-c0db-46dc-8853-d962169ad73c None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:36:37.836700 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6647de-c0db-46dc-8853-d962169ad73c None admin] PATH_INFO: `/v3/users/placement` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:36:37.843805 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6647de-c0db-46dc-8853-d962169ad73c None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:36:37.845227 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6647de-c0db-46dc-8853-d962169ad73c None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:36:37.856346 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application [None req-2c6647de-c0db-46dc-8853-d962169ad73c None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 24 05:36:37.856346 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:36:37.856346 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:36:37.856346 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:36:37.856346 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:36:37.856346 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:36:37.856346 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:36:37.856346 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:36:37.856346 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:36:37.856346 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:36:37.856346 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:36:37.856346 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:36:37.856346 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 05:36:37.856346 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 05:36:37.856346 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 05:36:37.856346 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 05:36:37.857435 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:36:37.857435 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:36:37.857435 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 05:36:37.857435 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 05:36:37.857435 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 05:36:37.857435 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 05:36:37.857435 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:36:37.857435 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:36:37.857435 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:36:37.857435 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:36:37.857435 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:36:37.857435 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application with Lock( Aug 24 05:36:37.857435 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:36:37.857435 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:36:37.857435 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:36:37.857435 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:36:37.857435 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:36:37.857435 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:36:37.858416 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:36:37.858416 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:36:37.858416 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 05:36:37.858416 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 05:36:37.858416 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 05:36:37.858416 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 05:36:37.858416 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 05:36:37.858416 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 05:36:37.858416 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 24 05:36:37.858416 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Aug 24 05:36:37.858416 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 629/1267] 10.222.0.26 () {56 vars in 1108 bytes} [Wed Aug 24 05:36:37 2022] GET /identity/v3/users/placement => generated 87 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:36:37.863100 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abf913b-e23e-496a-b437-0e7e5dd1835e None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:36:37.966124 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abf913b-e23e-496a-b437-0e7e5dd1835e None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:36:38.003955 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bccb055-6d47-4bdb-812a-420c57a53bff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:36:38.004545 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bccb055-6d47-4bdb-812a-420c57a53bff None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:36:38.004818 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bccb055-6d47-4bdb-812a-420c57a53bff None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:36:38.005083 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bccb055-6d47-4bdb-812a-420c57a53bff None admin] PATH_INFO: `/v3/users` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:36:38.005802 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bccb055-6d47-4bdb-812a-420c57a53bff None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:36:38.006130 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bccb055-6d47-4bdb-812a-420c57a53bff None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:36:38.007600 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bccb055-6d47-4bdb-812a-420c57a53bff None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:36:38.016159 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:36:38.024580 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 639/1268] 10.222.0.26 () {56 vars in 1143 bytes} [Wed Aug 24 05:36:37 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:36:38.030219 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6647de-c0db-46dc-8853-d962169ad73c None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:36:38.127292 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6647de-c0db-46dc-8853-d962169ad73c None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:36:38.159635 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cf618f-add5-4e8e-bd02-462206600d01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:36:38.160238 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cf618f-add5-4e8e-bd02-462206600d01 None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:36:38.160513 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cf618f-add5-4e8e-bd02-462206600d01 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:36:38.160785 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cf618f-add5-4e8e-bd02-462206600d01 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:36:38.170756 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cf618f-add5-4e8e-bd02-462206600d01 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:36:38.172170 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cf618f-add5-4e8e-bd02-462206600d01 None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:36:38.185983 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application [None req-83cf618f-add5-4e8e-bd02-462206600d01 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:36:38.185983 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:36:38.185983 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:36:38.185983 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:36:38.185983 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:36:38.185983 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:36:38.185983 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:36:38.185983 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:36:38.185983 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:36:38.185983 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:36:38.185983 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:36:38.185983 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:36:38.185983 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 05:36:38.185983 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 05:36:38.185983 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 05:36:38.185983 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 05:36:38.187050 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:36:38.187050 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:36:38.187050 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:36:38.187050 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:36:38.187050 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:36:38.187050 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:36:38.187050 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:36:38.187050 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application with Lock( Aug 24 05:36:38.187050 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:36:38.187050 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:36:38.187050 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:36:38.187050 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:36:38.187050 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:36:38.187050 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:36:38.187050 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:36:38.187050 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:36:38.187050 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 05:36:38.188384 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 05:36:38.188384 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:36:38.188384 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Aug 24 05:36:38.188384 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 630/1269] 10.222.0.26 () {56 vars in 1108 bytes} [Wed Aug 24 05:36:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:36:38.193034 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bccb055-6d47-4bdb-812a-420c57a53bff None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:36:38.289167 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bccb055-6d47-4bdb-812a-420c57a53bff None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:36:38.322469 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfdcf43-5487-4fbc-9770-10ac0f4d29c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:36:38.323064 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfdcf43-5487-4fbc-9770-10ac0f4d29c3 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:36:38.323345 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfdcf43-5487-4fbc-9770-10ac0f4d29c3 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:36:38.323619 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfdcf43-5487-4fbc-9770-10ac0f4d29c3 None admin] PATH_INFO: `/v3/domains` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:36:38.324256 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfdcf43-5487-4fbc-9770-10ac0f4d29c3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:36:38.324561 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfdcf43-5487-4fbc-9770-10ac0f4d29c3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:36:38.325918 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfdcf43-5487-4fbc-9770-10ac0f4d29c3 None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:36:38.336727 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 640/1270] 10.222.0.26 () {56 vars in 1109 bytes} [Wed Aug 24 05:36:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:36:38.342226 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cf618f-add5-4e8e-bd02-462206600d01 None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:36:38.373189 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:36:38.439011 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cf618f-add5-4e8e-bd02-462206600d01 None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:36:38.470935 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb65de05-3f79-4a43-a505-bb8e02b2aed7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:36:38.471543 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb65de05-3f79-4a43-a505-bb8e02b2aed7 None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:36:38.471819 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb65de05-3f79-4a43-a505-bb8e02b2aed7 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:36:38.472087 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb65de05-3f79-4a43-a505-bb8e02b2aed7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:36:38.478449 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb65de05-3f79-4a43-a505-bb8e02b2aed7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:36:38.479865 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb65de05-3f79-4a43-a505-bb8e02b2aed7 None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:36:38.491070 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application [None req-cb65de05-3f79-4a43-a505-bb8e02b2aed7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 05:36:38.491070 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:36:38.491070 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:36:38.491070 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:36:38.491070 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:36:38.491070 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:36:38.491070 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:36:38.491070 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:36:38.491070 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:36:38.491070 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:36:38.491070 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:36:38.491070 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:36:38.491070 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 05:36:38.491070 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 05:36:38.491070 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 05:36:38.492483 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 05:36:38.492483 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:36:38.492483 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:36:38.492483 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:36:38.492483 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:36:38.492483 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:36:38.492483 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:36:38.492483 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:36:38.492483 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application with Lock( Aug 24 05:36:38.492483 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:36:38.492483 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:36:38.492483 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:36:38.492483 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:36:38.492483 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:36:38.492483 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:36:38.492483 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:36:38.492483 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:36:38.493739 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 05:36:38.493739 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 05:36:38.493739 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 05:36:38.493739 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 05:36:38.493739 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 05:36:38.493739 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 05:36:38.493739 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 05:36:38.493739 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Aug 24 05:36:38.493739 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 631/1271] 10.222.0.26 () {56 vars in 1111 bytes} [Wed Aug 24 05:36:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:36:38.498460 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfdcf43-5487-4fbc-9770-10ac0f4d29c3 None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:36:38.555921 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:36:38.597046 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfdcf43-5487-4fbc-9770-10ac0f4d29c3 None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:36:38.629585 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48022ca7-7b4c-431c-b364-aee958d9cd4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:36:38.630207 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48022ca7-7b4c-431c-b364-aee958d9cd4b None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:36:38.630487 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48022ca7-7b4c-431c-b364-aee958d9cd4b None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:36:38.630786 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48022ca7-7b4c-431c-b364-aee958d9cd4b None admin] PATH_INFO: `/v3/projects` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:36:38.631470 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48022ca7-7b4c-431c-b364-aee958d9cd4b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:36:38.631768 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48022ca7-7b4c-431c-b364-aee958d9cd4b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:36:38.633205 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48022ca7-7b4c-431c-b364-aee958d9cd4b None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:36:38.644695 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 641/1272] 10.222.0.26 () {56 vars in 1148 bytes} [Wed Aug 24 05:36:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:36:38.650722 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb65de05-3f79-4a43-a505-bb8e02b2aed7 None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:36:38.738222 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:36:38.747632 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb65de05-3f79-4a43-a505-bb8e02b2aed7 None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:36:38.778839 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174814ee-0185-46fe-bb7d-28593a4e8b57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:36:38.779475 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174814ee-0185-46fe-bb7d-28593a4e8b57 None admin] REQUEST_METHOD: `PUT` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:36:38.779751 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174814ee-0185-46fe-bb7d-28593a4e8b57 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:36:38.780020 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174814ee-0185-46fe-bb7d-28593a4e8b57 None admin] PATH_INFO: `/v3/projects/ded4fe81d4dc43188dd84e53025ee783/users/995ebe690b7748c9842bc0696415fc52/roles/640bda0879494e60b72680ee505285f0` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:36:38.781856 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174814ee-0185-46fe-bb7d-28593a4e8b57 None admin] RBAC: Authorizing `identity:create_grant(project_id=ded4fe81d4dc43188dd84e53025ee783, user_id=995ebe690b7748c9842bc0696415fc52, role_id=640bda0879494e60b72680ee505285f0)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:36:38.783296 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174814ee-0185-46fe-bb7d-28593a4e8b57 None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:36:38.795756 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 632/1273] 10.222.0.26 () {58 vars in 1439 bytes} [Wed Aug 24 05:36:38 2022] PUT /identity/v3/projects/ded4fe81d4dc43188dd84e53025ee783/users/995ebe690b7748c9842bc0696415fc52/roles/640bda0879494e60b72680ee505285f0 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:36:40.637462 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd742fbf-4d07-4f68-8c27-e317c41817dd None None] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:36:40.637999 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd742fbf-4d07-4f68-8c27-e317c41817dd None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:36:40.638092 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd742fbf-4d07-4f68-8c27-e317c41817dd None None] PATH_INFO: `/` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:36:40.639364 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 642/1274] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 24 05:36:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:36:40.644445 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4646e37-6c0b-42e5-b4db-79d0c07c6183 None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:36:40.644831 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4646e37-6c0b-42e5-b4db-79d0c07c6183 None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:36:40.644995 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4646e37-6c0b-42e5-b4db-79d0c07c6183 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:36:40.662940 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-a4646e37-6c0b-42e5-b4db-79d0c07c6183 None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:36:40.664802 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-a4646e37-6c0b-42e5-b4db-79d0c07c6183 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:36:40.729329 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 633/1275] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 24 05:36:40 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 05:36:40.993231 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd742fbf-4d07-4f68-8c27-e317c41817dd None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:36:41.090618 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd742fbf-4d07-4f68-8c27-e317c41817dd None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:36:41.107452 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:36:41.124231 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3ec8d7-1a60-46ae-afa9-3bc6fe7825cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:36:41.124845 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3ec8d7-1a60-46ae-afa9-3bc6fe7825cf None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:36:41.125122 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3ec8d7-1a60-46ae-afa9-3bc6fe7825cf None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:36:41.125392 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3ec8d7-1a60-46ae-afa9-3bc6fe7825cf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:36:41.135190 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3ec8d7-1a60-46ae-afa9-3bc6fe7825cf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 05:36:41.139992 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application [None req-6e3ec8d7-1a60-46ae-afa9-3bc6fe7825cf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 05:36:41.139992 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:36:41.139992 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:36:41.139992 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:36:41.139992 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:36:41.139992 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:36:41.139992 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:36:41.139992 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:36:41.139992 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:36:41.139992 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:36:41.139992 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:36:41.139992 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:36:41.139992 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 05:36:41.139992 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 05:36:41.139992 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 05:36:41.139992 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 05:36:41.141119 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 05:36:41.141119 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 05:36:41.141119 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 05:36:41.141119 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 05:36:41.141119 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:36:41.141119 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:36:41.141119 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:36:41.141119 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:36:41.141119 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:36:41.141119 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:36:41.141119 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:36:41.141119 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application with Lock( Aug 24 05:36:41.141119 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:36:41.141119 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:36:41.141119 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:36:41.141119 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:36:41.142001 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:36:41.142001 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:36:41.142001 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:36:41.142001 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:36:41.142001 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 05:36:41.142001 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 05:36:41.142001 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 05:36:41.142001 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 05:36:41.142001 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 05:36:41.142001 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 05:36:41.142001 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 05:36:41.142001 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Aug 24 05:36:41.142001 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 643/1276] 10.222.0.26 () {56 vars in 1096 bytes} [Wed Aug 24 05:36:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:36:41.147173 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4646e37-6c0b-42e5-b4db-79d0c07c6183 None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:36:41.224827 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:36:41.244135 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4646e37-6c0b-42e5-b4db-79d0c07c6183 None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:36:41.277215 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d473d711-0862-4f2e-8d17-8c065289d622 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:36:41.277814 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d473d711-0862-4f2e-8d17-8c065289d622 None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:36:41.278125 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d473d711-0862-4f2e-8d17-8c065289d622 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:36:41.278401 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d473d711-0862-4f2e-8d17-8c065289d622 None admin] PATH_INFO: `/v3/roles` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:36:41.279063 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d473d711-0862-4f2e-8d17-8c065289d622 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:36:41.279365 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d473d711-0862-4f2e-8d17-8c065289d622 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:36:41.281064 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d473d711-0862-4f2e-8d17-8c065289d622 None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:36:41.288794 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 634/1277] 10.222.0.26 () {56 vars in 1099 bytes} [Wed Aug 24 05:36:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:36:41.294461 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3ec8d7-1a60-46ae-afa9-3bc6fe7825cf None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:36:41.390447 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3ec8d7-1a60-46ae-afa9-3bc6fe7825cf None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:36:41.421964 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1594834-0df1-4dcb-ab51-c24fb18d112c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:36:41.422579 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1594834-0df1-4dcb-ab51-c24fb18d112c None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:36:41.422855 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1594834-0df1-4dcb-ab51-c24fb18d112c None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:36:41.423122 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1594834-0df1-4dcb-ab51-c24fb18d112c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:36:41.433169 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1594834-0df1-4dcb-ab51-c24fb18d112c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:36:41.434643 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1594834-0df1-4dcb-ab51-c24fb18d112c None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:36:41.449191 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application [None req-a1594834-0df1-4dcb-ab51-c24fb18d112c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:36:41.449191 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:36:41.449191 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:36:41.449191 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:36:41.449191 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:36:41.449191 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:36:41.449191 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:36:41.449191 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:36:41.449191 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:36:41.449191 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:36:41.449191 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:36:41.449191 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:36:41.449191 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 05:36:41.449191 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 05:36:41.449191 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 05:36:41.449191 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 05:36:41.450324 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:36:41.450324 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:36:41.450324 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:36:41.450324 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:36:41.450324 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:36:41.450324 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:36:41.450324 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:36:41.450324 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application with Lock( Aug 24 05:36:41.450324 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:36:41.450324 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:36:41.450324 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:36:41.450324 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:36:41.450324 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:36:41.450324 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:36:41.450324 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:36:41.450324 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:36:41.450324 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 05:36:41.451442 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 05:36:41.451442 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:36:41.451442 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Aug 24 05:36:41.451442 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 644/1278] 10.222.0.26 () {56 vars in 1108 bytes} [Wed Aug 24 05:36:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:36:41.455907 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d473d711-0862-4f2e-8d17-8c065289d622 None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:36:41.553826 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d473d711-0862-4f2e-8d17-8c065289d622 None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:36:41.586499 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51abfd58-0232-4378-abf2-3e080f71df1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:36:41.587120 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51abfd58-0232-4378-abf2-3e080f71df1b None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:36:41.587402 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51abfd58-0232-4378-abf2-3e080f71df1b None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:36:41.587670 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51abfd58-0232-4378-abf2-3e080f71df1b None admin] PATH_INFO: `/v3/domains` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:36:41.588304 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51abfd58-0232-4378-abf2-3e080f71df1b None admin] RBAC: Adding query filter params (name=Default) {{(pid=88112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:36:41.588604 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51abfd58-0232-4378-abf2-3e080f71df1b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:36:41.589969 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51abfd58-0232-4378-abf2-3e080f71df1b None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:36:41.601119 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 635/1279] 10.222.0.26 () {56 vars in 1109 bytes} [Wed Aug 24 05:36:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:36:41.607288 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1594834-0df1-4dcb-ab51-c24fb18d112c None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:36:41.637584 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:36:41.704772 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1594834-0df1-4dcb-ab51-c24fb18d112c None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:36:41.737260 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce7aba6-0600-42b2-8715-8d6dfc5820b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:36:41.737864 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce7aba6-0600-42b2-8715-8d6dfc5820b4 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:36:41.738168 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce7aba6-0600-42b2-8715-8d6dfc5820b4 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:36:41.738441 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce7aba6-0600-42b2-8715-8d6dfc5820b4 None admin] PATH_INFO: `/v3/users/placement` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:36:41.746135 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce7aba6-0600-42b2-8715-8d6dfc5820b4 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:36:41.747560 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce7aba6-0600-42b2-8715-8d6dfc5820b4 None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:36:41.758236 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application [None req-cce7aba6-0600-42b2-8715-8d6dfc5820b4 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 24 05:36:41.758236 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:36:41.758236 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:36:41.758236 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:36:41.758236 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:36:41.758236 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:36:41.758236 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:36:41.758236 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:36:41.758236 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:36:41.758236 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:36:41.758236 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:36:41.758236 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:36:41.758236 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 05:36:41.758236 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 05:36:41.758236 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 05:36:41.758236 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 05:36:41.759858 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:36:41.759858 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:36:41.759858 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 05:36:41.759858 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 05:36:41.759858 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 05:36:41.759858 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 05:36:41.759858 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:36:41.759858 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:36:41.759858 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:36:41.759858 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:36:41.759858 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:36:41.759858 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application with Lock( Aug 24 05:36:41.759858 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:36:41.759858 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:36:41.759858 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:36:41.759858 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:36:41.759858 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:36:41.759858 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:36:41.760999 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:36:41.760999 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:36:41.760999 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 05:36:41.760999 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 05:36:41.760999 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 05:36:41.760999 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 05:36:41.760999 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 05:36:41.760999 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 05:36:41.760999 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 24 05:36:41.760999 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Aug 24 05:36:41.760999 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 645/1280] 10.222.0.26 () {56 vars in 1108 bytes} [Wed Aug 24 05:36:41 2022] GET /identity/v3/users/placement => generated 87 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:36:41.765463 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51abfd58-0232-4378-abf2-3e080f71df1b None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:36:41.769211 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:36:41.861278 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51abfd58-0232-4378-abf2-3e080f71df1b None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:36:41.894231 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308711ce-e6b1-4d36-a4e0-4930a6f1cea8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:36:41.894826 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308711ce-e6b1-4d36-a4e0-4930a6f1cea8 None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:36:41.895105 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308711ce-e6b1-4d36-a4e0-4930a6f1cea8 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:36:41.895374 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308711ce-e6b1-4d36-a4e0-4930a6f1cea8 None admin] PATH_INFO: `/v3/users` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:36:41.896090 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308711ce-e6b1-4d36-a4e0-4930a6f1cea8 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:36:41.896392 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308711ce-e6b1-4d36-a4e0-4930a6f1cea8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:36:41.897794 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308711ce-e6b1-4d36-a4e0-4930a6f1cea8 None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:36:41.914756 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 636/1281] 10.222.0.26 () {56 vars in 1143 bytes} [Wed Aug 24 05:36:41 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:36:41.920574 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce7aba6-0600-42b2-8715-8d6dfc5820b4 None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:36:42.008207 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:36:42.018400 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce7aba6-0600-42b2-8715-8d6dfc5820b4 None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:36:42.049736 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d558381b-c783-405f-9893-3085d721127f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:36:42.050368 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d558381b-c783-405f-9893-3085d721127f None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:36:42.050644 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d558381b-c783-405f-9893-3085d721127f None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:36:42.050910 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d558381b-c783-405f-9893-3085d721127f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:36:42.114549 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d558381b-c783-405f-9893-3085d721127f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:36:42.115918 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d558381b-c783-405f-9893-3085d721127f None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:36:42.200607 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:36:42.210764 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 646/1282] 10.222.0.26 () {58 vars in 1282 bytes} [Wed Aug 24 05:36:41 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 05:36:42.216487 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308711ce-e6b1-4d36-a4e0-4930a6f1cea8 None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:36:42.275278 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:36:42.313355 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308711ce-e6b1-4d36-a4e0-4930a6f1cea8 None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:36:42.345464 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac82bb2-3797-4efe-b39b-914d49dc97d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:36:42.346113 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac82bb2-3797-4efe-b39b-914d49dc97d6 None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:36:42.346390 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac82bb2-3797-4efe-b39b-914d49dc97d6 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:36:42.346660 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac82bb2-3797-4efe-b39b-914d49dc97d6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:36:42.356771 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac82bb2-3797-4efe-b39b-914d49dc97d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:36:42.358229 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac82bb2-3797-4efe-b39b-914d49dc97d6 None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:36:42.372672 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application [None req-5ac82bb2-3797-4efe-b39b-914d49dc97d6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:36:42.372672 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:36:42.372672 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:36:42.372672 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:36:42.372672 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:36:42.372672 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:36:42.372672 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:36:42.372672 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:36:42.372672 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:36:42.372672 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:36:42.372672 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:36:42.372672 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:36:42.372672 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 05:36:42.372672 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 05:36:42.372672 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 05:36:42.372672 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 05:36:42.373776 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:36:42.373776 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:36:42.373776 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:36:42.373776 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:36:42.373776 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:36:42.373776 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:36:42.373776 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:36:42.373776 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application with Lock( Aug 24 05:36:42.373776 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:36:42.373776 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:36:42.373776 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:36:42.373776 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:36:42.373776 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:36:42.373776 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:36:42.373776 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:36:42.373776 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:36:42.373776 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 05:36:42.374854 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 05:36:42.374854 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 05:36:42.374854 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Aug 24 05:36:42.374854 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 637/1283] 10.222.0.26 () {56 vars in 1108 bytes} [Wed Aug 24 05:36:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:36:42.379236 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d558381b-c783-405f-9893-3085d721127f None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:36:42.476093 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d558381b-c783-405f-9893-3085d721127f None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:36:42.509286 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53264c1a-0ec0-4708-a910-833135790f43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:36:42.509913 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53264c1a-0ec0-4708-a910-833135790f43 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:36:42.510227 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53264c1a-0ec0-4708-a910-833135790f43 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:36:42.510494 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53264c1a-0ec0-4708-a910-833135790f43 None admin] PATH_INFO: `/v3/domains` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:36:42.511132 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53264c1a-0ec0-4708-a910-833135790f43 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:36:42.511434 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53264c1a-0ec0-4708-a910-833135790f43 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:36:42.512799 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53264c1a-0ec0-4708-a910-833135790f43 None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:36:42.523649 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 647/1284] 10.222.0.26 () {56 vars in 1109 bytes} [Wed Aug 24 05:36:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:36:42.529684 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac82bb2-3797-4efe-b39b-914d49dc97d6 None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:36:42.625327 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac82bb2-3797-4efe-b39b-914d49dc97d6 None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:36:42.638978 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:36:42.658684 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929491de-0455-46a1-82fe-2204caf630c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:36:42.659306 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929491de-0455-46a1-82fe-2204caf630c3 None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:36:42.659584 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929491de-0455-46a1-82fe-2204caf630c3 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:36:42.659854 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929491de-0455-46a1-82fe-2204caf630c3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:36:42.666299 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929491de-0455-46a1-82fe-2204caf630c3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:36:42.667720 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929491de-0455-46a1-82fe-2204caf630c3 None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:36:42.678542 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application [None req-929491de-0455-46a1-82fe-2204caf630c3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 05:36:42.678542 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:36:42.678542 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:36:42.678542 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:36:42.678542 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:36:42.678542 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:36:42.678542 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:36:42.678542 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:36:42.678542 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:36:42.678542 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:36:42.678542 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:36:42.678542 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:36:42.678542 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 05:36:42.678542 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 05:36:42.678542 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 05:36:42.679567 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 05:36:42.679567 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:36:42.679567 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:36:42.679567 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:36:42.679567 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:36:42.679567 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:36:42.679567 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:36:42.679567 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:36:42.679567 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application with Lock( Aug 24 05:36:42.679567 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:36:42.679567 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:36:42.679567 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:36:42.679567 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:36:42.679567 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:36:42.679567 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:36:42.679567 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:36:42.679567 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:36:42.685733 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 05:36:42.685733 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 05:36:42.685733 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 05:36:42.685733 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 05:36:42.685733 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 05:36:42.685733 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 05:36:42.685733 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 05:36:42.685733 dv-cinder-854268-1-smb devstack@keystone.service[88112]: ERROR keystone.server.flask.application Aug 24 05:36:42.685733 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 638/1285] 10.222.0.26 () {56 vars in 1111 bytes} [Wed Aug 24 05:36:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:36:42.686404 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53264c1a-0ec0-4708-a910-833135790f43 None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:36:42.735047 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:36:42.784056 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53264c1a-0ec0-4708-a910-833135790f43 None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:36:42.816521 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cad550e-23df-4233-b887-cc374f83969e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:36:42.817112 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cad550e-23df-4233-b887-cc374f83969e None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:36:42.817390 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cad550e-23df-4233-b887-cc374f83969e None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:36:42.817663 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cad550e-23df-4233-b887-cc374f83969e None admin] PATH_INFO: `/v3/projects` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:36:42.818377 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cad550e-23df-4233-b887-cc374f83969e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:36:42.818677 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cad550e-23df-4233-b887-cc374f83969e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:36:42.820087 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cad550e-23df-4233-b887-cc374f83969e None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:36:42.831550 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 648/1286] 10.222.0.26 () {56 vars in 1148 bytes} [Wed Aug 24 05:36:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:36:42.838231 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929491de-0455-46a1-82fe-2204caf630c3 None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:36:42.938190 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929491de-0455-46a1-82fe-2204caf630c3 None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:36:42.973643 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499d8ce1-a281-43b9-9c91-64833f98d2a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:36:42.974257 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499d8ce1-a281-43b9-9c91-64833f98d2a7 None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:36:42.974542 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499d8ce1-a281-43b9-9c91-64833f98d2a7 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:36:42.974816 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499d8ce1-a281-43b9-9c91-64833f98d2a7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:36:42.975531 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499d8ce1-a281-43b9-9c91-64833f98d2a7 None admin] RBAC: Adding query filter params (role.id=640bda0879494e60b72680ee505285f0, scope.project.id=ded4fe81d4dc43188dd84e53025ee783, user.id=995ebe690b7748c9842bc0696415fc52) {{(pid=88112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:36:42.975837 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499d8ce1-a281-43b9-9c91-64833f98d2a7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:36:42.977802 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499d8ce1-a281-43b9-9c91-64833f98d2a7 None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:36:42.983354 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 639/1287] 10.222.0.26 () {56 vars in 1374 bytes} [Wed Aug 24 05:36:42 2022] GET /identity/v3/role_assignments?user.id=995ebe690b7748c9842bc0696415fc52&scope.project.id=ded4fe81d4dc43188dd84e53025ee783&role.id=640bda0879494e60b72680ee505285f0 => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:36:44.888778 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d429a8-cb1f-454b-a77e-a92d139daa04 None None] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:36:44.889296 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d429a8-cb1f-454b-a77e-a92d139daa04 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:36:44.889296 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d429a8-cb1f-454b-a77e-a92d139daa04 None None] PATH_INFO: `/` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:36:44.890599 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 649/1288] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 24 05:36:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:36:44.895853 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d03a9e-4d3c-467b-973a-a00c970f6b98 None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:36:44.896254 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d03a9e-4d3c-467b-973a-a00c970f6b98 None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:36:44.896398 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d03a9e-4d3c-467b-973a-a00c970f6b98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:36:44.914398 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-c7d03a9e-4d3c-467b-973a-a00c970f6b98 None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:36:44.916171 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-c7d03a9e-4d3c-467b-973a-a00c970f6b98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:36:44.944352 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:36:44.981365 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 640/1289] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 24 05:36:44 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 05:36:45.246027 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d429a8-cb1f-454b-a77e-a92d139daa04 None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:36:45.349707 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d429a8-cb1f-454b-a77e-a92d139daa04 None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:36:45.360495 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:36:45.385584 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d09b74-618c-4904-94e5-6741f113005e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:36:45.387230 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d09b74-618c-4904-94e5-6741f113005e None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:36:45.387230 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d09b74-618c-4904-94e5-6741f113005e None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:36:45.387230 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d09b74-618c-4904-94e5-6741f113005e None admin] PATH_INFO: `/v3/services/placement` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:36:45.388554 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d09b74-618c-4904-94e5-6741f113005e None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:36:45.390309 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d09b74-618c-4904-94e5-6741f113005e None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:36:45.398240 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application [None req-87d09b74-618c-4904-94e5-6741f113005e None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 05:36:45.398240 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:36:45.398240 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 05:36:45.398240 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 05:36:45.398240 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 05:36:45.398240 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 05:36:45.398240 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 05:36:45.398240 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 05:36:45.398240 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 05:36:45.398240 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Aug 24 05:36:45.398240 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 05:36:45.398240 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Aug 24 05:36:45.398240 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:36:45.398240 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:36:45.398240 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:36:45.398240 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:36:45.398240 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:36:45.400102 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:36:45.400102 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:36:45.400102 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:36:45.400102 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:36:45.400102 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:36:45.400102 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:36:45.400102 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 05:36:45.400102 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 05:36:45.400102 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 05:36:45.400102 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 05:36:45.400102 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:36:45.400102 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:36:45.400102 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:36:45.400102 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:36:45.400102 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:36:45.400102 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:36:45.401275 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:36:45.401275 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application with Lock( Aug 24 05:36:45.401275 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:36:45.401275 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:36:45.401275 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:36:45.401275 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:36:45.401275 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:36:45.401275 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:36:45.401275 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:36:45.401275 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:36:45.401275 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 05:36:45.401275 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 05:36:45.401275 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 05:36:45.401275 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Aug 24 05:36:45.401275 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 650/1290] 10.222.0.26 () {56 vars in 1117 bytes} [Wed Aug 24 05:36:45 2022] GET /identity/v3/services/placement => generated 90 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:36:45.406053 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d03a9e-4d3c-467b-973a-a00c970f6b98 None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:36:45.499244 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d03a9e-4d3c-467b-973a-a00c970f6b98 None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:36:45.533522 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5b1889-5b3e-4f54-a624-42691969d3a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:36:45.534159 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5b1889-5b3e-4f54-a624-42691969d3a9 None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:36:45.534434 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5b1889-5b3e-4f54-a624-42691969d3a9 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:36:45.534703 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5b1889-5b3e-4f54-a624-42691969d3a9 None admin] PATH_INFO: `/v3/services` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:36:45.535325 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5b1889-5b3e-4f54-a624-42691969d3a9 None admin] RBAC: Adding query filter params (name=placement) {{(pid=88112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:36:45.535622 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5b1889-5b3e-4f54-a624-42691969d3a9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:36:45.536978 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5b1889-5b3e-4f54-a624-42691969d3a9 None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:36:45.541743 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 641/1291] 10.222.0.26 () {56 vars in 1116 bytes} [Wed Aug 24 05:36:45 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:36:45.547450 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d09b74-618c-4904-94e5-6741f113005e None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:36:45.649554 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d09b74-618c-4904-94e5-6741f113005e None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:36:45.682366 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf42902-6b3f-4be0-bfe6-ff7f5d4f2947 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:36:45.682957 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf42902-6b3f-4be0-bfe6-ff7f5d4f2947 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:36:45.683235 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf42902-6b3f-4be0-bfe6-ff7f5d4f2947 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:36:45.683505 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf42902-6b3f-4be0-bfe6-ff7f5d4f2947 None admin] PATH_INFO: `/v3/services` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:36:45.684127 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf42902-6b3f-4be0-bfe6-ff7f5d4f2947 None admin] RBAC: Adding query filter params (type=placement) {{(pid=88113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:36:45.684427 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf42902-6b3f-4be0-bfe6-ff7f5d4f2947 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:36:45.685783 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf42902-6b3f-4be0-bfe6-ff7f5d4f2947 None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:36:45.690329 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 651/1292] 10.222.0.26 () {56 vars in 1116 bytes} [Wed Aug 24 05:36:45 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:36:47.534798 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c49672-1eca-4a1f-bdd2-64b276663e3b None None] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:36:47.535360 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c49672-1eca-4a1f-bdd2-64b276663e3b None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:36:47.535360 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c49672-1eca-4a1f-bdd2-64b276663e3b None None] PATH_INFO: `/` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:36:47.536698 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 642/1293] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 24 05:36:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:36:47.542182 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085f101a-6bc0-465e-ab82-c4dba6606893 None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:36:47.542629 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085f101a-6bc0-465e-ab82-c4dba6606893 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:36:47.542751 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085f101a-6bc0-465e-ab82-c4dba6606893 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:36:47.560432 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-085f101a-6bc0-465e-ab82-c4dba6606893 None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:36:47.561609 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-085f101a-6bc0-465e-ab82-c4dba6606893 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:36:47.592324 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:36:47.628344 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 652/1294] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 24 05:36:47 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 05:36:47.894669 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c49672-1eca-4a1f-bdd2-64b276663e3b None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:36:47.925793 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:36:48.008517 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c49672-1eca-4a1f-bdd2-64b276663e3b None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:36:48.043279 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf691de0-6ccb-4d19-ae41-37b972a17a36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:36:48.043881 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf691de0-6ccb-4d19-ae41-37b972a17a36 None admin] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:36:48.044161 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf691de0-6ccb-4d19-ae41-37b972a17a36 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:36:48.044435 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf691de0-6ccb-4d19-ae41-37b972a17a36 None admin] PATH_INFO: `/v3/services` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:36:48.045074 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf691de0-6ccb-4d19-ae41-37b972a17a36 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:36:48.046466 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf691de0-6ccb-4d19-ae41-37b972a17a36 None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:36:48.059880 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 643/1295] 10.222.0.26 () {60 vars in 1141 bytes} [Wed Aug 24 05:36:47 2022] POST /identity/v3/services => generated 246 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:36:49.932976 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518ddd37-7061-42d4-a3b6-265dd8c6a367 None None] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:36:49.933542 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518ddd37-7061-42d4-a3b6-265dd8c6a367 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:36:49.933542 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518ddd37-7061-42d4-a3b6-265dd8c6a367 None None] PATH_INFO: `/` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:36:49.934803 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 653/1296] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 24 05:36:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:36:49.940416 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfd4a05-2208-41a7-96fe-9f0beabeeda9 None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:36:49.940833 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfd4a05-2208-41a7-96fe-9f0beabeeda9 None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:36:49.940969 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfd4a05-2208-41a7-96fe-9f0beabeeda9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:36:49.960740 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-6dfd4a05-2208-41a7-96fe-9f0beabeeda9 None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:36:49.962392 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-6dfd4a05-2208-41a7-96fe-9f0beabeeda9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:36:50.031961 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 644/1297] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 24 05:36:49 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 05:36:50.294905 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518ddd37-7061-42d4-a3b6-265dd8c6a367 None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:36:50.391891 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518ddd37-7061-42d4-a3b6-265dd8c6a367 None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:36:50.423457 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d930ab1c-3e8c-4043-811f-dd096aa47d32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:36:50.424061 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d930ab1c-3e8c-4043-811f-dd096aa47d32 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:36:50.424334 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d930ab1c-3e8c-4043-811f-dd096aa47d32 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:36:50.424597 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d930ab1c-3e8c-4043-811f-dd096aa47d32 None admin] PATH_INFO: `/v3/services/placement` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:36:50.425158 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d930ab1c-3e8c-4043-811f-dd096aa47d32 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:36:50.426538 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d930ab1c-3e8c-4043-811f-dd096aa47d32 None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:36:50.435331 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application [None req-d930ab1c-3e8c-4043-811f-dd096aa47d32 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 05:36:50.435331 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:36:50.435331 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 05:36:50.435331 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 05:36:50.435331 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 05:36:50.435331 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 05:36:50.435331 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 05:36:50.435331 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 05:36:50.435331 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 05:36:50.435331 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Aug 24 05:36:50.435331 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 05:36:50.435331 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Aug 24 05:36:50.435331 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:36:50.435331 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:36:50.435331 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:36:50.435331 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:36:50.435331 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:36:50.436519 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:36:50.436519 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:36:50.436519 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:36:50.436519 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:36:50.436519 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:36:50.436519 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:36:50.436519 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 05:36:50.436519 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 05:36:50.436519 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 05:36:50.436519 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 05:36:50.436519 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:36:50.436519 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:36:50.436519 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:36:50.436519 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:36:50.436519 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:36:50.436519 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:36:50.437767 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:36:50.437767 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application with Lock( Aug 24 05:36:50.437767 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:36:50.437767 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:36:50.437767 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:36:50.437767 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:36:50.437767 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:36:50.437767 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:36:50.437767 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:36:50.437767 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:36:50.437767 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 05:36:50.437767 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 05:36:50.437767 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 05:36:50.437767 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Aug 24 05:36:50.437767 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 654/1298] 10.222.0.26 () {56 vars in 1117 bytes} [Wed Aug 24 05:36:50 2022] GET /identity/v3/services/placement => generated 90 bytes in 142 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:36:50.442319 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfd4a05-2208-41a7-96fe-9f0beabeeda9 None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:36:50.460490 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:36:50.538480 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfd4a05-2208-41a7-96fe-9f0beabeeda9 None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:36:50.571973 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89fd28d-8e2e-4df2-9513-d21bb5341b94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:36:50.572522 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89fd28d-8e2e-4df2-9513-d21bb5341b94 None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:36:50.572801 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89fd28d-8e2e-4df2-9513-d21bb5341b94 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:36:50.573071 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89fd28d-8e2e-4df2-9513-d21bb5341b94 None admin] PATH_INFO: `/v3/services` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:36:50.573691 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89fd28d-8e2e-4df2-9513-d21bb5341b94 None admin] RBAC: Adding query filter params (name=placement) {{(pid=88112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:36:50.574021 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89fd28d-8e2e-4df2-9513-d21bb5341b94 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:36:50.575405 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89fd28d-8e2e-4df2-9513-d21bb5341b94 None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:36:50.580341 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 645/1299] 10.222.0.26 () {56 vars in 1116 bytes} [Wed Aug 24 05:36:50 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:36:50.586256 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d930ab1c-3e8c-4043-811f-dd096aa47d32 None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:36:50.617200 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:36:50.684309 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d930ab1c-3e8c-4043-811f-dd096aa47d32 None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:36:50.716696 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b191e32-3a8b-4c6a-b517-6a7702b51572 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:36:50.717290 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b191e32-3a8b-4c6a-b517-6a7702b51572 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:36:50.717571 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b191e32-3a8b-4c6a-b517-6a7702b51572 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:36:50.717844 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b191e32-3a8b-4c6a-b517-6a7702b51572 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:36:50.718599 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b191e32-3a8b-4c6a-b517-6a7702b51572 None admin] RBAC: Adding query filter params (interface=public, service_id=512c657f64204fbd8465699b24fb638c, region_id=RegionOne) {{(pid=88113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:36:50.718907 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b191e32-3a8b-4c6a-b517-6a7702b51572 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:36:50.720264 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b191e32-3a8b-4c6a-b517-6a7702b51572 None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:36:50.725212 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 655/1300] 10.222.0.26 () {56 vars in 1251 bytes} [Wed Aug 24 05:36:50 2022] GET /identity/v3/endpoints?service_id=512c657f64204fbd8465699b24fb638c&interface=public®ion_id=RegionOne => generated 194 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:36:50.731280 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89fd28d-8e2e-4df2-9513-d21bb5341b94 None admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:36:50.809841 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:36:50.827873 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89fd28d-8e2e-4df2-9513-d21bb5341b94 None admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:36:50.860407 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc89cb6-ba02-48d4-b333-1f748e1bf693 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:36:50.861006 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc89cb6-ba02-48d4-b333-1f748e1bf693 None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:36:50.861287 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc89cb6-ba02-48d4-b333-1f748e1bf693 None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:36:50.861560 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc89cb6-ba02-48d4-b333-1f748e1bf693 None admin] PATH_INFO: `/v3/services` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:36:50.862193 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc89cb6-ba02-48d4-b333-1f748e1bf693 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:36:50.863546 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc89cb6-ba02-48d4-b333-1f748e1bf693 None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:36:50.870738 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 646/1301] 10.222.0.26 () {56 vars in 1087 bytes} [Wed Aug 24 05:36:50 2022] GET /identity/v3/services => generated 2191 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:36:52.731192 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ac4ff5-89ab-429d-ba3a-81f9f6f9c8c2 None None] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:36:52.731740 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ac4ff5-89ab-429d-ba3a-81f9f6f9c8c2 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:36:52.731740 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ac4ff5-89ab-429d-ba3a-81f9f6f9c8c2 None None] PATH_INFO: `/` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:36:52.733071 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 656/1302] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 24 05:36:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:36:52.738197 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d297cfb8-2580-44df-b1e7-58ff80bf8da9 None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:36:52.738604 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d297cfb8-2580-44df-b1e7-58ff80bf8da9 None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:36:52.738748 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d297cfb8-2580-44df-b1e7-58ff80bf8da9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:36:52.756312 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-d297cfb8-2580-44df-b1e7-58ff80bf8da9 None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:36:52.757488 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-d297cfb8-2580-44df-b1e7-58ff80bf8da9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:36:52.822068 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 647/1303] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 24 05:36:52 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 05:36:53.086885 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ac4ff5-89ab-429d-ba3a-81f9f6f9c8c2 None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:36:53.177750 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:36:53.185213 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ac4ff5-89ab-429d-ba3a-81f9f6f9c8c2 None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:36:53.217670 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb56114b-1fbe-4d54-b6f8-016265a072b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:36:53.218310 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb56114b-1fbe-4d54-b6f8-016265a072b8 None admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:36:53.218591 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb56114b-1fbe-4d54-b6f8-016265a072b8 None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:36:53.218862 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb56114b-1fbe-4d54-b6f8-016265a072b8 None admin] PATH_INFO: `/v3/services/placement` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:36:53.219437 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb56114b-1fbe-4d54-b6f8-016265a072b8 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:36:53.220795 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb56114b-1fbe-4d54-b6f8-016265a072b8 None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:36:53.229249 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application [None req-fb56114b-1fbe-4d54-b6f8-016265a072b8 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 05:36:53.229249 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:36:53.229249 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 05:36:53.229249 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 05:36:53.229249 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 05:36:53.229249 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 05:36:53.229249 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 05:36:53.229249 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 05:36:53.229249 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 05:36:53.229249 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Aug 24 05:36:53.229249 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 05:36:53.229249 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Aug 24 05:36:53.229249 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 05:36:53.229249 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 05:36:53.229249 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 05:36:53.229249 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 05:36:53.229249 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 05:36:53.230429 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 05:36:53.230429 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 05:36:53.230429 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 05:36:53.230429 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 05:36:53.230429 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 05:36:53.230429 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 05:36:53.230429 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 05:36:53.230429 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 05:36:53.230429 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 05:36:53.230429 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 05:36:53.230429 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 05:36:53.230429 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 05:36:53.230429 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 05:36:53.230429 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 05:36:53.230429 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 05:36:53.230429 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 05:36:53.231461 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 05:36:53.231461 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application with Lock( Aug 24 05:36:53.231461 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 05:36:53.231461 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self._enter() Aug 24 05:36:53.231461 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 05:36:53.231461 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 05:36:53.231461 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 05:36:53.231461 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application return self.creator() Aug 24 05:36:53.231461 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 05:36:53.231461 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application created_value = creator( Aug 24 05:36:53.231461 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 05:36:53.231461 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 05:36:53.231461 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 05:36:53.231461 dv-cinder-854268-1-smb devstack@keystone.service[88113]: ERROR keystone.server.flask.application Aug 24 05:36:53.231461 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 657/1304] 10.222.0.26 () {56 vars in 1117 bytes} [Wed Aug 24 05:36:53 2022] GET /identity/v3/services/placement => generated 90 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 05:36:53.236244 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d297cfb8-2580-44df-b1e7-58ff80bf8da9 None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:36:53.309329 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:36:53.332154 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d297cfb8-2580-44df-b1e7-58ff80bf8da9 None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:36:53.364752 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afaec3a4-d103-4f5d-9c32-ae9d7406dd4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:36:53.365286 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaec3a4-d103-4f5d-9c32-ae9d7406dd4f None admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:36:53.365559 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaec3a4-d103-4f5d-9c32-ae9d7406dd4f None admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:36:53.365826 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaec3a4-d103-4f5d-9c32-ae9d7406dd4f None admin] PATH_INFO: `/v3/services` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:36:53.366468 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afaec3a4-d103-4f5d-9c32-ae9d7406dd4f None admin] RBAC: Adding query filter params (name=placement) {{(pid=88112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:36:53.366762 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afaec3a4-d103-4f5d-9c32-ae9d7406dd4f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:36:53.368673 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afaec3a4-d103-4f5d-9c32-ae9d7406dd4f None admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:36:53.373552 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 648/1305] 10.222.0.26 () {56 vars in 1116 bytes} [Wed Aug 24 05:36:53 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:36:53.379263 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb56114b-1fbe-4d54-b6f8-016265a072b8 None admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:36:53.476639 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb56114b-1fbe-4d54-b6f8-016265a072b8 None admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:36:53.510142 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec870ac-5be2-41d9-8020-f4b75a1d16dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:36:53.510735 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec870ac-5be2-41d9-8020-f4b75a1d16dc None admin] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:36:53.511017 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec870ac-5be2-41d9-8020-f4b75a1d16dc None admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:36:53.511290 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec870ac-5be2-41d9-8020-f4b75a1d16dc None admin] PATH_INFO: `/v3/endpoints` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:36:53.511944 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec870ac-5be2-41d9-8020-f4b75a1d16dc None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:36:53.513306 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec870ac-5be2-41d9-8020-f4b75a1d16dc None admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:36:53.531979 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 658/1306] 10.222.0.26 () {60 vars in 1144 bytes} [Wed Aug 24 05:36:53 2022] POST /identity/v3/endpoints => generated 331 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:37:03.370662 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=30 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:37:03.527745 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:37:56.886191 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29318bed-4a42-474a-82eb-3a502096b54e None None] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:37:56.886685 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29318bed-4a42-474a-82eb-3a502096b54e None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:37:56.886768 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29318bed-4a42-474a-82eb-3a502096b54e None None] PATH_INFO: `/` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:37:56.892382 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 649/1307] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 24 05:37:56 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:37:56.894739 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37f2b9f-9191-4f14-b4af-0bea5be33342 None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:37:56.895685 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37f2b9f-9191-4f14-b4af-0bea5be33342 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:37:56.896142 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37f2b9f-9191-4f14-b4af-0bea5be33342 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:37:57.009330 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-a37f2b9f-9191-4f14-b4af-0bea5be33342 None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:37:57.010861 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-a37f2b9f-9191-4f14-b4af-0bea5be33342 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:37:57.155717 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 659/1308] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 24 05:37:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 05:37:57.450244 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c009942-3910-49e0-941f-d19833c01dc0 None None] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:37:57.450531 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c009942-3910-49e0-941f-d19833c01dc0 None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:37:57.450855 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c009942-3910-49e0-941f-d19833c01dc0 None None] PATH_INFO: `/` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:37:57.452684 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 650/1309] 10.222.0.26 () {54 vars in 965 bytes} [Wed Aug 24 05:37:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:37:57.460001 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0245046b-53ac-4c9d-9da3-b1fbe7505e80 None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:37:57.460317 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0245046b-53ac-4c9d-9da3-b1fbe7505e80 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:37:57.460569 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0245046b-53ac-4c9d-9da3-b1fbe7505e80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:37:57.553986 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-0245046b-53ac-4c9d-9da3-b1fbe7505e80 None None] MFA Rules not processed for user `874348b647194ac2b5ecbf12c33bf59e`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:37:57.555458 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-0245046b-53ac-4c9d-9da3-b1fbe7505e80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:37:57.580129 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:37:57.646009 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 660/1310] 10.222.0.26 () {58 vars in 1062 bytes} [Wed Aug 24 05:37:57 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:37:57.655248 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c009942-3910-49e0-941f-d19833c01dc0 None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:37:57.657005 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-6c009942-3910-49e0-941f-d19833c01dc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:37:57.775596 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c009942-3910-49e0-941f-d19833c01dc0 None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:37:57.853104 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65dc6fbc-35b4-46be-a074-16bf623638b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '874348b647194ac2b5ecbf12c33bf59e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:37:57.853713 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dc6fbc-35b4-46be-a074-16bf623638b7 service neutron] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:37:57.854017 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dc6fbc-35b4-46be-a074-16bf623638b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:37:57.854291 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dc6fbc-35b4-46be-a074-16bf623638b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:37:57.855884 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-65dc6fbc-35b4-46be-a074-16bf623638b7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:37:57.911862 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:37:57.970809 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65dc6fbc-35b4-46be-a074-16bf623638b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:37:57.972858 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65dc6fbc-35b4-46be-a074-16bf623638b7 service neutron] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:37:57.992291 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 651/1311] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 24 05:37:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:38:00.164229 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c9efdd-d5ae-49de-8295-3c139f6b6328 None None] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:38:00.164759 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c9efdd-d5ae-49de-8295-3c139f6b6328 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:38:00.164896 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c9efdd-d5ae-49de-8295-3c139f6b6328 None None] PATH_INFO: `/` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:38:00.166283 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 661/1312] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 24 05:38:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:38:00.171609 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc25021-c187-4150-b4e7-a3dbff57452a None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:38:00.172075 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc25021-c187-4150-b4e7-a3dbff57452a None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:38:00.172201 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc25021-c187-4150-b4e7-a3dbff57452a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:38:00.255385 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-6fc25021-c187-4150-b4e7-a3dbff57452a None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:38:00.256707 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-6fc25021-c187-4150-b4e7-a3dbff57452a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:38:00.352825 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 652/1313] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 24 05:38:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:38:00.631852 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c9efdd-d5ae-49de-8295-3c139f6b6328 None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:38:00.633377 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-75c9efdd-d5ae-49de-8295-3c139f6b6328 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:38:00.734736 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c9efdd-d5ae-49de-8295-3c139f6b6328 None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:38:00.802461 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:38:00.805018 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213352ae-112b-4454-bd32-b81148fcc352 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '874348b647194ac2b5ecbf12c33bf59e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:38:00.805846 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213352ae-112b-4454-bd32-b81148fcc352 service neutron] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:38:00.806373 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213352ae-112b-4454-bd32-b81148fcc352 service neutron] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:38:00.806684 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213352ae-112b-4454-bd32-b81148fcc352 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:38:00.808400 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-213352ae-112b-4454-bd32-b81148fcc352 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:38:00.917026 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213352ae-112b-4454-bd32-b81148fcc352 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:38:00.918547 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213352ae-112b-4454-bd32-b81148fcc352 service neutron] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:38:00.937844 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 662/1314] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 24 05:38:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:38:03.135058 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce4b3a2-5700-4df3-8c3c-bffae2cd5f1d None None] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:38:03.135555 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce4b3a2-5700-4df3-8c3c-bffae2cd5f1d None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:38:03.135671 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce4b3a2-5700-4df3-8c3c-bffae2cd5f1d None None] PATH_INFO: `/` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:38:03.136935 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 653/1315] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 24 05:38:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:38:03.142070 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369ee91d-74a8-4a6d-a874-843b2ff41bd9 None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:38:03.142521 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369ee91d-74a8-4a6d-a874-843b2ff41bd9 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:38:03.142619 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369ee91d-74a8-4a6d-a874-843b2ff41bd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:38:03.207987 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-369ee91d-74a8-4a6d-a874-843b2ff41bd9 None None] MFA Rules not processed for user `3f18e05ea2ca4efea2d541eedaad23e0`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:38:03.209171 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-369ee91d-74a8-4a6d-a874-843b2ff41bd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:38:03.259626 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:38:03.303100 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 663/1316] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 24 05:38:03 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 05:38:03.585938 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce4b3a2-5700-4df3-8c3c-bffae2cd5f1d None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:38:03.587519 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-dce4b3a2-5700-4df3-8c3c-bffae2cd5f1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:38:03.597137 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:38:03.696625 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce4b3a2-5700-4df3-8c3c-bffae2cd5f1d None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:38:03.769917 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de940658-66d0-4249-ab45-bb59396f77f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '874348b647194ac2b5ecbf12c33bf59e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:38:03.770545 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de940658-66d0-4249-ab45-bb59396f77f8 service neutron] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:38:03.770820 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de940658-66d0-4249-ab45-bb59396f77f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:38:03.771086 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de940658-66d0-4249-ab45-bb59396f77f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:38:03.772667 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-de940658-66d0-4249-ab45-bb59396f77f8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:38:03.834060 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:38:03.880340 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de940658-66d0-4249-ab45-bb59396f77f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:38:03.881759 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de940658-66d0-4249-ab45-bb59396f77f8 service neutron] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:38:03.899604 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 654/1317] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 24 05:38:03 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:38:06.270563 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa1a7cc-a131-4c25-8d90-2408c5f40666 None None] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:38:06.271026 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa1a7cc-a131-4c25-8d90-2408c5f40666 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:38:06.271117 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa1a7cc-a131-4c25-8d90-2408c5f40666 None None] PATH_INFO: `/` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:38:06.272428 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 664/1318] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 24 05:38:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:38:06.277605 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f816244-e708-40b1-8488-5d2af9a8b5c8 None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:38:06.278015 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f816244-e708-40b1-8488-5d2af9a8b5c8 None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:38:06.278189 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f816244-e708-40b1-8488-5d2af9a8b5c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:38:06.341777 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-0f816244-e708-40b1-8488-5d2af9a8b5c8 None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:38:06.342998 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-0f816244-e708-40b1-8488-5d2af9a8b5c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:38:06.438286 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 655/1319] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 24 05:38:06 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:38:06.721360 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa1a7cc-a131-4c25-8d90-2408c5f40666 None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:38:06.722932 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-dfa1a7cc-a131-4c25-8d90-2408c5f40666 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:38:06.823641 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa1a7cc-a131-4c25-8d90-2408c5f40666 None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:38:06.893295 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3df843-d763-4116-b2e2-c6f6f56f8e17 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '874348b647194ac2b5ecbf12c33bf59e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:38:06.893881 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3df843-d763-4116-b2e2-c6f6f56f8e17 service neutron] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:38:06.894189 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3df843-d763-4116-b2e2-c6f6f56f8e17 service neutron] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:38:06.894451 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3df843-d763-4116-b2e2-c6f6f56f8e17 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:38:06.896021 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-9f3df843-d763-4116-b2e2-c6f6f56f8e17 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:38:06.903132 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:38:07.004025 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3df843-d763-4116-b2e2-c6f6f56f8e17 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:38:07.005447 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3df843-d763-4116-b2e2-c6f6f56f8e17 service neutron] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:38:07.023299 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 665/1320] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 24 05:38:06 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:38:09.529991 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9806c7-501d-43c7-978d-59a4aa69a5ab None None] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:38:09.530525 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9806c7-501d-43c7-978d-59a4aa69a5ab None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:38:09.530617 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9806c7-501d-43c7-978d-59a4aa69a5ab None None] PATH_INFO: `/` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:38:09.531913 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 656/1321] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 24 05:38:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:38:09.537748 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828cb0a1-12d9-4447-baff-95f3de8ed319 None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:38:09.538234 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828cb0a1-12d9-4447-baff-95f3de8ed319 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:38:09.538319 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828cb0a1-12d9-4447-baff-95f3de8ed319 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:38:09.603133 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-828cb0a1-12d9-4447-baff-95f3de8ed319 None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:38:09.604333 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-828cb0a1-12d9-4447-baff-95f3de8ed319 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:38:09.661457 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:38:09.701388 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 666/1322] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 24 05:38:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:38:09.982762 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9806c7-501d-43c7-978d-59a4aa69a5ab None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:38:09.984385 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-6d9806c7-501d-43c7-978d-59a4aa69a5ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:38:10.003852 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:38:10.089876 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9806c7-501d-43c7-978d-59a4aa69a5ab None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:38:10.161232 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecf9fcc-c9c8-48e5-990b-c41180f294cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '874348b647194ac2b5ecbf12c33bf59e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:38:10.162067 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecf9fcc-c9c8-48e5-990b-c41180f294cd service neutron] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:38:10.162349 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecf9fcc-c9c8-48e5-990b-c41180f294cd service neutron] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:38:10.162619 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecf9fcc-c9c8-48e5-990b-c41180f294cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:38:10.164214 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-aecf9fcc-c9c8-48e5-990b-c41180f294cd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:38:10.234879 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:38:10.274286 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecf9fcc-c9c8-48e5-990b-c41180f294cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:38:10.275758 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecf9fcc-c9c8-48e5-990b-c41180f294cd service neutron] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:38:10.293705 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 657/1323] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 24 05:38:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:38:12.234898 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48df8bfb-222d-4fb9-bf67-5af7f7c42731 None None] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:38:12.235389 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48df8bfb-222d-4fb9-bf67-5af7f7c42731 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:38:12.235485 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48df8bfb-222d-4fb9-bf67-5af7f7c42731 None None] PATH_INFO: `/` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:38:12.236823 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 667/1324] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 24 05:38:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:38:12.242077 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f9eb21-2acb-48d3-87f2-f6d17f375377 None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:38:12.242492 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f9eb21-2acb-48d3-87f2-f6d17f375377 None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:38:12.242630 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f9eb21-2acb-48d3-87f2-f6d17f375377 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:38:12.310267 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-97f9eb21-2acb-48d3-87f2-f6d17f375377 None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:38:12.311469 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-97f9eb21-2acb-48d3-87f2-f6d17f375377 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:38:12.406159 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 658/1325] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 24 05:38:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:38:12.701863 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec8561a-3786-4872-816f-b74a88a33852 None None] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:38:12.702283 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec8561a-3786-4872-816f-b74a88a33852 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:38:12.702633 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec8561a-3786-4872-816f-b74a88a33852 None None] PATH_INFO: `/` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:38:12.704050 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 668/1326] 10.222.0.26 () {54 vars in 965 bytes} [Wed Aug 24 05:38:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:38:12.710220 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b862ed5-6611-4d57-9e3f-9ff670f23e3f None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:38:12.710576 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b862ed5-6611-4d57-9e3f-9ff670f23e3f None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:38:12.710937 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b862ed5-6611-4d57-9e3f-9ff670f23e3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:38:12.742516 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:38:12.788540 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-4b862ed5-6611-4d57-9e3f-9ff670f23e3f None None] MFA Rules not processed for user `874348b647194ac2b5ecbf12c33bf59e`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:38:12.789826 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-4b862ed5-6611-4d57-9e3f-9ff670f23e3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:38:12.871459 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 659/1327] 10.222.0.26 () {58 vars in 1062 bytes} [Wed Aug 24 05:38:12 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:38:12.880829 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec8561a-3786-4872-816f-b74a88a33852 None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:38:12.882380 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-8ec8561a-3786-4872-816f-b74a88a33852 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:38:12.989412 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec8561a-3786-4872-816f-b74a88a33852 None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:38:13.064769 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b889d4b-e654-490e-8642-7a3b3ec044fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '874348b647194ac2b5ecbf12c33bf59e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:38:13.065315 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b889d4b-e654-490e-8642-7a3b3ec044fe service neutron] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:38:13.065586 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b889d4b-e654-490e-8642-7a3b3ec044fe service neutron] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:38:13.065849 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b889d4b-e654-490e-8642-7a3b3ec044fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:38:13.067470 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-4b889d4b-e654-490e-8642-7a3b3ec044fe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:38:13.084577 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:38:13.203336 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b889d4b-e654-490e-8642-7a3b3ec044fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:38:13.204947 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b889d4b-e654-490e-8642-7a3b3ec044fe service neutron] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:38:13.233186 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 669/1328] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 24 05:38:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:38:15.404897 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1028bc8a-5846-4186-8d26-f4339a6d04f5 None None] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:38:15.405325 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1028bc8a-5846-4186-8d26-f4339a6d04f5 None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:38:15.405498 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1028bc8a-5846-4186-8d26-f4339a6d04f5 None None] PATH_INFO: `/` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:38:15.413213 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37541399-53f7-4913-b4b9-c597f266abb8 None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:38:15.413654 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37541399-53f7-4913-b4b9-c597f266abb8 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:38:15.413834 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37541399-53f7-4913-b4b9-c597f266abb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:38:15.416595 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 660/1329] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 24 05:38:15 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:38:15.489433 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-37541399-53f7-4913-b4b9-c597f266abb8 None None] MFA Rules not processed for user `3f18e05ea2ca4efea2d541eedaad23e0`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:38:15.490750 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-37541399-53f7-4913-b4b9-c597f266abb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:38:15.557942 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:38:15.589304 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 670/1330] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 24 05:38:15 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 05:38:15.875995 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1028bc8a-5846-4186-8d26-f4339a6d04f5 None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:38:15.877561 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-1028bc8a-5846-4186-8d26-f4339a6d04f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:38:15.980575 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1028bc8a-5846-4186-8d26-f4339a6d04f5 None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:38:15.999744 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:38:16.054771 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d01498-e8b6-4101-b7e8-59634c5cc92e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '874348b647194ac2b5ecbf12c33bf59e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:38:16.055466 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d01498-e8b6-4101-b7e8-59634c5cc92e service neutron] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:38:16.055736 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d01498-e8b6-4101-b7e8-59634c5cc92e service neutron] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:38:16.056002 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d01498-e8b6-4101-b7e8-59634c5cc92e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:38:16.057675 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-49d01498-e8b6-4101-b7e8-59634c5cc92e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:38:16.171465 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d01498-e8b6-4101-b7e8-59634c5cc92e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:38:16.172925 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d01498-e8b6-4101-b7e8-59634c5cc92e service neutron] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:38:16.192575 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 661/1331] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 24 05:38:15 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:38:18.495411 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32e3db2-9de6-4ccd-91d9-4d65495ec7c2 None None] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:38:18.495967 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32e3db2-9de6-4ccd-91d9-4d65495ec7c2 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:38:18.495967 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32e3db2-9de6-4ccd-91d9-4d65495ec7c2 None None] PATH_INFO: `/` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:38:18.497239 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 671/1332] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 24 05:38:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:38:18.503256 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46766bf9-77d5-42c6-af80-5a318584c611 None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:38:18.503700 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46766bf9-77d5-42c6-af80-5a318584c611 None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:38:18.503812 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46766bf9-77d5-42c6-af80-5a318584c611 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:38:18.566713 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:38:18.569509 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-46766bf9-77d5-42c6-af80-5a318584c611 None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:38:18.571281 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-46766bf9-77d5-42c6-af80-5a318584c611 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:38:18.667049 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 662/1333] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 24 05:38:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:38:18.944650 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32e3db2-9de6-4ccd-91d9-4d65495ec7c2 None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:38:18.946744 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-f32e3db2-9de6-4ccd-91d9-4d65495ec7c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:38:19.047417 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32e3db2-9de6-4ccd-91d9-4d65495ec7c2 None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:38:19.118695 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931f8e77-8122-4943-81ee-84eaef782d59 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '874348b647194ac2b5ecbf12c33bf59e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:38:19.119290 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931f8e77-8122-4943-81ee-84eaef782d59 service neutron] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:38:19.119567 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931f8e77-8122-4943-81ee-84eaef782d59 service neutron] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:38:19.119835 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931f8e77-8122-4943-81ee-84eaef782d59 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:38:19.121419 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-931f8e77-8122-4943-81ee-84eaef782d59 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:38:19.147203 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:38:19.227421 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931f8e77-8122-4943-81ee-84eaef782d59 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:38:19.228856 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931f8e77-8122-4943-81ee-84eaef782d59 service neutron] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:38:19.246878 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 672/1334] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 24 05:38:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:38:21.183779 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28730b02-7501-4f0b-8364-3b7fd3e2c29d None None] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:38:21.184610 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28730b02-7501-4f0b-8364-3b7fd3e2c29d None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:38:21.184610 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28730b02-7501-4f0b-8364-3b7fd3e2c29d None None] PATH_INFO: `/` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:38:21.185985 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 663/1335] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 24 05:38:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:38:21.191329 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b532394-76d9-48d6-86d0-0b64429de4c0 None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:38:21.191749 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b532394-76d9-48d6-86d0-0b64429de4c0 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:38:21.191888 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b532394-76d9-48d6-86d0-0b64429de4c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:38:21.257755 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-1b532394-76d9-48d6-86d0-0b64429de4c0 None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:38:21.258984 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-1b532394-76d9-48d6-86d0-0b64429de4c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:38:21.334225 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:38:21.356410 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 673/1336] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 24 05:38:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:38:21.641221 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28730b02-7501-4f0b-8364-3b7fd3e2c29d None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:38:21.642813 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-28730b02-7501-4f0b-8364-3b7fd3e2c29d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:38:21.743490 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28730b02-7501-4f0b-8364-3b7fd3e2c29d None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:38:21.771092 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:38:21.814998 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67e43da-5fb1-4229-b886-6cd17d1c1758 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '874348b647194ac2b5ecbf12c33bf59e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:38:21.816128 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67e43da-5fb1-4229-b886-6cd17d1c1758 service neutron] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:38:21.816401 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67e43da-5fb1-4229-b886-6cd17d1c1758 service neutron] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:38:21.816672 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67e43da-5fb1-4229-b886-6cd17d1c1758 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:38:21.818267 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-d67e43da-5fb1-4229-b886-6cd17d1c1758 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:38:21.921493 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67e43da-5fb1-4229-b886-6cd17d1c1758 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:38:21.922930 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67e43da-5fb1-4229-b886-6cd17d1c1758 service neutron] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:38:21.942370 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 664/1337] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 24 05:38:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:38:24.114178 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8de72c1-d393-4e67-87c9-3b43f40fddb8 None None] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:38:24.114773 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8de72c1-d393-4e67-87c9-3b43f40fddb8 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:38:24.114773 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8de72c1-d393-4e67-87c9-3b43f40fddb8 None None] PATH_INFO: `/` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:38:24.116044 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 674/1338] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 24 05:38:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:38:24.121092 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec1fff3-1f62-49af-8b0d-0c2f7541f345 None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:38:24.121518 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec1fff3-1f62-49af-8b0d-0c2f7541f345 None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:38:24.121651 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec1fff3-1f62-49af-8b0d-0c2f7541f345 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:38:24.186709 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-fec1fff3-1f62-49af-8b0d-0c2f7541f345 None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:38:24.187903 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-fec1fff3-1f62-49af-8b0d-0c2f7541f345 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:38:24.196026 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:38:24.284121 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 665/1339] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 24 05:38:24 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:38:24.564108 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8de72c1-d393-4e67-87c9-3b43f40fddb8 None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:38:24.566241 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-c8de72c1-d393-4e67-87c9-3b43f40fddb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:38:24.666566 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8de72c1-d393-4e67-87c9-3b43f40fddb8 None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:38:24.738106 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225468c2-eca3-4956-8056-2f0023613233 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '874348b647194ac2b5ecbf12c33bf59e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:38:24.738699 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225468c2-eca3-4956-8056-2f0023613233 service neutron] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:38:24.738977 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225468c2-eca3-4956-8056-2f0023613233 service neutron] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:38:24.739246 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225468c2-eca3-4956-8056-2f0023613233 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:38:24.740826 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-225468c2-eca3-4956-8056-2f0023613233 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:38:24.775160 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:38:24.846954 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225468c2-eca3-4956-8056-2f0023613233 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:38:24.848328 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225468c2-eca3-4956-8056-2f0023613233 service neutron] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:38:24.866383 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 675/1340] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 24 05:38:24 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:38:28.672148 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dc39a6-2a59-4880-8859-2e25b5bbe384 None None] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:38:28.672637 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dc39a6-2a59-4880-8859-2e25b5bbe384 None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:38:28.672733 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dc39a6-2a59-4880-8859-2e25b5bbe384 None None] PATH_INFO: `/` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:38:28.674581 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 666/1341] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 24 05:38:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:38:28.679902 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb7c7cc-6e7d-43c0-a0cd-e58d490cec02 None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:38:28.680307 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb7c7cc-6e7d-43c0-a0cd-e58d490cec02 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:38:28.680457 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb7c7cc-6e7d-43c0-a0cd-e58d490cec02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:38:28.746721 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-bfb7c7cc-6e7d-43c0-a0cd-e58d490cec02 None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:38:28.747911 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-bfb7c7cc-6e7d-43c0-a0cd-e58d490cec02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:38:28.831057 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:38:28.842307 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 676/1342] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 24 05:38:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 05:38:29.120780 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dc39a6-2a59-4880-8859-2e25b5bbe384 None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:38:29.122372 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-01dc39a6-2a59-4880-8859-2e25b5bbe384 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:38:29.225237 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dc39a6-2a59-4880-8859-2e25b5bbe384 None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:38:29.261970 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:38:29.298592 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69249d1-00aa-4e90-83b2-1b72e8f6aba9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '874348b647194ac2b5ecbf12c33bf59e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:38:29.299541 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69249d1-00aa-4e90-83b2-1b72e8f6aba9 service neutron] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:38:29.299819 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69249d1-00aa-4e90-83b2-1b72e8f6aba9 service neutron] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:38:29.300085 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69249d1-00aa-4e90-83b2-1b72e8f6aba9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:38:29.301649 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-a69249d1-00aa-4e90-83b2-1b72e8f6aba9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:38:29.411808 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69249d1-00aa-4e90-83b2-1b72e8f6aba9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:38:29.413153 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69249d1-00aa-4e90-83b2-1b72e8f6aba9 service neutron] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:38:29.431243 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 667/1343] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 24 05:38:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:38:31.963386 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d48343-9420-4324-864a-76b7773f841e None None] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:38:31.963970 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d48343-9420-4324-864a-76b7773f841e None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:38:31.963970 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d48343-9420-4324-864a-76b7773f841e None None] PATH_INFO: `/` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:38:31.965277 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 677/1344] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 24 05:38:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:38:31.971283 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd12ba69-03dc-43eb-a98a-8e2df6698525 None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:38:31.971713 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd12ba69-03dc-43eb-a98a-8e2df6698525 None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:38:31.971807 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd12ba69-03dc-43eb-a98a-8e2df6698525 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:38:32.039700 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-cd12ba69-03dc-43eb-a98a-8e2df6698525 None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:38:32.040901 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-cd12ba69-03dc-43eb-a98a-8e2df6698525 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:38:32.060233 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:38:32.139230 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 668/1345] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 24 05:38:31 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 05:38:32.418006 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d48343-9420-4324-864a-76b7773f841e None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:38:32.420665 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-f2d48343-9420-4324-864a-76b7773f841e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:38:32.525856 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d48343-9420-4324-864a-76b7773f841e None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:38:32.599788 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e252532-575e-43a3-8f83-976abbf81890 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '874348b647194ac2b5ecbf12c33bf59e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:38:32.600395 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e252532-575e-43a3-8f83-976abbf81890 service neutron] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:38:32.600674 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e252532-575e-43a3-8f83-976abbf81890 service neutron] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:38:32.600942 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e252532-575e-43a3-8f83-976abbf81890 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:38:32.602640 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-1e252532-575e-43a3-8f83-976abbf81890 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:38:32.650011 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:38:32.719126 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e252532-575e-43a3-8f83-976abbf81890 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:38:32.721358 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e252532-575e-43a3-8f83-976abbf81890 service neutron] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:38:32.741000 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 678/1346] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 24 05:38:32 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:38:36.578673 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0553b661-b2b4-4135-8db9-0beb03ac533a None None] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:38:36.579265 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0553b661-b2b4-4135-8db9-0beb03ac533a None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:38:36.579265 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0553b661-b2b4-4135-8db9-0beb03ac533a None None] PATH_INFO: `/` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:38:36.581192 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 669/1347] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 24 05:38:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:38:36.586942 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c54b63c-2892-48c5-9af7-4d9da1981f09 None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:38:36.587407 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c54b63c-2892-48c5-9af7-4d9da1981f09 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:38:36.587567 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c54b63c-2892-48c5-9af7-4d9da1981f09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:38:36.665066 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-7c54b63c-2892-48c5-9af7-4d9da1981f09 None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:38:36.666338 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-7c54b63c-2892-48c5-9af7-4d9da1981f09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:38:36.772900 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:38:36.776055 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 679/1348] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 24 05:38:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:38:37.061456 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0553b661-b2b4-4135-8db9-0beb03ac533a None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:38:37.063076 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-0553b661-b2b4-4135-8db9-0beb03ac533a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:38:37.169715 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0553b661-b2b4-4135-8db9-0beb03ac533a None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:38:37.218559 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:38:37.245128 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a506993d-e232-4648-8c5e-ca99dd73ea0d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '874348b647194ac2b5ecbf12c33bf59e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:38:37.245729 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a506993d-e232-4648-8c5e-ca99dd73ea0d service neutron] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:38:37.246031 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a506993d-e232-4648-8c5e-ca99dd73ea0d service neutron] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:38:37.246302 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a506993d-e232-4648-8c5e-ca99dd73ea0d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:38:37.247893 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-a506993d-e232-4648-8c5e-ca99dd73ea0d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:38:37.354515 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a506993d-e232-4648-8c5e-ca99dd73ea0d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:38:37.355879 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a506993d-e232-4648-8c5e-ca99dd73ea0d service neutron] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:38:37.373965 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 670/1349] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 24 05:38:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:38:42.197498 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c8e37e-5fc0-4ad5-a98b-5a62f2c020db None None] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:38:42.197498 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c8e37e-5fc0-4ad5-a98b-5a62f2c020db None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:38:42.197994 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c8e37e-5fc0-4ad5-a98b-5a62f2c020db None None] PATH_INFO: `/` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:38:42.199293 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 680/1350] 10.222.0.26 () {54 vars in 921 bytes} [Wed Aug 24 05:38:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:38:42.205092 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d25e8f-b74e-44bc-ab22-8923d3a46d72 None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:38:42.205888 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d25e8f-b74e-44bc-ab22-8923d3a46d72 None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:38:42.206349 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d25e8f-b74e-44bc-ab22-8923d3a46d72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:38:42.291327 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-45d25e8f-b74e-44bc-ab22-8923d3a46d72 None None] MFA Rules not processed for user `995ebe690b7748c9842bc0696415fc52`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:38:42.292533 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-45d25e8f-b74e-44bc-ab22-8923d3a46d72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:38:42.312365 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:38:42.448195 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 671/1351] 10.222.0.26 () {58 vars in 1018 bytes} [Wed Aug 24 05:38:42 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 05:38:46.686780 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b5a8f6-a464-48ca-a67d-cb1e32091d73 None None] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:38:46.687340 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b5a8f6-a464-48ca-a67d-cb1e32091d73 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:38:46.687340 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b5a8f6-a464-48ca-a67d-cb1e32091d73 None None] PATH_INFO: `/` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:38:46.689475 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 681/1352] 10.222.0.26 () {54 vars in 921 bytes} [Wed Aug 24 05:38:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:38:46.694398 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0978c83-55c4-4f6b-a902-26f3b2057d68 None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:38:46.694845 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0978c83-55c4-4f6b-a902-26f3b2057d68 None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:38:46.694925 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0978c83-55c4-4f6b-a902-26f3b2057d68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:38:46.772766 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-c0978c83-55c4-4f6b-a902-26f3b2057d68 None None] MFA Rules not processed for user `995ebe690b7748c9842bc0696415fc52`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:38:46.773976 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-c0978c83-55c4-4f6b-a902-26f3b2057d68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:38:46.843829 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:38:46.883422 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 672/1353] 10.222.0.26 () {58 vars in 1018 bytes} [Wed Aug 24 05:38:46 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:38:48.213008 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba528408-b15d-4a25-a33c-4cdd7d05e972 None None] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:38:48.213569 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba528408-b15d-4a25-a33c-4cdd7d05e972 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:38:48.213569 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba528408-b15d-4a25-a33c-4cdd7d05e972 None None] PATH_INFO: `/` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:38:48.214888 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 682/1354] 10.222.0.26 () {54 vars in 921 bytes} [Wed Aug 24 05:38:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:38:48.220572 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9f5afa-1690-411e-98f4-651c747daa45 None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:38:48.220985 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9f5afa-1690-411e-98f4-651c747daa45 None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:38:48.221128 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9f5afa-1690-411e-98f4-651c747daa45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:38:48.302708 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-4a9f5afa-1690-411e-98f4-651c747daa45 None None] MFA Rules not processed for user `995ebe690b7748c9842bc0696415fc52`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:38:48.303916 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-4a9f5afa-1690-411e-98f4-651c747daa45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:38:48.412303 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 673/1355] 10.222.0.26 () {58 vars in 1018 bytes} [Wed Aug 24 05:38:48 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:38:51.668280 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9144a3-8ad6-47e6-bf68-d7aae8378190 None None] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:38:51.668816 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9144a3-8ad6-47e6-bf68-d7aae8378190 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:38:51.668816 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9144a3-8ad6-47e6-bf68-d7aae8378190 None None] PATH_INFO: `/` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:38:51.670312 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 683/1356] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 24 05:38:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:38:51.675666 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57167d5d-c3d0-4f1d-b820-2f18be156343 None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:38:51.676094 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57167d5d-c3d0-4f1d-b820-2f18be156343 None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:38:51.676349 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57167d5d-c3d0-4f1d-b820-2f18be156343 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:38:51.712018 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:38:51.744998 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-57167d5d-c3d0-4f1d-b820-2f18be156343 None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:38:51.746594 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-57167d5d-c3d0-4f1d-b820-2f18be156343 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:38:51.881251 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 674/1357] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 24 05:38:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:38:52.182838 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b92e804-d09f-4be8-a534-7dbc63e8b928 None None] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:38:52.183622 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b92e804-d09f-4be8-a534-7dbc63e8b928 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:38:52.184054 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b92e804-d09f-4be8-a534-7dbc63e8b928 None None] PATH_INFO: `/` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:38:52.185792 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 684/1358] 10.222.0.26 () {54 vars in 962 bytes} [Wed Aug 24 05:38:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:38:52.193786 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfe1f15-fb20-4484-8d1b-19e56362b94f None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:38:52.194131 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfe1f15-fb20-4484-8d1b-19e56362b94f None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:38:52.194408 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfe1f15-fb20-4484-8d1b-19e56362b94f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:38:52.282632 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-5cfe1f15-fb20-4484-8d1b-19e56362b94f None None] MFA Rules not processed for user `7b633e1aec6c4269bce13aa9c89e911a`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:38:52.284089 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-5cfe1f15-fb20-4484-8d1b-19e56362b94f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:38:52.334701 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:38:52.409464 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 675/1359] 10.222.0.26 () {58 vars in 1059 bytes} [Wed Aug 24 05:38:52 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:38:52.417421 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b92e804-d09f-4be8-a534-7dbc63e8b928 None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:38:52.418963 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-2b92e804-d09f-4be8-a534-7dbc63e8b928 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:38:52.584151 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b92e804-d09f-4be8-a534-7dbc63e8b928 None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:38:52.660419 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:38:52.706185 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d25782-da52-4d79-8a0f-3f05dbf7936b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b633e1aec6c4269bce13aa9c89e911a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:38:52.707011 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d25782-da52-4d79-8a0f-3f05dbf7936b service nova] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:38:52.707384 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d25782-da52-4d79-8a0f-3f05dbf7936b service nova] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:38:52.707818 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d25782-da52-4d79-8a0f-3f05dbf7936b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:38:52.709768 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-d4d25782-da52-4d79-8a0f-3f05dbf7936b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:38:52.803698 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d25782-da52-4d79-8a0f-3f05dbf7936b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:38:52.805606 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d25782-da52-4d79-8a0f-3f05dbf7936b service nova] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:38:52.825311 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 685/1360] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 24 05:38:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:38:54.937059 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260a379c-aaeb-4946-b0b4-32c03429a57f None None] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:38:54.937567 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260a379c-aaeb-4946-b0b4-32c03429a57f None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:38:54.937567 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260a379c-aaeb-4946-b0b4-32c03429a57f None None] PATH_INFO: `/` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:38:54.942968 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 676/1361] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 24 05:38:54 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:38:54.944060 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf680a7-7464-44c5-b51b-669e7b5f28e0 None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:38:54.944529 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf680a7-7464-44c5-b51b-669e7b5f28e0 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:38:54.944636 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf680a7-7464-44c5-b51b-669e7b5f28e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:38:55.014740 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-3bf680a7-7464-44c5-b51b-669e7b5f28e0 None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:38:55.016517 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-3bf680a7-7464-44c5-b51b-669e7b5f28e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:38:55.053393 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:38:55.113274 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 686/1362] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 24 05:38:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 05:38:55.396972 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260a379c-aaeb-4946-b0b4-32c03429a57f None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:38:55.398506 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-260a379c-aaeb-4946-b0b4-32c03429a57f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:38:55.581732 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260a379c-aaeb-4946-b0b4-32c03429a57f None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:38:55.590974 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:38:55.705998 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb3b102-edeb-4a62-a667-18f10a73ad87 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b633e1aec6c4269bce13aa9c89e911a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:38:55.706707 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb3b102-edeb-4a62-a667-18f10a73ad87 service nova] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:38:55.707057 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb3b102-edeb-4a62-a667-18f10a73ad87 service nova] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:38:55.707397 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb3b102-edeb-4a62-a667-18f10a73ad87 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:38:55.709098 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-6eb3b102-edeb-4a62-a667-18f10a73ad87 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:38:55.805645 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb3b102-edeb-4a62-a667-18f10a73ad87 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:38:55.807670 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb3b102-edeb-4a62-a667-18f10a73ad87 service nova] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:38:55.827470 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 677/1363] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 24 05:38:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 05:38:58.061937 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260780db-a1f4-4f5d-a92f-ec25736ac8e7 None None] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:38:58.062519 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260780db-a1f4-4f5d-a92f-ec25736ac8e7 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:38:58.062681 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260780db-a1f4-4f5d-a92f-ec25736ac8e7 None None] PATH_INFO: `/` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:38:58.064289 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 687/1364] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 24 05:38:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:38:58.069647 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bb3f60-473b-4690-88d4-e1e01aeb7697 None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:38:58.070142 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bb3f60-473b-4690-88d4-e1e01aeb7697 None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:38:58.070237 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bb3f60-473b-4690-88d4-e1e01aeb7697 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:38:58.088456 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:38:58.150113 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-89bb3f60-473b-4690-88d4-e1e01aeb7697 None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:38:58.151358 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-89bb3f60-473b-4690-88d4-e1e01aeb7697 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:38:58.262302 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 678/1365] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 24 05:38:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:38:58.560555 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13d0955-9882-41e1-b231-1d0cfec853c5 None None] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:38:58.561208 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13d0955-9882-41e1-b231-1d0cfec853c5 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:38:58.561489 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13d0955-9882-41e1-b231-1d0cfec853c5 None None] PATH_INFO: `/` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:38:58.564148 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 688/1366] 10.222.0.26 () {54 vars in 962 bytes} [Wed Aug 24 05:38:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:38:58.569762 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85db18c-e922-4a43-9e6f-239a596fd0ea None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:38:58.570089 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85db18c-e922-4a43-9e6f-239a596fd0ea None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:38:58.570367 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85db18c-e922-4a43-9e6f-239a596fd0ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:38:58.680489 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-d85db18c-e922-4a43-9e6f-239a596fd0ea None None] MFA Rules not processed for user `7b633e1aec6c4269bce13aa9c89e911a`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:38:58.681728 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-d85db18c-e922-4a43-9e6f-239a596fd0ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:38:58.719865 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:38:58.816618 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 679/1367] 10.222.0.26 () {58 vars in 1059 bytes} [Wed Aug 24 05:38:58 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 05:38:58.824361 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13d0955-9882-41e1-b231-1d0cfec853c5 None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:38:58.825989 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-f13d0955-9882-41e1-b231-1d0cfec853c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:38:58.980465 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13d0955-9882-41e1-b231-1d0cfec853c5 None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:38:59.002079 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:38:59.102892 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a67180c-21ac-49ff-9c89-94172e433e30 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b633e1aec6c4269bce13aa9c89e911a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:38:59.103518 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a67180c-21ac-49ff-9c89-94172e433e30 service nova] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:38:59.103768 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a67180c-21ac-49ff-9c89-94172e433e30 service nova] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:38:59.103951 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a67180c-21ac-49ff-9c89-94172e433e30 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:38:59.105511 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-7a67180c-21ac-49ff-9c89-94172e433e30 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:38:59.195932 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a67180c-21ac-49ff-9c89-94172e433e30 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:38:59.198008 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a67180c-21ac-49ff-9c89-94172e433e30 service nova] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:38:59.217388 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 689/1368] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 24 05:38:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:38:59.891332 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ca499a-3c90-4841-90b8-10380d0c09d2 None None] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:38:59.891864 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ca499a-3c90-4841-90b8-10380d0c09d2 None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:38:59.892051 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ca499a-3c90-4841-90b8-10380d0c09d2 None None] PATH_INFO: `/` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:38:59.893673 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 680/1369] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 24 05:38:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 05:38:59.898791 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe941ded-fa16-4640-8509-ea727e40e5b4 None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:38:59.899083 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe941ded-fa16-4640-8509-ea727e40e5b4 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:38:59.899364 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe941ded-fa16-4640-8509-ea727e40e5b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:38:59.934905 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:38:59.973602 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-fe941ded-fa16-4640-8509-ea727e40e5b4 None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:38:59.974871 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-fe941ded-fa16-4640-8509-ea727e40e5b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:39:00.076702 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 690/1370] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 24 05:38:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:39:00.671145 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c176a52f-df87-419c-8724-fd199a0bfba6 None None] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:00.671546 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c176a52f-df87-419c-8724-fd199a0bfba6 None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:00.672434 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c176a52f-df87-419c-8724-fd199a0bfba6 None None] PATH_INFO: `/` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:00.674022 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 681/1371] 10.222.0.26 () {54 vars in 964 bytes} [Wed Aug 24 05:39:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:39:00.679211 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b44e40-6865-4861-b008-169e8a92e04d None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:00.679684 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b44e40-6865-4861-b008-169e8a92e04d None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:00.679787 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b44e40-6865-4861-b008-169e8a92e04d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:00.760188 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-b2b44e40-6865-4861-b008-169e8a92e04d None None] MFA Rules not processed for user `17b450afe795495680fc70f522c83750`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:39:00.761395 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-b2b44e40-6865-4861-b008-169e8a92e04d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:39:00.815156 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:00.847613 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 691/1372] 10.222.0.26 () {58 vars in 1061 bytes} [Wed Aug 24 05:39:00 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:39:00.854985 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c176a52f-df87-419c-8724-fd199a0bfba6 None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:00.856510 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-c176a52f-df87-419c-8724-fd199a0bfba6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:39:00.964143 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c176a52f-df87-419c-8724-fd199a0bfba6 None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:01.006312 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:01.042457 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643a6318-5b8f-43a5-84c8-d0760530f601 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17b450afe795495680fc70f522c83750', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:01.043069 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643a6318-5b8f-43a5-84c8-d0760530f601 service cinder] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:01.043347 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643a6318-5b8f-43a5-84c8-d0760530f601 service cinder] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:01.043614 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643a6318-5b8f-43a5-84c8-d0760530f601 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:01.045213 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-643a6318-5b8f-43a5-84c8-d0760530f601 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:39:01.174409 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643a6318-5b8f-43a5-84c8-d0760530f601 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:01.175967 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643a6318-5b8f-43a5-84c8-d0760530f601 service cinder] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:01.198051 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 682/1373] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 24 05:39:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 05:39:01.213109 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd2e7e2-bcb1-43fb-b304-7497b72192db None None] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:01.213586 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd2e7e2-bcb1-43fb-b304-7497b72192db None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:01.214138 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd2e7e2-bcb1-43fb-b304-7497b72192db None None] PATH_INFO: `/` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:01.216494 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 692/1374] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 24 05:39:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:39:01.221044 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8102e92-234d-4bb4-9c49-9a817eaa3b0e None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:01.221323 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8102e92-234d-4bb4-9c49-9a817eaa3b0e None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:01.221594 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8102e92-234d-4bb4-9c49-9a817eaa3b0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:01.301875 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-d8102e92-234d-4bb4-9c49-9a817eaa3b0e None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:39:01.303490 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-d8102e92-234d-4bb4-9c49-9a817eaa3b0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:39:01.332748 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:01.422636 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 683/1375] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 24 05:39:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:39:01.713564 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd2e7e2-bcb1-43fb-b304-7497b72192db None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:01.715191 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-7bd2e7e2-bcb1-43fb-b304-7497b72192db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:39:01.861983 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd2e7e2-bcb1-43fb-b304-7497b72192db None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:01.916570 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:01.978170 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd493868-8201-4e78-be8c-2704a5da2919 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b633e1aec6c4269bce13aa9c89e911a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:01.978694 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd493868-8201-4e78-be8c-2704a5da2919 service nova] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:01.978972 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd493868-8201-4e78-be8c-2704a5da2919 service nova] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:01.979242 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd493868-8201-4e78-be8c-2704a5da2919 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:01.980825 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-cd493868-8201-4e78-be8c-2704a5da2919 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:39:02.068527 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd493868-8201-4e78-be8c-2704a5da2919 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:02.070154 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd493868-8201-4e78-be8c-2704a5da2919 service nova] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:02.088304 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 693/1376] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 24 05:39:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:39:04.008382 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590069c8-2442-449b-8058-69a52c5b094f None None] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:04.008877 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590069c8-2442-449b-8058-69a52c5b094f None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:04.008974 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590069c8-2442-449b-8058-69a52c5b094f None None] PATH_INFO: `/` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:04.010301 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 684/1377] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 24 05:39:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:39:04.016149 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d80c6cc-3fb3-4826-b7ee-a41be70eb4f5 None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:04.016590 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d80c6cc-3fb3-4826-b7ee-a41be70eb4f5 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:04.016700 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d80c6cc-3fb3-4826-b7ee-a41be70eb4f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:04.088613 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-1d80c6cc-3fb3-4826-b7ee-a41be70eb4f5 None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:39:04.089744 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-1d80c6cc-3fb3-4826-b7ee-a41be70eb4f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:39:04.096324 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:04.196155 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 694/1378] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 24 05:39:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:39:04.489297 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590069c8-2442-449b-8058-69a52c5b094f None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:04.490925 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-590069c8-2442-449b-8058-69a52c5b094f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:39:04.669852 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590069c8-2442-449b-8058-69a52c5b094f None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:04.676678 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:04.813655 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04588c45-baec-4e9e-917b-c7df018e97c3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b633e1aec6c4269bce13aa9c89e911a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:04.814341 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04588c45-baec-4e9e-917b-c7df018e97c3 service nova] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:04.814734 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04588c45-baec-4e9e-917b-c7df018e97c3 service nova] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:04.815173 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04588c45-baec-4e9e-917b-c7df018e97c3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:04.816847 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-04588c45-baec-4e9e-917b-c7df018e97c3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:39:04.911936 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04588c45-baec-4e9e-917b-c7df018e97c3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:04.913701 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04588c45-baec-4e9e-917b-c7df018e97c3 service nova] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:04.935419 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 685/1379] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 24 05:39:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:39:06.877001 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa37142-0398-46ce-8e68-47c01f80c6b2 None None] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:06.877541 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa37142-0398-46ce-8e68-47c01f80c6b2 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:06.877541 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa37142-0398-46ce-8e68-47c01f80c6b2 None None] PATH_INFO: `/` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:06.882703 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 695/1380] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 24 05:39:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:39:06.884323 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548aa462-651c-423a-be3c-d3e286b449b9 None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:06.884776 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548aa462-651c-423a-be3c-d3e286b449b9 None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:06.884875 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548aa462-651c-423a-be3c-d3e286b449b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:06.896856 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:06.955752 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-548aa462-651c-423a-be3c-d3e286b449b9 None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:39:06.956950 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-548aa462-651c-423a-be3c-d3e286b449b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:39:07.066407 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 686/1381] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 24 05:39:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:39:07.351053 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa37142-0398-46ce-8e68-47c01f80c6b2 None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:07.352560 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-0aa37142-0398-46ce-8e68-47c01f80c6b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:39:07.495310 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:07.511475 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa37142-0398-46ce-8e68-47c01f80c6b2 None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:07.642324 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5a657e-dfdc-4a48-85be-ea852630aa4d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b633e1aec6c4269bce13aa9c89e911a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:07.642840 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5a657e-dfdc-4a48-85be-ea852630aa4d service nova] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:07.643114 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5a657e-dfdc-4a48-85be-ea852630aa4d service nova] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:07.643380 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5a657e-dfdc-4a48-85be-ea852630aa4d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:07.644956 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-3f5a657e-dfdc-4a48-85be-ea852630aa4d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:39:07.740103 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5a657e-dfdc-4a48-85be-ea852630aa4d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:07.741821 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5a657e-dfdc-4a48-85be-ea852630aa4d service nova] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:07.753134 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:07.763578 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 696/1382] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 24 05:39:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:39:09.702006 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8071e19d-276f-4225-b0e4-78386c2d027b None None] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:09.702537 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8071e19d-276f-4225-b0e4-78386c2d027b None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:09.702656 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8071e19d-276f-4225-b0e4-78386c2d027b None None] PATH_INFO: `/` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:09.703947 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 687/1383] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 24 05:39:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 05:39:09.709358 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a9bd4f-8d7e-4cd5-a91b-d4b1709d2b80 None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:09.709793 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a9bd4f-8d7e-4cd5-a91b-d4b1709d2b80 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:09.709888 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a9bd4f-8d7e-4cd5-a91b-d4b1709d2b80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:09.798421 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-21a9bd4f-8d7e-4cd5-a91b-d4b1709d2b80 None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:39:09.800539 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-21a9bd4f-8d7e-4cd5-a91b-d4b1709d2b80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:39:09.961339 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 697/1384] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 24 05:39:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 05:39:10.256259 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8071e19d-276f-4225-b0e4-78386c2d027b None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:10.257805 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-8071e19d-276f-4225-b0e4-78386c2d027b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:39:10.360121 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:10.436085 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8071e19d-276f-4225-b0e4-78386c2d027b None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:10.554270 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb81d9aa-7ed4-40ae-92f9-1792b886551e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b633e1aec6c4269bce13aa9c89e911a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:10.554879 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb81d9aa-7ed4-40ae-92f9-1792b886551e service nova] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:10.555156 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb81d9aa-7ed4-40ae-92f9-1792b886551e service nova] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:10.555427 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb81d9aa-7ed4-40ae-92f9-1792b886551e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:10.557033 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-eb81d9aa-7ed4-40ae-92f9-1792b886551e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:39:10.619821 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:10.660190 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb81d9aa-7ed4-40ae-92f9-1792b886551e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:10.661813 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb81d9aa-7ed4-40ae-92f9-1792b886551e service nova] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:10.680216 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 688/1385] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 24 05:39:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:39:12.761016 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9983a73f-6e09-4c05-b932-e33d81f5b7f9 None None] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:12.761603 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9983a73f-6e09-4c05-b932-e33d81f5b7f9 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:12.761743 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9983a73f-6e09-4c05-b932-e33d81f5b7f9 None None] PATH_INFO: `/` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:12.763740 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 698/1386] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 24 05:39:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:39:12.768850 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fafd0c-584f-4d4d-a702-b5c777a46dc4 None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:12.769251 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fafd0c-584f-4d4d-a702-b5c777a46dc4 None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:12.769403 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fafd0c-584f-4d4d-a702-b5c777a46dc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:12.838045 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-85fafd0c-584f-4d4d-a702-b5c777a46dc4 None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:39:12.839192 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-85fafd0c-584f-4d4d-a702-b5c777a46dc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:39:12.939839 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 689/1387] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 24 05:39:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:39:13.232071 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9983a73f-6e09-4c05-b932-e33d81f5b7f9 None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:13.234218 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-9983a73f-6e09-4c05-b932-e33d81f5b7f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:39:13.315843 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:13.399968 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9983a73f-6e09-4c05-b932-e33d81f5b7f9 None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:13.536279 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290defe5-9458-4a92-ac31-08d791e82eca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b633e1aec6c4269bce13aa9c89e911a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:13.536813 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290defe5-9458-4a92-ac31-08d791e82eca service nova] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:13.537090 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290defe5-9458-4a92-ac31-08d791e82eca service nova] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:13.537477 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290defe5-9458-4a92-ac31-08d791e82eca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:13.539168 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-290defe5-9458-4a92-ac31-08d791e82eca service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:39:13.579534 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:13.636713 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290defe5-9458-4a92-ac31-08d791e82eca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:13.638375 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290defe5-9458-4a92-ac31-08d791e82eca service nova] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:13.656405 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 699/1388] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 24 05:39:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:39:15.682062 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b01d23a-5274-4d2d-a7e0-960022504df5 None None] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:15.682905 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b01d23a-5274-4d2d-a7e0-960022504df5 None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:15.682905 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b01d23a-5274-4d2d-a7e0-960022504df5 None None] PATH_INFO: `/` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:15.684212 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 690/1389] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 24 05:39:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:39:15.690044 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9be600-5ccd-4109-bd21-0b38f4242afd None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:15.690476 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9be600-5ccd-4109-bd21-0b38f4242afd None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:15.690584 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9be600-5ccd-4109-bd21-0b38f4242afd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:15.756000 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-af9be600-5ccd-4109-bd21-0b38f4242afd None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:39:15.757190 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-af9be600-5ccd-4109-bd21-0b38f4242afd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:39:15.852220 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 700/1390] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 24 05:39:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:39:16.142026 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11452bf7-addd-4f98-aefa-55e2b57fbdce None None] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:16.142383 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11452bf7-addd-4f98-aefa-55e2b57fbdce None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:16.142606 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11452bf7-addd-4f98-aefa-55e2b57fbdce None None] PATH_INFO: `/` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:16.143566 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9be600-5ccd-4109-bd21-0b38f4242afd None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:16.143941 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 691/1391] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 24 05:39:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:39:16.144852 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-af9be600-5ccd-4109-bd21-0b38f4242afd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:39:16.148737 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3942eaa-1c06-428d-ad12-9b970591215b None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:16.149024 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3942eaa-1c06-428d-ad12-9b970591215b None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:16.149294 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3942eaa-1c06-428d-ad12-9b970591215b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:16.159628 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:16.185561 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:16.216427 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-a3942eaa-1c06-428d-ad12-9b970591215b None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:39:16.218176 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-a3942eaa-1c06-428d-ad12-9b970591215b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:39:16.259674 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9be600-5ccd-4109-bd21-0b38f4242afd None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:16.316958 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 692/1392] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 24 05:39:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 05:39:16.377042 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3668cc0a-718d-4f37-9aa1-edb522caddd5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b633e1aec6c4269bce13aa9c89e911a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:16.377645 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3668cc0a-718d-4f37-9aa1-edb522caddd5 service nova] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:16.377920 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3668cc0a-718d-4f37-9aa1-edb522caddd5 service nova] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:16.378215 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3668cc0a-718d-4f37-9aa1-edb522caddd5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:16.379811 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-3668cc0a-718d-4f37-9aa1-edb522caddd5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:39:16.388430 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:16.469191 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3668cc0a-718d-4f37-9aa1-edb522caddd5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:16.470851 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3668cc0a-718d-4f37-9aa1-edb522caddd5 service nova] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:16.488776 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 701/1393] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 24 05:39:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:39:16.619088 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbd7f11-a44c-4260-9988-bc944f25eed6 None None] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:16.619409 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbd7f11-a44c-4260-9988-bc944f25eed6 None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:16.619683 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbd7f11-a44c-4260-9988-bc944f25eed6 None None] PATH_INFO: `/` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:16.621107 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 693/1394] 10.222.0.26 () {54 vars in 967 bytes} [Wed Aug 24 05:39:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:39:16.626799 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17829e21-d0a3-4304-ac79-15821c04dd76 None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:16.627167 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17829e21-d0a3-4304-ac79-15821c04dd76 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:16.627549 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17829e21-d0a3-4304-ac79-15821c04dd76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:16.711415 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-17829e21-d0a3-4304-ac79-15821c04dd76 None None] MFA Rules not processed for user `7f856958add7474a989325cea7b1b224`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:39:16.712614 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-17829e21-d0a3-4304-ac79-15821c04dd76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:39:16.786150 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:16.789324 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 702/1395] 10.222.0.26 () {58 vars in 1064 bytes} [Wed Aug 24 05:39:16 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:39:16.796998 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbd7f11-a44c-4260-9988-bc944f25eed6 None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:16.798588 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-bfbd7f11-a44c-4260-9988-bc944f25eed6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:39:16.903023 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbd7f11-a44c-4260-9988-bc944f25eed6 None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:16.910557 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:16.979086 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1579d133-964c-493b-93f2-28ecd01a57aa service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f856958add7474a989325cea7b1b224', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:16.979609 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1579d133-964c-493b-93f2-28ecd01a57aa service glance] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:16.979885 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1579d133-964c-493b-93f2-28ecd01a57aa service glance] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:16.980154 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1579d133-964c-493b-93f2-28ecd01a57aa service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:16.981731 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-1579d133-964c-493b-93f2-28ecd01a57aa service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:39:17.091818 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1579d133-964c-493b-93f2-28ecd01a57aa service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:17.093268 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1579d133-964c-493b-93f2-28ecd01a57aa service glance] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:17.111930 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 694/1396] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 24 05:39:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:39:17.846506 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9dee29-8ebd-4669-a930-6efbbe3d49e4 None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:17.846999 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9dee29-8ebd-4669-a930-6efbbe3d49e4 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:17.847101 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9dee29-8ebd-4669-a930-6efbbe3d49e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:17.913503 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-bb9dee29-8ebd-4669-a930-6efbbe3d49e4 None None] MFA Rules not processed for user `6c2c08b27a0f4943b5da908eb7b1cd96`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:39:17.914741 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-bb9dee29-8ebd-4669-a930-6efbbe3d49e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:39:18.005037 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 703/1397] 10.222.0.26 () {58 vars in 1009 bytes} [Wed Aug 24 05:39:17 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:39:18.052627 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54abc38-55be-4ee5-bedb-566dc4d290d5 None None] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:18.053133 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54abc38-55be-4ee5-bedb-566dc4d290d5 None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:18.053233 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54abc38-55be-4ee5-bedb-566dc4d290d5 None None] PATH_INFO: `/` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:18.054548 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 695/1398] 10.222.0.26 () {54 vars in 943 bytes} [Wed Aug 24 05:39:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:39:18.061881 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b639621-c560-41e0-8b33-8d2b49a5afd3 None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:18.062204 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b639621-c560-41e0-8b33-8d2b49a5afd3 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:18.062485 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b639621-c560-41e0-8b33-8d2b49a5afd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:18.137578 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-0b639621-c560-41e0-8b33-8d2b49a5afd3 None None] MFA Rules not processed for user `87ff96222a7c4baea31fc1bebf4d89a9`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:39:18.138714 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-0b639621-c560-41e0-8b33-8d2b49a5afd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:39:18.171390 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:18.243922 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 704/1399] 10.222.0.26 () {58 vars in 1040 bytes} [Wed Aug 24 05:39:18 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:39:18.253604 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54abc38-55be-4ee5-bedb-566dc4d290d5 None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:18.255144 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-d54abc38-55be-4ee5-bedb-566dc4d290d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:39:18.302696 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:18.399023 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54abc38-55be-4ee5-bedb-566dc4d290d5 None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:18.435103 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1548c0-5cab-459f-ab6f-939022c9035d None None] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:18.435395 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1548c0-5cab-459f-ab6f-939022c9035d None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:18.435675 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1548c0-5cab-459f-ab6f-939022c9035d None None] PATH_INFO: `/` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:18.437535 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 705/1400] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 24 05:39:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:39:18.442430 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e935de37-6235-4b93-9ecc-64068c08dc0b None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:18.442716 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e935de37-6235-4b93-9ecc-64068c08dc0b None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:18.442992 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e935de37-6235-4b93-9ecc-64068c08dc0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:18.505936 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7c8062-fdd1-4745-98cc-d48c1606340f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87ff96222a7c4baea31fc1bebf4d89a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:18.506575 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7c8062-fdd1-4745-98cc-d48c1606340f service swift] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:18.506886 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7c8062-fdd1-4745-98cc-d48c1606340f service swift] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:18.507157 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7c8062-fdd1-4745-98cc-d48c1606340f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:18.509058 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-9d7c8062-fdd1-4745-98cc-d48c1606340f service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:39:18.517398 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-e935de37-6235-4b93-9ecc-64068c08dc0b None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:39:18.518672 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-e935de37-6235-4b93-9ecc-64068c08dc0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:39:18.530848 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:18.594947 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7c8062-fdd1-4745-98cc-d48c1606340f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:18.596556 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7c8062-fdd1-4745-98cc-d48c1606340f service swift] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:18.604778 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 696/1401] 10.222.0.26 () {60 vars in 1384 bytes} [Wed Aug 24 05:39:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 05:39:18.618489 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 706/1402] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 24 05:39:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 05:39:18.906477 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7c8062-fdd1-4745-98cc-d48c1606340f service swift] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:18.907800 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-9d7c8062-fdd1-4745-98cc-d48c1606340f service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:39:19.054211 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7c8062-fdd1-4745-98cc-d48c1606340f service swift] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:19.163224 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:19.216346 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b68039-24b3-49da-b858-3a0ab9243942 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b633e1aec6c4269bce13aa9c89e911a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:19.216346 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b68039-24b3-49da-b858-3a0ab9243942 service nova] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:19.216346 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b68039-24b3-49da-b858-3a0ab9243942 service nova] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:19.216346 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b68039-24b3-49da-b858-3a0ab9243942 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:19.218166 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-d5b68039-24b3-49da-b858-3a0ab9243942 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:39:19.316604 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b68039-24b3-49da-b858-3a0ab9243942 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:19.318289 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b68039-24b3-49da-b858-3a0ab9243942 service nova] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:19.337350 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 697/1403] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 24 05:39:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:39:21.265591 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f56ea4e-5c00-4263-95dd-d7920a0468fe None None] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:21.266185 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f56ea4e-5c00-4263-95dd-d7920a0468fe None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:21.266185 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f56ea4e-5c00-4263-95dd-d7920a0468fe None None] PATH_INFO: `/` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:21.267555 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 707/1404] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 24 05:39:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:39:21.272842 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128ee3e2-f7ff-4008-96c5-407c1f5c8874 None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:21.273670 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128ee3e2-f7ff-4008-96c5-407c1f5c8874 None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:21.274288 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128ee3e2-f7ff-4008-96c5-407c1f5c8874 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:21.344970 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-128ee3e2-f7ff-4008-96c5-407c1f5c8874 None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:39:21.346228 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-128ee3e2-f7ff-4008-96c5-407c1f5c8874 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:39:21.377252 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:21.453921 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 698/1405] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 24 05:39:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:39:21.741069 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f56ea4e-5c00-4263-95dd-d7920a0468fe None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:21.742616 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-7f56ea4e-5c00-4263-95dd-d7920a0468fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:39:21.745481 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:21.903179 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f56ea4e-5c00-4263-95dd-d7920a0468fe None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:21.987690 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:22.035334 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7bcd05-b420-4542-9516-d16674a45ec2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b633e1aec6c4269bce13aa9c89e911a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:22.035946 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7bcd05-b420-4542-9516-d16674a45ec2 service nova] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:22.036224 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7bcd05-b420-4542-9516-d16674a45ec2 service nova] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:22.036495 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7bcd05-b420-4542-9516-d16674a45ec2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:22.038180 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-5a7bcd05-b420-4542-9516-d16674a45ec2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:39:22.136089 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7bcd05-b420-4542-9516-d16674a45ec2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:22.137737 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7bcd05-b420-4542-9516-d16674a45ec2 service nova] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:22.157859 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 708/1406] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 24 05:39:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:39:24.111206 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d5da23-2a91-460f-b69e-33370d9105fb None None] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:24.111772 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d5da23-2a91-460f-b69e-33370d9105fb None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:24.111772 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d5da23-2a91-460f-b69e-33370d9105fb None None] PATH_INFO: `/` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:24.113398 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 699/1407] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 24 05:39:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:39:24.118668 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd894beb-ff36-43fd-be69-963ab5862e03 None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:24.119108 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd894beb-ff36-43fd-be69-963ab5862e03 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:24.119210 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd894beb-ff36-43fd-be69-963ab5862e03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:24.189174 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-fd894beb-ff36-43fd-be69-963ab5862e03 None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:39:24.190423 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-fd894beb-ff36-43fd-be69-963ab5862e03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:39:24.238767 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:24.307341 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 709/1408] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 24 05:39:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:39:24.598775 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d5da23-2a91-460f-b69e-33370d9105fb None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:24.600310 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-b0d5da23-2a91-460f-b69e-33370d9105fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:39:24.774033 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d5da23-2a91-460f-b69e-33370d9105fb None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:24.789761 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:24.906982 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0126ad64-9da8-466f-940c-dc53b4ac7953 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b633e1aec6c4269bce13aa9c89e911a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:24.907685 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0126ad64-9da8-466f-940c-dc53b4ac7953 service nova] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:24.908080 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0126ad64-9da8-466f-940c-dc53b4ac7953 service nova] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:24.908453 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0126ad64-9da8-466f-940c-dc53b4ac7953 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:24.910276 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-0126ad64-9da8-466f-940c-dc53b4ac7953 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:39:25.010970 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0126ad64-9da8-466f-940c-dc53b4ac7953 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:25.012707 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0126ad64-9da8-466f-940c-dc53b4ac7953 service nova] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:25.035559 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 700/1409] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 24 05:39:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:39:34.304968 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=26 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:35.032771 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=93 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:40.656501 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170b5320-7314-4915-a61f-9b7c5dcd8705 None None] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:40.657063 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170b5320-7314-4915-a61f-9b7c5dcd8705 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:40.657063 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170b5320-7314-4915-a61f-9b7c5dcd8705 None None] PATH_INFO: `/` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:40.658454 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 710/1410] 10.222.0.26 () {54 vars in 918 bytes} [Wed Aug 24 05:39:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:39:40.663709 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d735ba39-d789-4095-8db3-59f54602aa1b None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:40.664138 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d735ba39-d789-4095-8db3-59f54602aa1b None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:40.664253 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d735ba39-d789-4095-8db3-59f54602aa1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:40.739485 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-d735ba39-d789-4095-8db3-59f54602aa1b None None] MFA Rules not processed for user `995ebe690b7748c9842bc0696415fc52`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:39:40.740745 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-d735ba39-d789-4095-8db3-59f54602aa1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:39:40.843224 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 701/1411] 10.222.0.26 () {58 vars in 1015 bytes} [Wed Aug 24 05:39:40 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 05:39:40.857801 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18a8477-facf-456e-8d21-30fa61dccf08 None None] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:40.858118 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18a8477-facf-456e-8d21-30fa61dccf08 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:40.858392 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18a8477-facf-456e-8d21-30fa61dccf08 None None] PATH_INFO: `/` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:40.859713 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 711/1412] 10.222.0.26 () {54 vars in 918 bytes} [Wed Aug 24 05:39:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:39:40.864354 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0beb46-da77-4be6-b7c5-876c79fa5721 None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:40.864664 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0beb46-da77-4be6-b7c5-876c79fa5721 None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:40.864937 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0beb46-da77-4be6-b7c5-876c79fa5721 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:40.936361 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:40.938982 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-dc0beb46-da77-4be6-b7c5-876c79fa5721 None None] MFA Rules not processed for user `7b633e1aec6c4269bce13aa9c89e911a`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:39:40.940756 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-dc0beb46-da77-4be6-b7c5-876c79fa5721 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:39:41.054598 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 702/1413] 10.222.0.26 () {58 vars in 1015 bytes} [Wed Aug 24 05:39:40 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:39:43.402121 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7505d04-9bd5-4a8f-b4d0-019db1c7654c None None] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:43.402707 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7505d04-9bd5-4a8f-b4d0-019db1c7654c None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:43.402707 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7505d04-9bd5-4a8f-b4d0-019db1c7654c None None] PATH_INFO: `/` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:43.404586 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 712/1414] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 05:39:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:39:43.409848 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623a5022-6a86-4615-b661-9303a653c501 None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:43.410309 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623a5022-6a86-4615-b661-9303a653c501 None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:43.410436 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623a5022-6a86-4615-b661-9303a653c501 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:43.476485 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-623a5022-6a86-4615-b661-9303a653c501 None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:39:43.477675 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-623a5022-6a86-4615-b661-9303a653c501 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:39:43.532066 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:43.574098 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 703/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 05:39:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:39:43.864752 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7505d04-9bd5-4a8f-b4d0-019db1c7654c None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:43.866331 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-f7505d04-9bd5-4a8f-b4d0-019db1c7654c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:39:44.011071 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7505d04-9bd5-4a8f-b4d0-019db1c7654c None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:44.082357 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:44.121412 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b279b6-50d7-4830-b009-45c27cca19cc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b633e1aec6c4269bce13aa9c89e911a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:44.122574 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b279b6-50d7-4830-b009-45c27cca19cc service nova] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:44.122849 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b279b6-50d7-4830-b009-45c27cca19cc service nova] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:44.123113 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b279b6-50d7-4830-b009-45c27cca19cc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:44.124698 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-47b279b6-50d7-4830-b009-45c27cca19cc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:39:44.210585 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b279b6-50d7-4830-b009-45c27cca19cc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:44.212221 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b279b6-50d7-4830-b009-45c27cca19cc service nova] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:44.229812 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 713/1416] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 24 05:39:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:39:45.111001 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745d81c0-917e-4cce-8484-e0a0bd8b394a None None] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:45.111928 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745d81c0-917e-4cce-8484-e0a0bd8b394a None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:45.111928 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745d81c0-917e-4cce-8484-e0a0bd8b394a None None] PATH_INFO: `/` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:45.114698 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 704/1417] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 05:39:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:39:45.119903 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95df7c7f-b788-4fcc-9c75-54f0a94241e0 None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:45.120366 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95df7c7f-b788-4fcc-9c75-54f0a94241e0 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:45.120473 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95df7c7f-b788-4fcc-9c75-54f0a94241e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:45.194638 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-95df7c7f-b788-4fcc-9c75-54f0a94241e0 None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:39:45.195840 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-95df7c7f-b788-4fcc-9c75-54f0a94241e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:39:45.223548 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:45.291595 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 714/1418] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 05:39:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:39:45.439884 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745d81c0-917e-4cce-8484-e0a0bd8b394a None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:45.441409 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-745d81c0-917e-4cce-8484-e0a0bd8b394a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:39:45.585360 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745d81c0-917e-4cce-8484-e0a0bd8b394a None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:45.624945 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:45.695807 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653aff02-25c8-4918-a00f-e18fd1e95f14 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b633e1aec6c4269bce13aa9c89e911a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:45.696410 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653aff02-25c8-4918-a00f-e18fd1e95f14 service nova] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:45.696686 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653aff02-25c8-4918-a00f-e18fd1e95f14 service nova] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:45.696954 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653aff02-25c8-4918-a00f-e18fd1e95f14 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:45.698566 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-653aff02-25c8-4918-a00f-e18fd1e95f14 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:39:45.786080 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653aff02-25c8-4918-a00f-e18fd1e95f14 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:45.787711 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653aff02-25c8-4918-a00f-e18fd1e95f14 service nova] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:45.805871 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 705/1419] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 24 05:39:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:39:46.688708 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1432b0-8f44-4d04-a30d-dc49ab71bf53 None None] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:46.689277 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1432b0-8f44-4d04-a30d-dc49ab71bf53 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:46.689277 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1432b0-8f44-4d04-a30d-dc49ab71bf53 None None] PATH_INFO: `/` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:46.690635 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 715/1420] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 05:39:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:39:46.695559 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61400c62-5418-4ace-84cf-c27d918bd567 None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:46.695955 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61400c62-5418-4ace-84cf-c27d918bd567 None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:46.696109 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61400c62-5418-4ace-84cf-c27d918bd567 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:46.750639 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:46.773733 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-61400c62-5418-4ace-84cf-c27d918bd567 None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:39:46.774974 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-61400c62-5418-4ace-84cf-c27d918bd567 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:39:46.869115 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 706/1421] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 05:39:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 05:39:47.019888 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1432b0-8f44-4d04-a30d-dc49ab71bf53 None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:47.021484 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-ed1432b0-8f44-4d04-a30d-dc49ab71bf53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:39:47.165841 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1432b0-8f44-4d04-a30d-dc49ab71bf53 None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:47.178556 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:47.277462 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957f127d-8ebb-47f2-9b63-af25b3cdac16 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b633e1aec6c4269bce13aa9c89e911a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:47.278085 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957f127d-8ebb-47f2-9b63-af25b3cdac16 service nova] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:47.278363 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957f127d-8ebb-47f2-9b63-af25b3cdac16 service nova] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:47.278632 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957f127d-8ebb-47f2-9b63-af25b3cdac16 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:47.280209 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-957f127d-8ebb-47f2-9b63-af25b3cdac16 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:39:47.366874 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957f127d-8ebb-47f2-9b63-af25b3cdac16 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:47.368463 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957f127d-8ebb-47f2-9b63-af25b3cdac16 service nova] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:47.386589 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 716/1422] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 24 05:39:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:39:48.239977 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc839a7-82a5-4702-8b80-520c0a8319a8 None None] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:48.240526 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc839a7-82a5-4702-8b80-520c0a8319a8 None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:48.240526 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc839a7-82a5-4702-8b80-520c0a8319a8 None None] PATH_INFO: `/` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:48.241885 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 707/1423] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 05:39:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:39:48.247198 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe598f50-d9b6-44fe-9552-020c540c6648 None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:48.247605 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe598f50-d9b6-44fe-9552-020c540c6648 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:48.247745 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe598f50-d9b6-44fe-9552-020c540c6648 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:48.267640 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:48.323805 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-fe598f50-d9b6-44fe-9552-020c540c6648 None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:39:48.325638 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-fe598f50-d9b6-44fe-9552-020c540c6648 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:39:48.420342 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 717/1424] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 05:39:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:39:48.569243 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc839a7-82a5-4702-8b80-520c0a8319a8 None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:48.570784 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-5fc839a7-82a5-4702-8b80-520c0a8319a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:39:48.679311 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:48.715351 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc839a7-82a5-4702-8b80-520c0a8319a8 None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:48.826278 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0a8efc-33f2-4f5e-b64e-918b7ec23541 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b633e1aec6c4269bce13aa9c89e911a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:48.826863 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0a8efc-33f2-4f5e-b64e-918b7ec23541 service nova] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:48.827151 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0a8efc-33f2-4f5e-b64e-918b7ec23541 service nova] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:48.827429 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0a8efc-33f2-4f5e-b64e-918b7ec23541 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:48.829031 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-8f0a8efc-33f2-4f5e-b64e-918b7ec23541 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:39:48.902925 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:48.916559 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0a8efc-33f2-4f5e-b64e-918b7ec23541 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:48.918669 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0a8efc-33f2-4f5e-b64e-918b7ec23541 service nova] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:48.936901 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 708/1425] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 24 05:39:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:39:49.791199 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbe2e65-bde8-4c91-92ba-092602fcf303 None None] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:49.791730 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbe2e65-bde8-4c91-92ba-092602fcf303 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:49.791730 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbe2e65-bde8-4c91-92ba-092602fcf303 None None] PATH_INFO: `/` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:49.793037 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 718/1426] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 05:39:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:39:49.798006 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494807b9-87c6-43bd-918f-dee80b5be966 None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:49.798392 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494807b9-87c6-43bd-918f-dee80b5be966 None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:49.798585 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494807b9-87c6-43bd-918f-dee80b5be966 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:49.874525 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-494807b9-87c6-43bd-918f-dee80b5be966 None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:39:49.875721 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-494807b9-87c6-43bd-918f-dee80b5be966 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:39:49.970541 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 709/1427] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 05:39:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:39:50.121072 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbe2e65-bde8-4c91-92ba-092602fcf303 None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:50.123171 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-dbbe2e65-bde8-4c91-92ba-092602fcf303 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:39:50.214464 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:50.286211 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbe2e65-bde8-4c91-92ba-092602fcf303 None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:50.399845 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f956a5-0a10-4728-afbc-7960adda38fe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b633e1aec6c4269bce13aa9c89e911a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:50.400368 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f956a5-0a10-4728-afbc-7960adda38fe service nova] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:50.400645 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f956a5-0a10-4728-afbc-7960adda38fe service nova] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:50.400914 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f956a5-0a10-4728-afbc-7960adda38fe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:50.402971 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-99f956a5-0a10-4728-afbc-7960adda38fe service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:39:50.450202 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:50.492028 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f956a5-0a10-4728-afbc-7960adda38fe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:50.493632 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f956a5-0a10-4728-afbc-7960adda38fe service nova] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:50.511316 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 719/1428] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 24 05:39:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:39:51.306574 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a94ffc2-3fde-44e0-b1bc-ee1179ba8525 None None] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:51.307149 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a94ffc2-3fde-44e0-b1bc-ee1179ba8525 None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:51.307149 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a94ffc2-3fde-44e0-b1bc-ee1179ba8525 None None] PATH_INFO: `/` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:51.308507 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 710/1429] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 05:39:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:39:51.313480 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5338ca8-f61e-4959-b7ff-76d1c48ace9e None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:51.313884 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5338ca8-f61e-4959-b7ff-76d1c48ace9e None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:51.314041 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5338ca8-f61e-4959-b7ff-76d1c48ace9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:51.388350 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-d5338ca8-f61e-4959-b7ff-76d1c48ace9e None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:39:51.389553 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-d5338ca8-f61e-4959-b7ff-76d1c48ace9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:39:51.484088 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 720/1430] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 05:39:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:39:51.633522 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a94ffc2-3fde-44e0-b1bc-ee1179ba8525 None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:51.635005 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-0a94ffc2-3fde-44e0-b1bc-ee1179ba8525 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:39:51.683289 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:51.780516 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a94ffc2-3fde-44e0-b1bc-ee1179ba8525 None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:51.889750 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144c7538-2a6d-482e-9343-097589fdf6ab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b633e1aec6c4269bce13aa9c89e911a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:51.890317 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144c7538-2a6d-482e-9343-097589fdf6ab service nova] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:51.890599 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144c7538-2a6d-482e-9343-097589fdf6ab service nova] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:51.890873 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144c7538-2a6d-482e-9343-097589fdf6ab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:51.892517 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-144c7538-2a6d-482e-9343-097589fdf6ab service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:39:51.899350 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:51.981685 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144c7538-2a6d-482e-9343-097589fdf6ab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:51.983447 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144c7538-2a6d-482e-9343-097589fdf6ab service nova] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:52.001503 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 711/1431] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 24 05:39:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:39:52.798148 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c075e2-e725-493b-bdbb-ac23fe002593 None None] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:52.798704 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c075e2-e725-493b-bdbb-ac23fe002593 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:52.798704 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c075e2-e725-493b-bdbb-ac23fe002593 None None] PATH_INFO: `/` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:52.799960 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 721/1432] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 05:39:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:39:52.805042 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf68bad-6862-40ca-8951-b571dacdb59e None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:52.805478 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf68bad-6862-40ca-8951-b571dacdb59e None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:52.805587 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf68bad-6862-40ca-8951-b571dacdb59e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:52.880619 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-6bf68bad-6862-40ca-8951-b571dacdb59e None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:39:52.881842 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-6bf68bad-6862-40ca-8951-b571dacdb59e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:39:52.947927 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:52.977791 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 712/1433] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 05:39:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:39:53.129997 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c075e2-e725-493b-bdbb-ac23fe002593 None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:53.131442 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-d9c075e2-e725-493b-bdbb-ac23fe002593 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:39:53.148812 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:53.275366 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c075e2-e725-493b-bdbb-ac23fe002593 None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:53.361538 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:53.388414 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255f8c6f-2035-4f33-97ec-faae7051db15 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b633e1aec6c4269bce13aa9c89e911a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:53.388955 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255f8c6f-2035-4f33-97ec-faae7051db15 service nova] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:53.389234 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255f8c6f-2035-4f33-97ec-faae7051db15 service nova] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:53.389502 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255f8c6f-2035-4f33-97ec-faae7051db15 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:53.391138 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-255f8c6f-2035-4f33-97ec-faae7051db15 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:39:53.478912 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255f8c6f-2035-4f33-97ec-faae7051db15 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:53.480561 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255f8c6f-2035-4f33-97ec-faae7051db15 service nova] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:53.499049 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 722/1434] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 24 05:39:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:39:54.300281 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d61e83-fe31-40d2-850d-ab54dc5368bc None None] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:54.300711 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d61e83-fe31-40d2-850d-ab54dc5368bc None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:54.300818 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d61e83-fe31-40d2-850d-ab54dc5368bc None None] PATH_INFO: `/` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:54.302207 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 713/1435] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 05:39:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:39:54.307400 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335f1491-20a4-43dc-a6e0-2fc330bc78aa None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:54.307834 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335f1491-20a4-43dc-a6e0-2fc330bc78aa None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:54.307982 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335f1491-20a4-43dc-a6e0-2fc330bc78aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:54.383339 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-335f1491-20a4-43dc-a6e0-2fc330bc78aa None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:39:54.384563 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-335f1491-20a4-43dc-a6e0-2fc330bc78aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:39:54.424894 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:54.479500 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 723/1436] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 05:39:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:39:54.630413 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d61e83-fe31-40d2-850d-ab54dc5368bc None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:54.631928 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-66d61e83-fe31-40d2-850d-ab54dc5368bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:39:54.775189 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d61e83-fe31-40d2-850d-ab54dc5368bc None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:54.828874 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:54.886767 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd45c833-abe5-44b3-a53f-5df8a35332be service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b633e1aec6c4269bce13aa9c89e911a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:54.887391 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd45c833-abe5-44b3-a53f-5df8a35332be service nova] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:54.887676 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd45c833-abe5-44b3-a53f-5df8a35332be service nova] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:54.887946 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd45c833-abe5-44b3-a53f-5df8a35332be service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:54.889540 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-bd45c833-abe5-44b3-a53f-5df8a35332be service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:39:54.976728 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd45c833-abe5-44b3-a53f-5df8a35332be service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:54.978464 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd45c833-abe5-44b3-a53f-5df8a35332be service nova] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:54.997498 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 714/1437] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 24 05:39:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:39:55.791267 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f50b86d-0cb8-4d2c-b6a3-203296188237 None None] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:55.791893 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f50b86d-0cb8-4d2c-b6a3-203296188237 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:55.791893 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f50b86d-0cb8-4d2c-b6a3-203296188237 None None] PATH_INFO: `/` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:55.793069 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 724/1438] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 05:39:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:39:55.798023 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee77157-5374-4fb0-b4fb-4e5ef3cdfcad None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:55.798411 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee77157-5374-4fb0-b4fb-4e5ef3cdfcad None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:55.798569 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee77157-5374-4fb0-b4fb-4e5ef3cdfcad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:55.877744 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-1ee77157-5374-4fb0-b4fb-4e5ef3cdfcad None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:39:55.878999 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-1ee77157-5374-4fb0-b4fb-4e5ef3cdfcad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:39:55.881090 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:55.975912 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 715/1439] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 05:39:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:39:56.126401 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f50b86d-0cb8-4d2c-b6a3-203296188237 None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:56.127869 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-4f50b86d-0cb8-4d2c-b6a3-203296188237 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:39:56.271930 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f50b86d-0cb8-4d2c-b6a3-203296188237 None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:56.298500 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:56.384124 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9aa4d94-78cd-430d-a9c7-f61370ebf2ff service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b633e1aec6c4269bce13aa9c89e911a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:56.384651 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aa4d94-78cd-430d-a9c7-f61370ebf2ff service nova] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:56.384959 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aa4d94-78cd-430d-a9c7-f61370ebf2ff service nova] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:56.385226 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aa4d94-78cd-430d-a9c7-f61370ebf2ff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:56.386941 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-b9aa4d94-78cd-430d-a9c7-f61370ebf2ff service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:39:56.474583 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9aa4d94-78cd-430d-a9c7-f61370ebf2ff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:56.476185 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9aa4d94-78cd-430d-a9c7-f61370ebf2ff service nova] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:56.494489 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 725/1440] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 24 05:39:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:39:58.299752 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2e6c56-7fab-4ac9-b1f5-f590f5c220d3 None None] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:58.300164 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2e6c56-7fab-4ac9-b1f5-f590f5c220d3 None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:58.300306 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2e6c56-7fab-4ac9-b1f5-f590f5c220d3 None None] PATH_INFO: `/` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:58.301663 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 716/1441] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 05:39:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:39:58.307444 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf4f40c-2eaa-4950-8e13-55d0e3fb6cc8 None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:58.307858 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf4f40c-2eaa-4950-8e13-55d0e3fb6cc8 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:58.307998 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf4f40c-2eaa-4950-8e13-55d0e3fb6cc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:58.349588 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:58.376197 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-dbf4f40c-2eaa-4950-8e13-55d0e3fb6cc8 None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:39:58.377402 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-dbf4f40c-2eaa-4950-8e13-55d0e3fb6cc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:39:58.473791 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 726/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 05:39:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:39:58.758686 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2e6c56-7fab-4ac9-b1f5-f590f5c220d3 None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:39:58.760236 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-ef2e6c56-7fab-4ac9-b1f5-f590f5c220d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:39:58.861242 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2e6c56-7fab-4ac9-b1f5-f590f5c220d3 None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:39:58.893169 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:58.933625 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956506bd-3161-4597-b76b-f6cb5c6062d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '874348b647194ac2b5ecbf12c33bf59e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:39:58.934289 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956506bd-3161-4597-b76b-f6cb5c6062d7 service neutron] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:39:58.934568 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956506bd-3161-4597-b76b-f6cb5c6062d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:39:58.934834 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956506bd-3161-4597-b76b-f6cb5c6062d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:39:58.936985 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-956506bd-3161-4597-b76b-f6cb5c6062d7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:39:59.042798 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956506bd-3161-4597-b76b-f6cb5c6062d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:39:59.044221 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956506bd-3161-4597-b76b-f6cb5c6062d7 service neutron] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:39:59.062794 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 717/1443] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 24 05:39:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:40:01.093919 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee53f51d-7ce1-4c7a-94f3-d2e7d31160c2 None None] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:01.094579 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee53f51d-7ce1-4c7a-94f3-d2e7d31160c2 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:01.094579 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee53f51d-7ce1-4c7a-94f3-d2e7d31160c2 None None] PATH_INFO: `/` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:01.095817 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 727/1444] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 05:40:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:40:01.100969 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9788ff2-a7b0-45a9-9a25-e720e007bdd3 None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:01.101426 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9788ff2-a7b0-45a9-9a25-e720e007bdd3 None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:01.101537 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9788ff2-a7b0-45a9-9a25-e720e007bdd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:01.168044 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-c9788ff2-a7b0-45a9-9a25-e720e007bdd3 None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:40:01.169196 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-c9788ff2-a7b0-45a9-9a25-e720e007bdd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:40:01.182517 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:01.266202 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 718/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 05:40:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:40:01.550870 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee53f51d-7ce1-4c7a-94f3-d2e7d31160c2 None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:01.552498 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-ee53f51d-7ce1-4c7a-94f3-d2e7d31160c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:40:01.654168 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee53f51d-7ce1-4c7a-94f3-d2e7d31160c2 None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:01.666064 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:01.727876 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848abde8-28f4-4707-a281-12397339fed5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '874348b647194ac2b5ecbf12c33bf59e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:01.728477 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848abde8-28f4-4707-a281-12397339fed5 service neutron] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:01.728760 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848abde8-28f4-4707-a281-12397339fed5 service neutron] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:01.729033 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848abde8-28f4-4707-a281-12397339fed5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:01.730665 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-848abde8-28f4-4707-a281-12397339fed5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:40:01.838401 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848abde8-28f4-4707-a281-12397339fed5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:01.839759 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848abde8-28f4-4707-a281-12397339fed5 service neutron] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:01.858311 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 728/1446] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 24 05:40:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:40:04.040450 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc6adf9-fc37-4d44-aadb-a7c9065dafa3 None None] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:04.040989 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc6adf9-fc37-4d44-aadb-a7c9065dafa3 None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:04.040989 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc6adf9-fc37-4d44-aadb-a7c9065dafa3 None None] PATH_INFO: `/` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:04.042427 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 719/1447] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 05:40:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:40:04.047631 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9066e9-09f1-426d-ac49-3799edca7cc6 None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:04.048049 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9066e9-09f1-426d-ac49-3799edca7cc6 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:04.048181 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9066e9-09f1-426d-ac49-3799edca7cc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:04.095982 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:04.114052 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-1d9066e9-09f1-426d-ac49-3799edca7cc6 None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:40:04.115281 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-1d9066e9-09f1-426d-ac49-3799edca7cc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:40:04.211051 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 729/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 05:40:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:40:04.492358 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc6adf9-fc37-4d44-aadb-a7c9065dafa3 None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:04.493982 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-bcc6adf9-fc37-4d44-aadb-a7c9065dafa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:40:04.598041 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc6adf9-fc37-4d44-aadb-a7c9065dafa3 None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:04.638108 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:04.672772 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2a162e-7073-484d-8e00-e4fc8b95a92c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '874348b647194ac2b5ecbf12c33bf59e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:04.673503 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2a162e-7073-484d-8e00-e4fc8b95a92c service neutron] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:04.673786 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2a162e-7073-484d-8e00-e4fc8b95a92c service neutron] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:04.674093 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2a162e-7073-484d-8e00-e4fc8b95a92c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:04.675686 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-0e2a162e-7073-484d-8e00-e4fc8b95a92c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:40:04.781330 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2a162e-7073-484d-8e00-e4fc8b95a92c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:04.782815 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2a162e-7073-484d-8e00-e4fc8b95a92c service neutron] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:04.800223 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 720/1449] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 24 05:40:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:40:06.812381 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa2ce58-c36b-469d-a620-eedfc304585a None None] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:06.812970 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa2ce58-c36b-469d-a620-eedfc304585a None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:06.812970 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa2ce58-c36b-469d-a620-eedfc304585a None None] PATH_INFO: `/` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:06.814280 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 730/1450] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 05:40:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:40:06.819583 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b98389-9144-4b0a-aa74-3a1d393152fd None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:06.819999 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b98389-9144-4b0a-aa74-3a1d393152fd None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:06.820141 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b98389-9144-4b0a-aa74-3a1d393152fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:06.885350 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-57b98389-9144-4b0a-aa74-3a1d393152fd None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:40:06.886590 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-57b98389-9144-4b0a-aa74-3a1d393152fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:40:06.907730 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:06.983569 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 721/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 05:40:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:40:07.268183 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa2ce58-c36b-469d-a620-eedfc304585a None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:07.269748 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-3aa2ce58-c36b-469d-a620-eedfc304585a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:40:07.370728 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa2ce58-c36b-469d-a620-eedfc304585a None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:07.390764 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:07.444504 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98772d9-04cd-4579-a3f9-c36246108594 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '874348b647194ac2b5ecbf12c33bf59e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:07.445108 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98772d9-04cd-4579-a3f9-c36246108594 service neutron] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:07.445387 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98772d9-04cd-4579-a3f9-c36246108594 service neutron] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:07.445657 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98772d9-04cd-4579-a3f9-c36246108594 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:07.447281 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-d98772d9-04cd-4579-a3f9-c36246108594 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:40:07.555798 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98772d9-04cd-4579-a3f9-c36246108594 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:07.557246 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98772d9-04cd-4579-a3f9-c36246108594 service neutron] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:07.575279 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 731/1452] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 24 05:40:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:40:09.500607 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754b3f4d-482d-43e2-8ac5-324168ddd7ae None None] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:09.501184 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754b3f4d-482d-43e2-8ac5-324168ddd7ae None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:09.501184 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754b3f4d-482d-43e2-8ac5-324168ddd7ae None None] PATH_INFO: `/` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:09.502544 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 722/1453] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 05:40:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:40:09.507951 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7adeb7-193d-431a-8ce8-d43e583fa52a None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:09.508354 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7adeb7-193d-431a-8ce8-d43e583fa52a None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:09.508474 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7adeb7-193d-431a-8ce8-d43e583fa52a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:09.571349 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:09.574191 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-1b7adeb7-193d-431a-8ce8-d43e583fa52a None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:40:09.575929 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-1b7adeb7-193d-431a-8ce8-d43e583fa52a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:40:09.671451 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 732/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 05:40:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:40:09.952601 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754b3f4d-482d-43e2-8ac5-324168ddd7ae None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:09.954200 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-754b3f4d-482d-43e2-8ac5-324168ddd7ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:40:10.175523 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754b3f4d-482d-43e2-8ac5-324168ddd7ae None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:10.223870 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:10.248575 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8479ad34-e308-49cb-9880-8d1a88bc18fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '874348b647194ac2b5ecbf12c33bf59e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:10.249175 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8479ad34-e308-49cb-9880-8d1a88bc18fa service neutron] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:10.249449 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8479ad34-e308-49cb-9880-8d1a88bc18fa service neutron] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:10.249717 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8479ad34-e308-49cb-9880-8d1a88bc18fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:10.251320 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-8479ad34-e308-49cb-9880-8d1a88bc18fa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:40:10.359834 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8479ad34-e308-49cb-9880-8d1a88bc18fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:10.361289 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8479ad34-e308-49cb-9880-8d1a88bc18fa service neutron] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:10.379383 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 723/1455] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 24 05:40:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:40:12.329243 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5b5229-36f0-46c7-9a5a-874fe90ef117 None None] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:12.329801 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5b5229-36f0-46c7-9a5a-874fe90ef117 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:12.329801 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5b5229-36f0-46c7-9a5a-874fe90ef117 None None] PATH_INFO: `/` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:12.331160 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 733/1456] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 05:40:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:40:12.336588 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7ef8ea-22bd-4642-aa12-ff68ed2d5db2 None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:12.337018 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7ef8ea-22bd-4642-aa12-ff68ed2d5db2 None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:12.337156 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7ef8ea-22bd-4642-aa12-ff68ed2d5db2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:12.403657 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-3d7ef8ea-22bd-4642-aa12-ff68ed2d5db2 None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:40:12.404863 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-3d7ef8ea-22bd-4642-aa12-ff68ed2d5db2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:40:12.432599 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:12.500363 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 724/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 05:40:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:40:12.786797 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5b5229-36f0-46c7-9a5a-874fe90ef117 None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:12.788355 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-de5b5229-36f0-46c7-9a5a-874fe90ef117 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:40:12.889780 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5b5229-36f0-46c7-9a5a-874fe90ef117 None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:12.917343 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:12.962547 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e8902e-5840-48ba-97e2-b398187acf3c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '874348b647194ac2b5ecbf12c33bf59e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:12.963084 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e8902e-5840-48ba-97e2-b398187acf3c service neutron] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:12.963363 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e8902e-5840-48ba-97e2-b398187acf3c service neutron] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:12.963635 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e8902e-5840-48ba-97e2-b398187acf3c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:12.965230 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-a0e8902e-5840-48ba-97e2-b398187acf3c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:40:13.071984 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e8902e-5840-48ba-97e2-b398187acf3c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:13.073404 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e8902e-5840-48ba-97e2-b398187acf3c service neutron] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:13.091333 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 734/1458] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 24 05:40:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:40:15.041824 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a347d4-9358-4fb7-9022-2342f0a022af None None] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:15.042450 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a347d4-9358-4fb7-9022-2342f0a022af None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:15.042450 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a347d4-9358-4fb7-9022-2342f0a022af None None] PATH_INFO: `/` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:15.043756 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 725/1459] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 05:40:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:40:15.049533 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314119d4-2a24-4bd3-8f67-4c7d1092556e None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:15.049981 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314119d4-2a24-4bd3-8f67-4c7d1092556e None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:15.050108 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314119d4-2a24-4bd3-8f67-4c7d1092556e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:15.116637 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-314119d4-2a24-4bd3-8f67-4c7d1092556e None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:40:15.117827 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-314119d4-2a24-4bd3-8f67-4c7d1092556e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:40:15.126507 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:15.214017 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 735/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 05:40:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:40:15.493076 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a347d4-9358-4fb7-9022-2342f0a022af None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:15.494684 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-08a347d4-9358-4fb7-9022-2342f0a022af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:40:15.597297 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a347d4-9358-4fb7-9022-2342f0a022af None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:15.650530 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:15.669037 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16db304c-716e-4cd0-abb0-7f56de578189 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '874348b647194ac2b5ecbf12c33bf59e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:15.669637 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16db304c-716e-4cd0-abb0-7f56de578189 service neutron] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:15.669913 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16db304c-716e-4cd0-abb0-7f56de578189 service neutron] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:15.670242 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16db304c-716e-4cd0-abb0-7f56de578189 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:15.671820 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-16db304c-716e-4cd0-abb0-7f56de578189 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:40:15.777831 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16db304c-716e-4cd0-abb0-7f56de578189 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:15.779235 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16db304c-716e-4cd0-abb0-7f56de578189 service neutron] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:15.797328 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 726/1461] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 24 05:40:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:40:17.831866 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990d22fe-0eab-465e-bc06-ab936e28de85 None None] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:17.832408 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990d22fe-0eab-465e-bc06-ab936e28de85 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:17.832408 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990d22fe-0eab-465e-bc06-ab936e28de85 None None] PATH_INFO: `/` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:17.833670 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 736/1462] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 05:40:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:40:17.838901 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87baab46-31cd-4a78-9e2a-55c775dd671b None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:17.839282 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87baab46-31cd-4a78-9e2a-55c775dd671b None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:17.839452 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87baab46-31cd-4a78-9e2a-55c775dd671b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:17.903717 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-87baab46-31cd-4a78-9e2a-55c775dd671b None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:40:17.904914 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-87baab46-31cd-4a78-9e2a-55c775dd671b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:40:17.944104 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:18.002641 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 727/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 05:40:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:40:18.288585 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990d22fe-0eab-465e-bc06-ab936e28de85 None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:18.290159 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-990d22fe-0eab-465e-bc06-ab936e28de85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:40:18.391412 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990d22fe-0eab-465e-bc06-ab936e28de85 None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:18.428383 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:18.463830 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcb42b2-42e7-4e27-a97f-05c51961edc3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '874348b647194ac2b5ecbf12c33bf59e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:18.464425 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcb42b2-42e7-4e27-a97f-05c51961edc3 service neutron] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:18.464701 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcb42b2-42e7-4e27-a97f-05c51961edc3 service neutron] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:18.464971 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcb42b2-42e7-4e27-a97f-05c51961edc3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:18.466645 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-4bcb42b2-42e7-4e27-a97f-05c51961edc3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:40:18.575786 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcb42b2-42e7-4e27-a97f-05c51961edc3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:18.577717 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcb42b2-42e7-4e27-a97f-05c51961edc3 service neutron] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:18.596037 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 737/1464] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 24 05:40:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:40:20.496889 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b98de3d-b371-4c40-a4cd-585cf1196775 None None] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:20.497444 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b98de3d-b371-4c40-a4cd-585cf1196775 None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:20.497444 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b98de3d-b371-4c40-a4cd-585cf1196775 None None] PATH_INFO: `/` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:20.498854 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 728/1465] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 05:40:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:40:20.504249 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629c96f0-e3e7-4159-b8a6-d8e1ac8bb83d None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:20.504651 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629c96f0-e3e7-4159-b8a6-d8e1ac8bb83d None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:20.504800 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629c96f0-e3e7-4159-b8a6-d8e1ac8bb83d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:20.571022 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-629c96f0-e3e7-4159-b8a6-d8e1ac8bb83d None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:40:20.572171 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-629c96f0-e3e7-4159-b8a6-d8e1ac8bb83d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:40:20.591169 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:20.669846 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 738/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 05:40:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:40:20.956169 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b98de3d-b371-4c40-a4cd-585cf1196775 None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:20.957723 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-9b98de3d-b371-4c40-a4cd-585cf1196775 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:40:21.058253 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b98de3d-b371-4c40-a4cd-585cf1196775 None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:21.123090 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:21.131025 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51229b26-765d-4bb8-83a4-7b6e74118de3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '874348b647194ac2b5ecbf12c33bf59e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:21.131627 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51229b26-765d-4bb8-83a4-7b6e74118de3 service neutron] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:21.131905 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51229b26-765d-4bb8-83a4-7b6e74118de3 service neutron] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:21.132173 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51229b26-765d-4bb8-83a4-7b6e74118de3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:21.133764 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-51229b26-765d-4bb8-83a4-7b6e74118de3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:40:21.240576 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51229b26-765d-4bb8-83a4-7b6e74118de3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:21.241925 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51229b26-765d-4bb8-83a4-7b6e74118de3 service neutron] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:21.259265 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 729/1467] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 24 05:40:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:40:23.153997 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f23729-c3bb-4d2f-8eab-5dbffa5b3a37 None None] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:23.154569 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f23729-c3bb-4d2f-8eab-5dbffa5b3a37 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:23.154569 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f23729-c3bb-4d2f-8eab-5dbffa5b3a37 None None] PATH_INFO: `/` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:23.156476 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 739/1468] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 05:40:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:40:23.161835 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa7f5a4-0197-4d05-8e24-981a990eea7f None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:23.162331 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa7f5a4-0197-4d05-8e24-981a990eea7f None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:23.162462 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa7f5a4-0197-4d05-8e24-981a990eea7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:23.226997 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-8aa7f5a4-0197-4d05-8e24-981a990eea7f None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:40:23.228188 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-8aa7f5a4-0197-4d05-8e24-981a990eea7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:40:23.274314 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:23.321779 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 730/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 05:40:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:40:23.603324 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f23729-c3bb-4d2f-8eab-5dbffa5b3a37 None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:23.604916 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-59f23729-c3bb-4d2f-8eab-5dbffa5b3a37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:40:23.708572 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f23729-c3bb-4d2f-8eab-5dbffa5b3a37 None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:23.754568 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:23.781318 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bfdb39-dd29-458d-b75a-57717765f94b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '874348b647194ac2b5ecbf12c33bf59e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:23.782099 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bfdb39-dd29-458d-b75a-57717765f94b service neutron] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:23.782263 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bfdb39-dd29-458d-b75a-57717765f94b service neutron] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:23.782571 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bfdb39-dd29-458d-b75a-57717765f94b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:23.784189 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-34bfdb39-dd29-458d-b75a-57717765f94b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:40:23.892593 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bfdb39-dd29-458d-b75a-57717765f94b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:23.894051 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bfdb39-dd29-458d-b75a-57717765f94b service neutron] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:23.911500 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 740/1470] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 24 05:40:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:40:33.320010 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=22 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:33.909230 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=66 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:43.262723 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9588d35-dff2-4e9a-a3ce-ce5e4c561151 None None] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:43.263293 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9588d35-dff2-4e9a-a3ce-ce5e4c561151 None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:43.263293 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9588d35-dff2-4e9a-a3ce-ce5e4c561151 None None] PATH_INFO: `/` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:43.264632 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 731/1471] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 24 05:40:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:40:43.269811 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5da9307-043e-4225-9c9d-410da4f8b9dd None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:43.270258 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5da9307-043e-4225-9c9d-410da4f8b9dd None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:43.270447 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5da9307-043e-4225-9c9d-410da4f8b9dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:43.335946 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-a5da9307-043e-4225-9c9d-410da4f8b9dd None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:40:43.337142 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-a5da9307-043e-4225-9c9d-410da4f8b9dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:40:43.431567 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 741/1472] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 24 05:40:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:40:43.738718 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05db7a4f-1fa6-456c-aa65-fabc42409ba5 None None] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:43.739052 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05db7a4f-1fa6-456c-aa65-fabc42409ba5 None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:43.739284 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05db7a4f-1fa6-456c-aa65-fabc42409ba5 None None] PATH_INFO: `/` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:43.740844 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 732/1473] 10.222.0.26 () {54 vars in 967 bytes} [Wed Aug 24 05:40:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:40:43.746222 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cde4fb2-9528-4ff9-adf3-87f70f8f2e67 None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:43.746512 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cde4fb2-9528-4ff9-adf3-87f70f8f2e67 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:43.746786 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cde4fb2-9528-4ff9-adf3-87f70f8f2e67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:43.830213 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-2cde4fb2-9528-4ff9-adf3-87f70f8f2e67 None None] MFA Rules not processed for user `7f856958add7474a989325cea7b1b224`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:40:43.831361 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-2cde4fb2-9528-4ff9-adf3-87f70f8f2e67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:40:43.852214 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:43.909874 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 742/1474] 10.222.0.26 () {58 vars in 1064 bytes} [Wed Aug 24 05:40:43 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:40:43.917526 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05db7a4f-1fa6-456c-aa65-fabc42409ba5 None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:43.919098 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-05db7a4f-1fa6-456c-aa65-fabc42409ba5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:40:44.022674 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05db7a4f-1fa6-456c-aa65-fabc42409ba5 None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:44.094612 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb771624-f417-4c8e-b7e8-12ef8587f4b7 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f856958add7474a989325cea7b1b224', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:44.095133 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb771624-f417-4c8e-b7e8-12ef8587f4b7 service glance] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:44.095410 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb771624-f417-4c8e-b7e8-12ef8587f4b7 service glance] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:44.095680 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb771624-f417-4c8e-b7e8-12ef8587f4b7 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:44.097274 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-bb771624-f417-4c8e-b7e8-12ef8587f4b7 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:40:44.148976 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:44.204286 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb771624-f417-4c8e-b7e8-12ef8587f4b7 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:44.205723 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb771624-f417-4c8e-b7e8-12ef8587f4b7 service glance] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:44.224448 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 733/1475] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 24 05:40:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:40:46.199593 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d29ed3d-8489-4d5e-aeb2-2b706ace1a79 None None] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:46.200175 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d29ed3d-8489-4d5e-aeb2-2b706ace1a79 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:46.200175 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d29ed3d-8489-4d5e-aeb2-2b706ace1a79 None None] PATH_INFO: `/` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:46.201472 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 743/1476] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 24 05:40:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:40:46.207589 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d272f5d1-a4d3-44f8-9589-51284e1e0e5f None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:46.208007 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d272f5d1-a4d3-44f8-9589-51284e1e0e5f None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:46.208179 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d272f5d1-a4d3-44f8-9589-51284e1e0e5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:46.272646 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-d272f5d1-a4d3-44f8-9589-51284e1e0e5f None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:40:46.273843 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-d272f5d1-a4d3-44f8-9589-51284e1e0e5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:40:46.369260 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 734/1477] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 24 05:40:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:40:46.642054 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d29ed3d-8489-4d5e-aeb2-2b706ace1a79 None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:46.643605 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-1d29ed3d-8489-4d5e-aeb2-2b706ace1a79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:40:46.773387 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d29ed3d-8489-4d5e-aeb2-2b706ace1a79 None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:46.822411 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:46.868014 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed2a860-68f2-4c5a-b9f9-4e3fea448727 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:46.868622 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed2a860-68f2-4c5a-b9f9-4e3fea448727 admin admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:46.868905 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed2a860-68f2-4c5a-b9f9-4e3fea448727 admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:46.869179 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed2a860-68f2-4c5a-b9f9-4e3fea448727 admin admin] PATH_INFO: `/v3/projects` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:46.869816 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed2a860-68f2-4c5a-b9f9-4e3fea448727 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:46.871655 dv-cinder-854268-1-smb devstack@keystone.service[88113]: WARNING py.warnings [None req-4ed2a860-68f2-4c5a-b9f9-4e3fea448727 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 05:40:46.871655 dv-cinder-854268-1-smb devstack@keystone.service[88113]: warnings.warn(msg) Aug 24 05:40:46.871655 dv-cinder-854268-1-smb devstack@keystone.service[88113]: Aug 24 05:40:46.872799 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed2a860-68f2-4c5a-b9f9-4e3fea448727 admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:46.891424 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 744/1478] 10.222.0.26 () {56 vars in 1108 bytes} [Wed Aug 24 05:40:46 2022] GET /identity/v3/projects => generated 2553 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:40:48.816715 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074383e4-1934-4e83-8643-1075c6cb2882 None None] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:48.817284 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074383e4-1934-4e83-8643-1075c6cb2882 None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:48.817284 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074383e4-1934-4e83-8643-1075c6cb2882 None None] PATH_INFO: `/` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:48.818642 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 735/1479] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 24 05:40:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:40:48.824110 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf59a0c6-5097-41e9-8209-c5d48c38a41c None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:48.824511 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf59a0c6-5097-41e9-8209-c5d48c38a41c None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:48.824746 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf59a0c6-5097-41e9-8209-c5d48c38a41c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:48.888859 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-bf59a0c6-5097-41e9-8209-c5d48c38a41c None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:40:48.890080 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-bf59a0c6-5097-41e9-8209-c5d48c38a41c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:40:48.986961 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 745/1480] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 24 05:40:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:40:49.277092 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074383e4-1934-4e83-8643-1075c6cb2882 None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:49.278662 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-074383e4-1934-4e83-8643-1075c6cb2882 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:40:49.288920 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:49.423345 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074383e4-1934-4e83-8643-1075c6cb2882 None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:49.503401 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:49.538573 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a919c398-abfd-4df2-812c-e34c37765308 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b633e1aec6c4269bce13aa9c89e911a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:49.539106 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a919c398-abfd-4df2-812c-e34c37765308 service nova] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:49.539815 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a919c398-abfd-4df2-812c-e34c37765308 service nova] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:49.539815 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a919c398-abfd-4df2-812c-e34c37765308 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:49.541268 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-a919c398-abfd-4df2-812c-e34c37765308 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:40:49.629445 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a919c398-abfd-4df2-812c-e34c37765308 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:49.631046 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a919c398-abfd-4df2-812c-e34c37765308 service nova] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:49.648881 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 736/1481] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 24 05:40:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:40:51.699255 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9b791d-c377-4f06-a24c-db68c2235a95 None None] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:51.699831 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9b791d-c377-4f06-a24c-db68c2235a95 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:51.699831 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9b791d-c377-4f06-a24c-db68c2235a95 None None] PATH_INFO: `/` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:51.701131 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 746/1482] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 24 05:40:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:40:51.707182 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469db598-31f4-451d-a8fc-41e276f0a4f5 None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:51.707602 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469db598-31f4-451d-a8fc-41e276f0a4f5 None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:51.707725 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469db598-31f4-451d-a8fc-41e276f0a4f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:51.772833 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-469db598-31f4-451d-a8fc-41e276f0a4f5 None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:40:51.774106 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-469db598-31f4-451d-a8fc-41e276f0a4f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:40:51.819847 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:51.869599 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 737/1483] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 24 05:40:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:40:52.153825 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9b791d-c377-4f06-a24c-db68c2235a95 None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:52.155392 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-5b9b791d-c377-4f06-a24c-db68c2235a95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:40:52.178068 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:52.257360 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9b791d-c377-4f06-a24c-db68c2235a95 None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:52.329159 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac2f3a1-74fa-4632-93a3-5418eb7a5f75 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '874348b647194ac2b5ecbf12c33bf59e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:52.329760 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac2f3a1-74fa-4632-93a3-5418eb7a5f75 service neutron] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:52.330072 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac2f3a1-74fa-4632-93a3-5418eb7a5f75 service neutron] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:52.330337 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac2f3a1-74fa-4632-93a3-5418eb7a5f75 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:52.331926 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-6ac2f3a1-74fa-4632-93a3-5418eb7a5f75 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:40:52.405888 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:52.441802 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac2f3a1-74fa-4632-93a3-5418eb7a5f75 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:52.443273 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac2f3a1-74fa-4632-93a3-5418eb7a5f75 service neutron] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:52.460967 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 747/1484] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 24 05:40:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 05:40:54.396863 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7994786e-f401-4248-b179-32d304a11b83 None None] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:54.397415 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7994786e-f401-4248-b179-32d304a11b83 None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:54.397415 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7994786e-f401-4248-b179-32d304a11b83 None None] PATH_INFO: `/` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:54.398856 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 738/1485] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 24 05:40:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:40:54.404157 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf3e461-bdd7-4457-8eb4-aee5b3a824f8 None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:54.404581 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf3e461-bdd7-4457-8eb4-aee5b3a824f8 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:54.404719 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf3e461-bdd7-4457-8eb4-aee5b3a824f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:54.469804 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-3bf3e461-bdd7-4457-8eb4-aee5b3a824f8 None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:40:54.471018 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-3bf3e461-bdd7-4457-8eb4-aee5b3a824f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:40:54.567776 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 748/1486] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 24 05:40:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:40:54.850934 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7994786e-f401-4248-b179-32d304a11b83 None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:54.852455 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-7994786e-f401-4248-b179-32d304a11b83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:40:54.953862 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7994786e-f401-4248-b179-32d304a11b83 None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:55.024603 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:55.026470 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8778f4b-6be5-45a4-8cb4-d05bbaafe67d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '874348b647194ac2b5ecbf12c33bf59e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:55.027254 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8778f4b-6be5-45a4-8cb4-d05bbaafe67d service neutron] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:55.027575 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8778f4b-6be5-45a4-8cb4-d05bbaafe67d service neutron] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:55.027994 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8778f4b-6be5-45a4-8cb4-d05bbaafe67d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:55.029787 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-a8778f4b-6be5-45a4-8cb4-d05bbaafe67d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:40:55.138402 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8778f4b-6be5-45a4-8cb4-d05bbaafe67d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:55.139756 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8778f4b-6be5-45a4-8cb4-d05bbaafe67d service neutron] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:55.158082 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 739/1487] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 24 05:40:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:40:57.151481 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a315e3ef-fd1f-49ed-850b-6e1b5e3aeeca None None] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:57.152037 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a315e3ef-fd1f-49ed-850b-6e1b5e3aeeca None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:57.152037 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a315e3ef-fd1f-49ed-850b-6e1b5e3aeeca None None] PATH_INFO: `/` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:57.153340 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 749/1488] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 24 05:40:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:40:57.158678 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65670e2d-08d5-4570-a86a-07a3777ef505 None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:57.159115 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65670e2d-08d5-4570-a86a-07a3777ef505 None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:57.159216 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65670e2d-08d5-4570-a86a-07a3777ef505 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:57.226209 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-65670e2d-08d5-4570-a86a-07a3777ef505 None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:40:57.227414 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-65670e2d-08d5-4570-a86a-07a3777ef505 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:40:57.278389 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:57.322756 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 740/1489] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 24 05:40:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 05:40:57.615503 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a315e3ef-fd1f-49ed-850b-6e1b5e3aeeca None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:40:57.617058 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-a315e3ef-fd1f-49ed-850b-6e1b5e3aeeca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:40:57.653020 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:57.721901 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a315e3ef-fd1f-49ed-850b-6e1b5e3aeeca None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:40:57.792969 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8ed1f0-87ea-4506-9e2a-e36d828022cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '874348b647194ac2b5ecbf12c33bf59e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:40:57.793508 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8ed1f0-87ea-4506-9e2a-e36d828022cf service neutron] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:57.793786 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8ed1f0-87ea-4506-9e2a-e36d828022cf service neutron] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:57.794089 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8ed1f0-87ea-4506-9e2a-e36d828022cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:57.795698 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-4e8ed1f0-87ea-4506-9e2a-e36d828022cf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:40:57.873890 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:57.902838 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8ed1f0-87ea-4506-9e2a-e36d828022cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:40:57.904267 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8ed1f0-87ea-4506-9e2a-e36d828022cf service neutron] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:40:57.922306 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 750/1490] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 24 05:40:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:40:59.975068 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ac5174-7235-4a7d-86dc-57f726c0d2f0 None None] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:59.975629 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ac5174-7235-4a7d-86dc-57f726c0d2f0 None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:59.975629 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ac5174-7235-4a7d-86dc-57f726c0d2f0 None None] PATH_INFO: `/` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:40:59.976992 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 741/1491] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 24 05:40:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:40:59.982103 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdd4240-6e5d-4ad0-8846-7d445f72e089 None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:40:59.982541 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdd4240-6e5d-4ad0-8846-7d445f72e089 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:40:59.982686 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdd4240-6e5d-4ad0-8846-7d445f72e089 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:00.049710 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-4bdd4240-6e5d-4ad0-8846-7d445f72e089 None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:41:00.050957 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-4bdd4240-6e5d-4ad0-8846-7d445f72e089 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:41:00.145249 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 751/1492] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 24 05:40:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:41:00.431396 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ac5174-7235-4a7d-86dc-57f726c0d2f0 None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:41:00.432949 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-24ac5174-7235-4a7d-86dc-57f726c0d2f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:41:00.535222 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ac5174-7235-4a7d-86dc-57f726c0d2f0 None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:41:00.607754 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf09e11-09cb-49b4-a513-080de81f2963 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '874348b647194ac2b5ecbf12c33bf59e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:41:00.608280 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf09e11-09cb-49b4-a513-080de81f2963 service neutron] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:41:00.608553 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf09e11-09cb-49b4-a513-080de81f2963 service neutron] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:41:00.608818 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf09e11-09cb-49b4-a513-080de81f2963 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:41:00.611010 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-1cf09e11-09cb-49b4-a513-080de81f2963 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:41:00.619732 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:41:00.718279 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf09e11-09cb-49b4-a513-080de81f2963 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:41:00.719718 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf09e11-09cb-49b4-a513-080de81f2963 service neutron] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:41:00.738038 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 742/1493] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 24 05:41:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:41:10.143496 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=82 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:41:10.735716 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=50 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:42:10.564702 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b001925-e588-431c-b359-d576e2b160ac None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:42:10.565151 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b001925-e588-431c-b359-d576e2b160ac None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:42:10.565264 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b001925-e588-431c-b359-d576e2b160ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:42:10.639670 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-9b001925-e588-431c-b359-d576e2b160ac None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:42:10.640795 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-9b001925-e588-431c-b359-d576e2b160ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:42:10.735661 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 752/1494] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:42:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:42:10.743682 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48e7871-0dfc-4349-9186-1ba2e6e4bc35 None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:42:10.744179 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48e7871-0dfc-4349-9186-1ba2e6e4bc35 None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:42:10.744286 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48e7871-0dfc-4349-9186-1ba2e6e4bc35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:42:10.820285 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-c48e7871-0dfc-4349-9186-1ba2e6e4bc35 None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:42:10.821492 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-c48e7871-0dfc-4349-9186-1ba2e6e4bc35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:42:10.914510 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 743/1495] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:42:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:42:10.919188 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b001925-e588-431c-b359-d576e2b160ac None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:42:10.920396 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-9b001925-e588-431c-b359-d576e2b160ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:42:10.931897 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b001925-e588-431c-b359-d576e2b160ac None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:42:10.992159 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:42:11.026354 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2a5abe-b07b-492e-b698-d51577da227f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:42:11.026955 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2a5abe-b07b-492e-b698-d51577da227f admin admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:42:11.027251 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2a5abe-b07b-492e-b698-d51577da227f admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:42:11.027502 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2a5abe-b07b-492e-b698-d51577da227f admin admin] PATH_INFO: `/v3/domains` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:42:11.028136 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2a5abe-b07b-492e-b698-d51577da227f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:42:11.028434 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2a5abe-b07b-492e-b698-d51577da227f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:42:11.029446 dv-cinder-854268-1-smb devstack@keystone.service[88113]: WARNING py.warnings [None req-5a2a5abe-b07b-492e-b698-d51577da227f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 05:42:11.029446 dv-cinder-854268-1-smb devstack@keystone.service[88113]: warnings.warn(msg) Aug 24 05:42:11.029446 dv-cinder-854268-1-smb devstack@keystone.service[88113]: Aug 24 05:42:11.030375 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2a5abe-b07b-492e-b698-d51577da227f admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:42:11.041202 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 753/1496] 10.222.0.26 () {58 vars in 1153 bytes} [Wed Aug 24 05:42:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:42:11.049513 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48e7871-0dfc-4349-9186-1ba2e6e4bc35 None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:42:11.059017 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48e7871-0dfc-4349-9186-1ba2e6e4bc35 None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:42:11.118286 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:42:11.151501 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6576a915-703e-478c-9deb-f8ac77673da9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:42:11.152115 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6576a915-703e-478c-9deb-f8ac77673da9 admin admin] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:42:11.152394 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6576a915-703e-478c-9deb-f8ac77673da9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:42:11.152696 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6576a915-703e-478c-9deb-f8ac77673da9 admin admin] PATH_INFO: `/v3/projects` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:42:11.153325 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6576a915-703e-478c-9deb-f8ac77673da9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:42:11.155070 dv-cinder-854268-1-smb devstack@keystone.service[88112]: WARNING py.warnings [None req-6576a915-703e-478c-9deb-f8ac77673da9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 05:42:11.155070 dv-cinder-854268-1-smb devstack@keystone.service[88112]: warnings.warn(msg) Aug 24 05:42:11.155070 dv-cinder-854268-1-smb devstack@keystone.service[88112]: Aug 24 05:42:11.156264 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6576a915-703e-478c-9deb-f8ac77673da9 admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:42:11.211912 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 744/1497] 10.222.0.26 () {60 vars in 1153 bytes} [Wed Aug 24 05:42:11 2022] POST /identity/v3/projects => generated 375 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:42:11.216093 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2a5abe-b07b-492e-b698-d51577da227f admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:42:11.217676 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-5a2a5abe-b07b-492e-b698-d51577da227f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:42:11.250783 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2a5abe-b07b-492e-b698-d51577da227f admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:42:11.343066 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fddf81-174d-4104-b929-33c7063c641c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:42:11.343659 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fddf81-174d-4104-b929-33c7063c641c admin admin] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:42:11.343941 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fddf81-174d-4104-b929-33c7063c641c admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:42:11.344210 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fddf81-174d-4104-b929-33c7063c641c admin admin] PATH_INFO: `/v3/users` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:42:11.344833 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fddf81-174d-4104-b929-33c7063c641c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:42:11.345844 dv-cinder-854268-1-smb devstack@keystone.service[88113]: WARNING py.warnings [None req-a4fddf81-174d-4104-b929-33c7063c641c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 05:42:11.345844 dv-cinder-854268-1-smb devstack@keystone.service[88113]: warnings.warn(msg) Aug 24 05:42:11.345844 dv-cinder-854268-1-smb devstack@keystone.service[88113]: Aug 24 05:42:11.347071 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fddf81-174d-4104-b929-33c7063c641c admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:42:11.389444 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 754/1498] 10.222.0.26 () {60 vars in 1144 bytes} [Wed Aug 24 05:42:11 2022] POST /identity/v3/users => generated 288 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:42:11.393495 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6576a915-703e-478c-9deb-f8ac77673da9 admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:42:11.395046 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-6576a915-703e-478c-9deb-f8ac77673da9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:42:11.456251 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6576a915-703e-478c-9deb-f8ac77673da9 admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:42:11.540344 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:42:11.552560 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4d71ae-1b05-42d8-abb5-6d19294f8d96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:42:11.553174 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4d71ae-1b05-42d8-abb5-6d19294f8d96 admin admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:42:11.553481 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4d71ae-1b05-42d8-abb5-6d19294f8d96 admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:42:11.553754 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4d71ae-1b05-42d8-abb5-6d19294f8d96 admin admin] PATH_INFO: `/v3/roles` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:42:11.554450 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4d71ae-1b05-42d8-abb5-6d19294f8d96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:42:11.555457 dv-cinder-854268-1-smb devstack@keystone.service[88112]: WARNING py.warnings [None req-1a4d71ae-1b05-42d8-abb5-6d19294f8d96 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 05:42:11.555457 dv-cinder-854268-1-smb devstack@keystone.service[88112]: warnings.warn(msg) Aug 24 05:42:11.555457 dv-cinder-854268-1-smb devstack@keystone.service[88112]: Aug 24 05:42:11.556344 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4d71ae-1b05-42d8-abb5-6d19294f8d96 admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:42:11.569556 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 745/1499] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Aug 24 05:42:11 2022] GET /identity/v3/roles => generated 1420 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:42:11.573842 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fddf81-174d-4104-b929-33c7063c641c admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:42:11.575487 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-a4fddf81-174d-4104-b929-33c7063c641c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:42:11.587580 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fddf81-174d-4104-b929-33c7063c641c admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:42:11.616492 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:42:11.692901 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81afcf6-a826-49c3-94cc-6411c86e3226 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:42:11.693509 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81afcf6-a826-49c3-94cc-6411c86e3226 admin admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:42:11.693788 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81afcf6-a826-49c3-94cc-6411c86e3226 admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:42:11.694094 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81afcf6-a826-49c3-94cc-6411c86e3226 admin admin] PATH_INFO: `/v3/roles` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:42:11.694741 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81afcf6-a826-49c3-94cc-6411c86e3226 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:42:11.695765 dv-cinder-854268-1-smb devstack@keystone.service[88113]: WARNING py.warnings [None req-e81afcf6-a826-49c3-94cc-6411c86e3226 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 05:42:11.695765 dv-cinder-854268-1-smb devstack@keystone.service[88113]: warnings.warn(msg) Aug 24 05:42:11.695765 dv-cinder-854268-1-smb devstack@keystone.service[88113]: Aug 24 05:42:11.696649 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81afcf6-a826-49c3-94cc-6411c86e3226 admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:42:11.709336 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 755/1500] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Aug 24 05:42:11 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:42:11.713658 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4d71ae-1b05-42d8-abb5-6d19294f8d96 admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:42:11.715319 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-1a4d71ae-1b05-42d8-abb5-6d19294f8d96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:42:11.747789 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4d71ae-1b05-42d8-abb5-6d19294f8d96 admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:42:11.842247 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f970cc7-75f8-4d24-ba6c-6b5233a8fadf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:42:11.842856 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f970cc7-75f8-4d24-ba6c-6b5233a8fadf admin admin] REQUEST_METHOD: `PUT` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:42:11.843155 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f970cc7-75f8-4d24-ba6c-6b5233a8fadf admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:42:11.843408 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f970cc7-75f8-4d24-ba6c-6b5233a8fadf admin admin] PATH_INFO: `/v3/projects/6922bf2e385d49be8c834fe6f84e67f9/users/866c9f152af94841b1885c15d006d45f/roles/f7aa4a2c74c94c1b9ca8ecdcccccda5c` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:42:11.865051 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f970cc7-75f8-4d24-ba6c-6b5233a8fadf admin admin] RBAC: Authorizing `identity:create_grant(project_id=6922bf2e385d49be8c834fe6f84e67f9, user_id=866c9f152af94841b1885c15d006d45f, role_id=f7aa4a2c74c94c1b9ca8ecdcccccda5c)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:42:11.866109 dv-cinder-854268-1-smb devstack@keystone.service[88112]: WARNING py.warnings [None req-3f970cc7-75f8-4d24-ba6c-6b5233a8fadf admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 05:42:11.866109 dv-cinder-854268-1-smb devstack@keystone.service[88112]: warnings.warn(msg) Aug 24 05:42:11.866109 dv-cinder-854268-1-smb devstack@keystone.service[88112]: Aug 24 05:42:11.868041 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f970cc7-75f8-4d24-ba6c-6b5233a8fadf admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:42:11.891843 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 746/1501] 10.222.0.26 () {60 vars in 1483 bytes} [Wed Aug 24 05:42:11 2022] PUT /identity/v3/projects/6922bf2e385d49be8c834fe6f84e67f9/users/866c9f152af94841b1885c15d006d45f/roles/f7aa4a2c74c94c1b9ca8ecdcccccda5c => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:42:11.903916 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de282e6d-aed4-4c44-98c5-ed59a24af2fd None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:42:11.904205 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de282e6d-aed4-4c44-98c5-ed59a24af2fd None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:42:11.904520 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de282e6d-aed4-4c44-98c5-ed59a24af2fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:42:11.961462 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-de282e6d-aed4-4c44-98c5-ed59a24af2fd None None] MFA Rules not processed for user `866c9f152af94841b1885c15d006d45f`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:42:11.962714 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-de282e6d-aed4-4c44-98c5-ed59a24af2fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:42:12.158055 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 756/1502] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:42:11 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:42:12.171563 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c761b54-9695-49d0-9556-dd9577eadfab None None] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:42:12.171854 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c761b54-9695-49d0-9556-dd9577eadfab None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:42:12.172131 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c761b54-9695-49d0-9556-dd9577eadfab None None] PATH_INFO: `/` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:42:12.173474 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 747/1503] 10.222.0.26 () {54 vars in 964 bytes} [Wed Aug 24 05:42:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:42:12.179027 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cc8bb4-4354-4db1-9f02-265338ae9f05 None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:42:12.179310 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cc8bb4-4354-4db1-9f02-265338ae9f05 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:42:12.179578 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cc8bb4-4354-4db1-9f02-265338ae9f05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:42:12.210252 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:42:12.253832 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-42cc8bb4-4354-4db1-9f02-265338ae9f05 None None] MFA Rules not processed for user `17b450afe795495680fc70f522c83750`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:42:12.255069 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-42cc8bb4-4354-4db1-9f02-265338ae9f05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:42:12.328788 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 757/1504] 10.222.0.26 () {58 vars in 1061 bytes} [Wed Aug 24 05:42:12 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:42:12.336784 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c761b54-9695-49d0-9556-dd9577eadfab None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:42:12.338339 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-7c761b54-9695-49d0-9556-dd9577eadfab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:42:12.389472 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:42:12.445404 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c761b54-9695-49d0-9556-dd9577eadfab None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:42:12.516504 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b07d3c6-0f76-4515-b43c-2d74000fefa1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17b450afe795495680fc70f522c83750', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:42:12.517116 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b07d3c6-0f76-4515-b43c-2d74000fefa1 service cinder] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:42:12.517400 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b07d3c6-0f76-4515-b43c-2d74000fefa1 service cinder] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:42:12.517672 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b07d3c6-0f76-4515-b43c-2d74000fefa1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:42:12.519797 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-4b07d3c6-0f76-4515-b43c-2d74000fefa1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:42:12.616793 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b07d3c6-0f76-4515-b43c-2d74000fefa1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:42:12.618254 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b07d3c6-0f76-4515-b43c-2d74000fefa1 service cinder] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:42:12.621684 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:42:12.636709 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 748/1505] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 24 05:42:12 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:42:12.681326 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37737169-3939-48fe-bddf-c5971a93a0e3 None None] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:42:12.681774 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37737169-3939-48fe-bddf-c5971a93a0e3 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:42:12.681884 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37737169-3939-48fe-bddf-c5971a93a0e3 None None] PATH_INFO: `/` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:42:12.683125 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 758/1506] 10.222.0.26 () {52 vars in 830 bytes} [Wed Aug 24 05:42:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:42:12.686803 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b07d3c6-0f76-4515-b43c-2d74000fefa1 service cinder] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:42:12.688057 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-4b07d3c6-0f76-4515-b43c-2d74000fefa1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:42:12.785768 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b07d3c6-0f76-4515-b43c-2d74000fefa1 service cinder] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:42:12.876205 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e86dad-0265-40f7-b61d-54fc97fb97cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:42:12.876829 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e86dad-0265-40f7-b61d-54fc97fb97cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:42:12.877107 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e86dad-0265-40f7-b61d-54fc97fb97cb admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:42:12.877379 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e86dad-0265-40f7-b61d-54fc97fb97cb admin admin] PATH_INFO: `/v3/users/866c9f152af94841b1885c15d006d45f` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:42:12.889760 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e86dad-0265-40f7-b61d-54fc97fb97cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=866c9f152af94841b1885c15d006d45f)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:42:12.890799 dv-cinder-854268-1-smb devstack@keystone.service[88112]: WARNING py.warnings [None req-b8e86dad-0265-40f7-b61d-54fc97fb97cb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 05:42:12.890799 dv-cinder-854268-1-smb devstack@keystone.service[88112]: warnings.warn(msg) Aug 24 05:42:12.890799 dv-cinder-854268-1-smb devstack@keystone.service[88112]: Aug 24 05:42:12.892007 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e86dad-0265-40f7-b61d-54fc97fb97cb admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:42:12.902151 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:42:12.958405 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-b8e86dad-0265-40f7-b61d-54fc97fb97cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '866c9f152af94841b1885c15d006d45f'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:42:12.972105 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-b8e86dad-0265-40f7-b61d-54fc97fb97cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '866c9f152af94841b1885c15d006d45f'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:42:12.995663 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-b8e86dad-0265-40f7-b61d-54fc97fb97cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '866c9f152af94841b1885c15d006d45f'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:42:13.005279 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-b8e86dad-0265-40f7-b61d-54fc97fb97cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '866c9f152af94841b1885c15d006d45f'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:42:13.005804 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-b8e86dad-0265-40f7-b61d-54fc97fb97cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '866c9f152af94841b1885c15d006d45f'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:42:13.011486 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 749/1507] 10.222.0.26 () {58 vars in 1224 bytes} [Wed Aug 24 05:42:12 2022] DELETE /identity/v3/users/866c9f152af94841b1885c15d006d45f => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:42:13.016087 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8384b5-9a80-4079-a6ef-fe35566cd6b6 None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:42:13.016370 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8384b5-9a80-4079-a6ef-fe35566cd6b6 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:42:13.016640 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8384b5-9a80-4079-a6ef-fe35566cd6b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:42:13.072530 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-0a8384b5-9a80-4079-a6ef-fe35566cd6b6 None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:42:13.073657 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-0a8384b5-9a80-4079-a6ef-fe35566cd6b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:42:13.146042 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:42:13.159001 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 759/1508] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:42:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 05:42:13.168484 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e86dad-0265-40f7-b61d-54fc97fb97cb admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:42:13.169696 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-b8e86dad-0265-40f7-b61d-54fc97fb97cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:42:13.272384 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e86dad-0265-40f7-b61d-54fc97fb97cb admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:42:13.326483 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:42:13.346558 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e25611-c49b-4cd7-be35-22ef3d0f5eed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '874348b647194ac2b5ecbf12c33bf59e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:42:13.347167 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e25611-c49b-4cd7-be35-22ef3d0f5eed service neutron] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:42:13.347484 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e25611-c49b-4cd7-be35-22ef3d0f5eed service neutron] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:42:13.347740 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e25611-c49b-4cd7-be35-22ef3d0f5eed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:42:13.349334 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-d1e25611-c49b-4cd7-be35-22ef3d0f5eed service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:42:13.455905 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e25611-c49b-4cd7-be35-22ef3d0f5eed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:42:13.457881 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e25611-c49b-4cd7-be35-22ef3d0f5eed service neutron] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:42:13.476571 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 750/1509] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 24 05:42:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:42:13.824417 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8384b5-9a80-4079-a6ef-fe35566cd6b6 None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:42:13.825699 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-0a8384b5-9a80-4079-a6ef-fe35566cd6b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:42:13.837216 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8384b5-9a80-4079-a6ef-fe35566cd6b6 None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:42:13.935515 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bba6205-59fa-454a-90ad-7a478b58606b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:42:13.936138 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bba6205-59fa-454a-90ad-7a478b58606b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:42:13.936416 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bba6205-59fa-454a-90ad-7a478b58606b admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:42:13.936679 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bba6205-59fa-454a-90ad-7a478b58606b admin admin] PATH_INFO: `/v3/projects/6922bf2e385d49be8c834fe6f84e67f9` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:42:13.948402 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bba6205-59fa-454a-90ad-7a478b58606b admin admin] RBAC: Authorizing `identity:delete_project(project_id=6922bf2e385d49be8c834fe6f84e67f9)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:42:13.949451 dv-cinder-854268-1-smb devstack@keystone.service[88113]: WARNING py.warnings [None req-7bba6205-59fa-454a-90ad-7a478b58606b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 05:42:13.949451 dv-cinder-854268-1-smb devstack@keystone.service[88113]: warnings.warn(msg) Aug 24 05:42:13.949451 dv-cinder-854268-1-smb devstack@keystone.service[88113]: Aug 24 05:42:13.950659 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bba6205-59fa-454a-90ad-7a478b58606b admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:42:14.011054 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-7bba6205-59fa-454a-90ad-7a478b58606b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6922bf2e385d49be8c834fe6f84e67f9', 'request_id': 'req-7bba6205-59fa-454a-90ad-7a478b58606b'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:42:14.020109 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-7bba6205-59fa-454a-90ad-7a478b58606b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6922bf2e385d49be8c834fe6f84e67f9', 'request_id': 'req-7bba6205-59fa-454a-90ad-7a478b58606b'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:42:14.032947 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-7bba6205-59fa-454a-90ad-7a478b58606b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6922bf2e385d49be8c834fe6f84e67f9', 'request_id': 'req-7bba6205-59fa-454a-90ad-7a478b58606b'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:42:14.055472 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-7bba6205-59fa-454a-90ad-7a478b58606b admin admin] The token cache is being invalidate because project 6922bf2e385d49be8c834fe6f84e67f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:42:14.055761 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-7bba6205-59fa-454a-90ad-7a478b58606b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:42:14.056227 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-7bba6205-59fa-454a-90ad-7a478b58606b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:42:14.057622 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 760/1510] 10.222.0.26 () {58 vars in 1233 bytes} [Wed Aug 24 05:42:13 2022] DELETE /identity/v3/projects/6922bf2e385d49be8c834fe6f84e67f9 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 05:42:23.474317 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=62 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:42:24.053542 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:43:49.713280 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa42f79-39bf-43a3-8a36-583a33ff9901 None None] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:43:49.713893 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa42f79-39bf-43a3-8a36-583a33ff9901 None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:43:49.713893 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa42f79-39bf-43a3-8a36-583a33ff9901 None None] PATH_INFO: `/` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:43:49.715204 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 751/1511] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 05:43:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:43:49.720115 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac2cc3f-deb7-4ca6-afb0-d6aece5ffcd2 None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:43:49.720546 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac2cc3f-deb7-4ca6-afb0-d6aece5ffcd2 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:43:49.720671 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac2cc3f-deb7-4ca6-afb0-d6aece5ffcd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:43:49.802761 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-bac2cc3f-deb7-4ca6-afb0-d6aece5ffcd2 None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:43:49.804333 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-bac2cc3f-deb7-4ca6-afb0-d6aece5ffcd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:43:49.907503 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 761/1512] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 05:43:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:43:50.060918 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa42f79-39bf-43a3-8a36-583a33ff9901 None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:43:50.063255 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-faa42f79-39bf-43a3-8a36-583a33ff9901 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:43:50.181199 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa42f79-39bf-43a3-8a36-583a33ff9901 None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:43:50.186623 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93ba820-85e8-4bfe-aab7-d0baf18059f2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b633e1aec6c4269bce13aa9c89e911a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:43:50.187217 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93ba820-85e8-4bfe-aab7-d0baf18059f2 service nova] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:43:50.187495 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93ba820-85e8-4bfe-aab7-d0baf18059f2 service nova] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:43:50.187764 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93ba820-85e8-4bfe-aab7-d0baf18059f2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:43:50.196281 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93ba820-85e8-4bfe-aab7-d0baf18059f2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:43:50.197876 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93ba820-85e8-4bfe-aab7-d0baf18059f2 service nova] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:43:50.207185 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 752/1513] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 24 05:43:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:43:51.025488 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410fa2fa-b4f3-436c-afe1-8ba4bcf1f239 None None] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:43:51.026077 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410fa2fa-b4f3-436c-afe1-8ba4bcf1f239 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:43:51.026077 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410fa2fa-b4f3-436c-afe1-8ba4bcf1f239 None None] PATH_INFO: `/` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:43:51.027402 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 762/1514] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 05:43:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:43:51.032104 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d3dc58-00f5-480d-a378-fac2ee25b47d None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:43:51.032555 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d3dc58-00f5-480d-a378-fac2ee25b47d None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:43:51.032688 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d3dc58-00f5-480d-a378-fac2ee25b47d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:43:51.052423 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-26d3dc58-00f5-480d-a378-fac2ee25b47d None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:43:51.053689 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-26d3dc58-00f5-480d-a378-fac2ee25b47d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:43:51.063349 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 753/1515] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 05:43:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:43:51.212945 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410fa2fa-b4f3-436c-afe1-8ba4bcf1f239 None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:43:51.227551 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410fa2fa-b4f3-436c-afe1-8ba4bcf1f239 None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:43:51.233502 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ae0dc7-810c-41ac-8f30-2d3192cc6077 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b633e1aec6c4269bce13aa9c89e911a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:43:51.234200 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ae0dc7-810c-41ac-8f30-2d3192cc6077 service nova] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:43:51.234481 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ae0dc7-810c-41ac-8f30-2d3192cc6077 service nova] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:43:51.234752 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ae0dc7-810c-41ac-8f30-2d3192cc6077 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:43:51.243606 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ae0dc7-810c-41ac-8f30-2d3192cc6077 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:43:51.245765 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ae0dc7-810c-41ac-8f30-2d3192cc6077 service nova] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:43:51.255476 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 763/1516] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 24 05:43:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 05:43:51.628931 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd2c96d-acfb-496a-8383-bf39335f884c None None] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:43:51.629235 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd2c96d-acfb-496a-8383-bf39335f884c None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:43:51.629508 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd2c96d-acfb-496a-8383-bf39335f884c None None] PATH_INFO: `/v3` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:43:51.630826 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 754/1517] 10.222.0.17 () {54 vars in 925 bytes} [Wed Aug 24 05:43:51 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:43:51.638620 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c35e287-fbc1-4f5d-8796-469a17a887c2 None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:43:51.638908 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c35e287-fbc1-4f5d-8796-469a17a887c2 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:43:51.639182 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c35e287-fbc1-4f5d-8796-469a17a887c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:43:51.698782 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-4c35e287-fbc1-4f5d-8796-469a17a887c2 None None] MFA Rules not processed for user `995ebe690b7748c9842bc0696415fc52`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:43:51.699979 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-4c35e287-fbc1-4f5d-8796-469a17a887c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:43:51.716738 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:43:51.770940 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 764/1518] 10.222.0.17 () {58 vars in 1015 bytes} [Wed Aug 24 05:43:51 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:44:00.950222 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570987d7-5829-4fbb-9c54-635df2719877 None None] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:44:00.950697 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570987d7-5829-4fbb-9c54-635df2719877 None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:44:00.950816 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570987d7-5829-4fbb-9c54-635df2719877 None None] PATH_INFO: `/` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:44:00.952088 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 755/1519] 10.222.0.26 () {54 vars in 961 bytes} [Wed Aug 24 05:44:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:44:00.957219 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fb6c16-213f-4d52-a547-8dd3eeca1203 None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:44:00.957618 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fb6c16-213f-4d52-a547-8dd3eeca1203 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:44:00.957759 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fb6c16-213f-4d52-a547-8dd3eeca1203 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:44:00.977262 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-b0fb6c16-213f-4d52-a547-8dd3eeca1203 None None] MFA Rules not processed for user `995ebe690b7748c9842bc0696415fc52`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:44:00.979034 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-b0fb6c16-213f-4d52-a547-8dd3eeca1203 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:44:00.987336 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 765/1520] 10.222.0.26 () {58 vars in 1058 bytes} [Wed Aug 24 05:44:00 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:44:00.995319 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570987d7-5829-4fbb-9c54-635df2719877 None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:44:01.008989 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570987d7-5829-4fbb-9c54-635df2719877 None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:44:01.014101 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdddd15-f1d7-4ed6-b9e7-614fc750084d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '995ebe690b7748c9842bc0696415fc52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:44:01.014724 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdddd15-f1d7-4ed6-b9e7-614fc750084d service placement] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:44:01.015026 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdddd15-f1d7-4ed6-b9e7-614fc750084d service placement] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:44:01.015300 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdddd15-f1d7-4ed6-b9e7-614fc750084d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:44:01.023518 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdddd15-f1d7-4ed6-b9e7-614fc750084d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:44:01.025082 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdddd15-f1d7-4ed6-b9e7-614fc750084d service placement] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:44:01.034738 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 756/1521] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 24 05:44:00 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:44:02.480211 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32e832c-cf04-4534-b933-26911e1c8523 None None] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:44:02.480795 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32e832c-cf04-4534-b933-26911e1c8523 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:44:02.480795 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32e832c-cf04-4534-b933-26911e1c8523 None None] PATH_INFO: `/` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:44:02.482189 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 766/1522] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 05:44:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:44:02.487005 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ed315b-3205-4119-a865-3fd51162b538 None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:44:02.487415 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ed315b-3205-4119-a865-3fd51162b538 None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:44:02.487528 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ed315b-3205-4119-a865-3fd51162b538 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:44:02.506542 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-b3ed315b-3205-4119-a865-3fd51162b538 None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:44:02.507725 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-b3ed315b-3205-4119-a865-3fd51162b538 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:44:02.516049 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 757/1523] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 05:44:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 05:44:02.667141 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32e832c-cf04-4534-b933-26911e1c8523 None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:44:02.681479 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32e832c-cf04-4534-b933-26911e1c8523 None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:44:02.687361 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948270fe-7b42-45cb-b075-565bb047b97e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b633e1aec6c4269bce13aa9c89e911a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:44:02.687949 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948270fe-7b42-45cb-b075-565bb047b97e service nova] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:44:02.688228 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948270fe-7b42-45cb-b075-565bb047b97e service nova] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:44:02.688496 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948270fe-7b42-45cb-b075-565bb047b97e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:44:02.696677 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948270fe-7b42-45cb-b075-565bb047b97e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:44:02.698884 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948270fe-7b42-45cb-b075-565bb047b97e service nova] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:44:02.708225 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 767/1524] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 24 05:44:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:44:03.511083 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a48d3e-e3c8-4ff3-b306-148cea2cabd5 None None] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:44:03.511614 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a48d3e-e3c8-4ff3-b306-148cea2cabd5 None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:44:03.511614 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a48d3e-e3c8-4ff3-b306-148cea2cabd5 None None] PATH_INFO: `/` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:44:03.512968 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 758/1525] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 05:44:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:44:03.517748 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a80996c-4a20-4695-be91-50c82764736e None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:44:03.518183 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a80996c-4a20-4695-be91-50c82764736e None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:44:03.518323 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a80996c-4a20-4695-be91-50c82764736e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:44:03.537652 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-4a80996c-4a20-4695-be91-50c82764736e None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:44:03.538873 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-4a80996c-4a20-4695-be91-50c82764736e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:44:03.547134 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 768/1526] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 05:44:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:44:03.696711 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a48d3e-e3c8-4ff3-b306-148cea2cabd5 None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:44:03.710930 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a48d3e-e3c8-4ff3-b306-148cea2cabd5 None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:44:03.716911 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0d0ee8-448e-4bdd-92be-197e5a0ae955 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b633e1aec6c4269bce13aa9c89e911a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:44:03.717499 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0d0ee8-448e-4bdd-92be-197e5a0ae955 service nova] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:44:03.717776 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0d0ee8-448e-4bdd-92be-197e5a0ae955 service nova] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:44:03.718076 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0d0ee8-448e-4bdd-92be-197e5a0ae955 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:44:03.726057 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0d0ee8-448e-4bdd-92be-197e5a0ae955 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:44:03.727624 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0d0ee8-448e-4bdd-92be-197e5a0ae955 service nova] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:44:03.737494 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 759/1527] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 24 05:44:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:44:07.698130 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b33d9d3-f451-4f34-9906-91ef3a3f87ad None None] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:44:07.698726 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b33d9d3-f451-4f34-9906-91ef3a3f87ad None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:44:07.698726 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b33d9d3-f451-4f34-9906-91ef3a3f87ad None None] PATH_INFO: `/` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:44:07.700089 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 769/1528] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 05:44:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:44:07.705350 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda82297-ad4c-4123-8650-a38dd8d8a2b7 None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:44:07.705800 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda82297-ad4c-4123-8650-a38dd8d8a2b7 None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:44:07.705907 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda82297-ad4c-4123-8650-a38dd8d8a2b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:44:07.724628 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-dda82297-ad4c-4123-8650-a38dd8d8a2b7 None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:44:07.725817 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-dda82297-ad4c-4123-8650-a38dd8d8a2b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:44:07.734182 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 760/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 05:44:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:44:08.017417 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b33d9d3-f451-4f34-9906-91ef3a3f87ad None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:44:08.019207 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-2b33d9d3-f451-4f34-9906-91ef3a3f87ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:44:08.097688 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b33d9d3-f451-4f34-9906-91ef3a3f87ad None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:44:08.101246 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1777d35c-c526-4831-b78f-a5d97e67d20e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '874348b647194ac2b5ecbf12c33bf59e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:44:08.101840 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1777d35c-c526-4831-b78f-a5d97e67d20e service neutron] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:44:08.102145 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1777d35c-c526-4831-b78f-a5d97e67d20e service neutron] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:44:08.102419 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1777d35c-c526-4831-b78f-a5d97e67d20e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:44:08.111854 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1777d35c-c526-4831-b78f-a5d97e67d20e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:44:08.113298 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1777d35c-c526-4831-b78f-a5d97e67d20e service neutron] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:44:08.122549 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 770/1530] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 24 05:44:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:44:09.984148 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe4aa88-0fd9-4651-a277-d4e18f437809 None None] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:44:09.984740 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe4aa88-0fd9-4651-a277-d4e18f437809 None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:44:09.984740 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe4aa88-0fd9-4651-a277-d4e18f437809 None None] PATH_INFO: `/` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:44:09.986063 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 761/1531] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 05:44:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:44:09.991277 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348ffad1-d758-4138-ac5f-990375ccd4ae None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:44:09.991727 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348ffad1-d758-4138-ac5f-990375ccd4ae None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:44:09.991833 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348ffad1-d758-4138-ac5f-990375ccd4ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:44:10.012417 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-348ffad1-d758-4138-ac5f-990375ccd4ae None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:44:10.013616 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-348ffad1-d758-4138-ac5f-990375ccd4ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:44:10.021452 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 771/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 05:44:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:44:10.308659 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe4aa88-0fd9-4651-a277-d4e18f437809 None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:44:10.310432 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-4fe4aa88-0fd9-4651-a277-d4e18f437809 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:44:10.323390 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe4aa88-0fd9-4651-a277-d4e18f437809 None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:44:10.326881 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38242858-9795-4070-9946-27c2dbbd4107 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '874348b647194ac2b5ecbf12c33bf59e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:44:10.327466 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38242858-9795-4070-9946-27c2dbbd4107 service neutron] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:44:10.327744 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38242858-9795-4070-9946-27c2dbbd4107 service neutron] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:44:10.328014 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38242858-9795-4070-9946-27c2dbbd4107 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:44:10.336751 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38242858-9795-4070-9946-27c2dbbd4107 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:44:10.338186 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38242858-9795-4070-9946-27c2dbbd4107 service neutron] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:44:10.347928 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 762/1533] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 24 05:44:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:44:14.067439 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b6e068-8aa2-4e97-bd11-03c81bdd32d9 None None] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:44:14.067985 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b6e068-8aa2-4e97-bd11-03c81bdd32d9 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:44:14.067985 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b6e068-8aa2-4e97-bd11-03c81bdd32d9 None None] PATH_INFO: `/` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:44:14.069299 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 772/1534] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 05:44:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:44:14.074763 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d38149-7dc7-4e54-8e25-ea10489e20cf None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:44:14.075171 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d38149-7dc7-4e54-8e25-ea10489e20cf None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:44:14.075314 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d38149-7dc7-4e54-8e25-ea10489e20cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:44:14.082953 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=81 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:44:14.095921 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-18d38149-7dc7-4e54-8e25-ea10489e20cf None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:44:14.097127 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-18d38149-7dc7-4e54-8e25-ea10489e20cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:44:14.104919 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 763/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 05:44:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:44:14.651230 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b6e068-8aa2-4e97-bd11-03c81bdd32d9 None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:44:14.652915 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-e0b6e068-8aa2-4e97-bd11-03c81bdd32d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:44:14.717626 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:44:14.731001 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b6e068-8aa2-4e97-bd11-03c81bdd32d9 None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:44:14.734513 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbbfc4f-87c1-4615-a8c4-5a10c7aa4baf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17b450afe795495680fc70f522c83750', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:44:14.735119 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbbfc4f-87c1-4615-a8c4-5a10c7aa4baf service cinder] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:44:14.735397 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbbfc4f-87c1-4615-a8c4-5a10c7aa4baf service cinder] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:44:14.735668 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbbfc4f-87c1-4615-a8c4-5a10c7aa4baf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:44:14.744512 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbbfc4f-87c1-4615-a8c4-5a10c7aa4baf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:44:14.746485 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbbfc4f-87c1-4615-a8c4-5a10c7aa4baf service cinder] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:44:14.755756 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 773/1536] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 24 05:44:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:44:16.649297 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec7bc09-b74f-4ddb-a36e-0c52a8ad7729 None None] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:44:16.649841 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec7bc09-b74f-4ddb-a36e-0c52a8ad7729 None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:44:16.649841 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec7bc09-b74f-4ddb-a36e-0c52a8ad7729 None None] PATH_INFO: `/` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:44:16.651228 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 764/1537] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 05:44:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:44:16.657077 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06a312c-1306-4c65-a1de-26d05e9ed3b9 None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:44:16.657479 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06a312c-1306-4c65-a1de-26d05e9ed3b9 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:44:16.657620 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06a312c-1306-4c65-a1de-26d05e9ed3b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:44:16.676731 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-b06a312c-1306-4c65-a1de-26d05e9ed3b9 None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:44:16.677854 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-b06a312c-1306-4c65-a1de-26d05e9ed3b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:44:16.685719 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 774/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 05:44:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:44:17.235727 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec7bc09-b74f-4ddb-a36e-0c52a8ad7729 None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:44:17.237408 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-eec7bc09-b74f-4ddb-a36e-0c52a8ad7729 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:44:17.251240 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec7bc09-b74f-4ddb-a36e-0c52a8ad7729 None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:44:17.254723 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286e7215-4691-4583-a5fb-db3529820655 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17b450afe795495680fc70f522c83750', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:44:17.255320 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286e7215-4691-4583-a5fb-db3529820655 service cinder] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:44:17.255598 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286e7215-4691-4583-a5fb-db3529820655 service cinder] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:44:17.255870 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286e7215-4691-4583-a5fb-db3529820655 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:44:17.264735 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286e7215-4691-4583-a5fb-db3529820655 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:44:17.266181 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286e7215-4691-4583-a5fb-db3529820655 service cinder] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:44:17.275423 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 765/1539] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 24 05:44:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:44:26.672380 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=11 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:44:27.271322 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=8 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:45:49.767986 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b3cdaf-8560-4d45-a3c6-82b714dd9c77 None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:49.768662 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b3cdaf-8560-4d45-a3c6-82b714dd9c77 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:49.768662 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b3cdaf-8560-4d45-a3c6-82b714dd9c77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:49.791697 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-f5b3cdaf-8560-4d45-a3c6-82b714dd9c77 None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:45:49.793409 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-f5b3cdaf-8560-4d45-a3c6-82b714dd9c77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:45:49.804811 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 775/1540] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:45:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:45:49.814084 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5dcf6c-46f0-4962-a734-28b3047aba1e None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:49.815161 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5dcf6c-46f0-4962-a734-28b3047aba1e None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:49.815668 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5dcf6c-46f0-4962-a734-28b3047aba1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:49.842863 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cffba83-788f-46c6-baaf-70948e0efd37 None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:49.843518 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cffba83-788f-46c6-baaf-70948e0efd37 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:49.844103 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cffba83-788f-46c6-baaf-70948e0efd37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:49.852717 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-2d5dcf6c-46f0-4962-a734-28b3047aba1e None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:45:49.854247 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-2d5dcf6c-46f0-4962-a734-28b3047aba1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:45:49.866822 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 766/1541] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:45:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:45:49.871289 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-3cffba83-788f-46c6-baaf-70948e0efd37 None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:45:49.872698 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-3cffba83-788f-46c6-baaf-70948e0efd37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:45:49.875670 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5dcf6c-46f0-4962-a734-28b3047aba1e None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:45:49.885966 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5dcf6c-46f0-4962-a734-28b3047aba1e None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:45:49.887649 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 776/1542] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:45:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 05:45:49.895604 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724ff7c9-2b26-44c2-8c83-957c7f335899 None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:49.895883 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724ff7c9-2b26-44c2-8c83-957c7f335899 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:49.896348 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724ff7c9-2b26-44c2-8c83-957c7f335899 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:49.901970 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbe80b5-6ddf-46b4-a9ca-f2559d9bfd5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:45:49.901970 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbe80b5-6ddf-46b4-a9ca-f2559d9bfd5e admin admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:49.901970 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbe80b5-6ddf-46b4-a9ca-f2559d9bfd5e admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:49.901970 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbe80b5-6ddf-46b4-a9ca-f2559d9bfd5e admin admin] PATH_INFO: `/v3/domains` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:49.902464 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbe80b5-6ddf-46b4-a9ca-f2559d9bfd5e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:45:49.902464 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbe80b5-6ddf-46b4-a9ca-f2559d9bfd5e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:45:49.903690 dv-cinder-854268-1-smb devstack@keystone.service[88112]: WARNING py.warnings [None req-6bbe80b5-6ddf-46b4-a9ca-f2559d9bfd5e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 05:45:49.903690 dv-cinder-854268-1-smb devstack@keystone.service[88112]: warnings.warn(msg) Aug 24 05:45:49.903690 dv-cinder-854268-1-smb devstack@keystone.service[88112]: Aug 24 05:45:49.905442 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbe80b5-6ddf-46b4-a9ca-f2559d9bfd5e admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:45:49.929492 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 767/1543] 10.222.0.26 () {58 vars in 1153 bytes} [Wed Aug 24 05:45:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:45:49.933501 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-724ff7c9-2b26-44c2-8c83-957c7f335899 None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:45:49.934913 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-724ff7c9-2b26-44c2-8c83-957c7f335899 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:45:49.947262 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbe80b5-6ddf-46b4-a9ca-f2559d9bfd5e admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:45:49.956079 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 777/1544] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:45:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 05:45:49.960321 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724ff7c9-2b26-44c2-8c83-957c7f335899 None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:45:49.963900 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbe80b5-6ddf-46b4-a9ca-f2559d9bfd5e admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:45:49.975066 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724ff7c9-2b26-44c2-8c83-957c7f335899 None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:45:49.985164 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a37dfd8-837c-4b93-ae56-f1ff95f1fbe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:45:49.986913 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a37dfd8-837c-4b93-ae56-f1ff95f1fbe4 admin admin] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:49.987304 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a37dfd8-837c-4b93-ae56-f1ff95f1fbe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:49.987772 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a37dfd8-837c-4b93-ae56-f1ff95f1fbe4 admin admin] PATH_INFO: `/v3/projects` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:49.988525 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a37dfd8-837c-4b93-ae56-f1ff95f1fbe4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:45:49.988658 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3825c9c-cbd1-4c23-8eb0-a52bd1cb72fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:45:49.989427 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3825c9c-cbd1-4c23-8eb0-a52bd1cb72fe admin admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:49.989875 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3825c9c-cbd1-4c23-8eb0-a52bd1cb72fe admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:49.995211 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a37dfd8-837c-4b93-ae56-f1ff95f1fbe4 admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:45:49.996137 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3825c9c-cbd1-4c23-8eb0-a52bd1cb72fe admin admin] PATH_INFO: `/v3/domains` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:49.997091 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3825c9c-cbd1-4c23-8eb0-a52bd1cb72fe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:45:49.997559 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3825c9c-cbd1-4c23-8eb0-a52bd1cb72fe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:45:49.999537 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3825c9c-cbd1-4c23-8eb0-a52bd1cb72fe admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:45:50.022046 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 778/1545] 10.222.0.26 () {58 vars in 1153 bytes} [Wed Aug 24 05:45:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:45:50.026602 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3825c9c-cbd1-4c23-8eb0-a52bd1cb72fe admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:45:50.040947 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3825c9c-cbd1-4c23-8eb0-a52bd1cb72fe admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:45:50.051490 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fecc1ce-387d-4ecd-a307-6021a111ab0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:45:50.052463 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fecc1ce-387d-4ecd-a307-6021a111ab0e admin admin] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:50.052940 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fecc1ce-387d-4ecd-a307-6021a111ab0e admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:50.053411 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fecc1ce-387d-4ecd-a307-6021a111ab0e admin admin] PATH_INFO: `/v3/projects` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:50.056505 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fecc1ce-387d-4ecd-a307-6021a111ab0e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:45:50.058455 dv-cinder-854268-1-smb devstack@keystone.service[88113]: WARNING py.warnings [None req-9fecc1ce-387d-4ecd-a307-6021a111ab0e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 05:45:50.058455 dv-cinder-854268-1-smb devstack@keystone.service[88113]: warnings.warn(msg) Aug 24 05:45:50.058455 dv-cinder-854268-1-smb devstack@keystone.service[88113]: Aug 24 05:45:50.060048 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fecc1ce-387d-4ecd-a307-6021a111ab0e admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:45:50.062119 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 768/1546] 10.222.0.26 () {60 vars in 1153 bytes} [Wed Aug 24 05:45:49 2022] POST /identity/v3/projects => generated 371 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:45:50.064182 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a37dfd8-837c-4b93-ae56-f1ff95f1fbe4 admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:45:50.130458 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 779/1547] 10.222.0.26 () {60 vars in 1153 bytes} [Wed Aug 24 05:45:50 2022] POST /identity/v3/projects => generated 363 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 05:45:50.134936 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fecc1ce-387d-4ecd-a307-6021a111ab0e admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:45:50.178732 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a37dfd8-837c-4b93-ae56-f1ff95f1fbe4 admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:45:50.272048 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6a935a-471e-4fb3-a49c-02cdf8b10abf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:45:50.272696 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6a935a-471e-4fb3-a49c-02cdf8b10abf admin admin] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:50.272980 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6a935a-471e-4fb3-a49c-02cdf8b10abf admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:50.273253 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6a935a-471e-4fb3-a49c-02cdf8b10abf admin admin] PATH_INFO: `/v3/users` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:50.273911 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6a935a-471e-4fb3-a49c-02cdf8b10abf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:45:50.275096 dv-cinder-854268-1-smb devstack@keystone.service[88112]: WARNING py.warnings [None req-cf6a935a-471e-4fb3-a49c-02cdf8b10abf admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 05:45:50.275096 dv-cinder-854268-1-smb devstack@keystone.service[88112]: warnings.warn(msg) Aug 24 05:45:50.275096 dv-cinder-854268-1-smb devstack@keystone.service[88112]: Aug 24 05:45:50.276322 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6a935a-471e-4fb3-a49c-02cdf8b10abf admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:45:50.293467 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fecc1ce-387d-4ecd-a307-6021a111ab0e admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:45:50.304683 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0571ca5-af1a-40a1-b7b2-c84ef84647cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:45:50.305221 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0571ca5-af1a-40a1-b7b2-c84ef84647cb admin admin] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:50.305507 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0571ca5-af1a-40a1-b7b2-c84ef84647cb admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:50.305778 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0571ca5-af1a-40a1-b7b2-c84ef84647cb admin admin] PATH_INFO: `/v3/users` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:50.306525 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0571ca5-af1a-40a1-b7b2-c84ef84647cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:45:50.308803 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 769/1548] 10.222.0.26 () {60 vars in 1144 bytes} [Wed Aug 24 05:45:50 2022] POST /identity/v3/users => generated 286 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 05:45:50.308938 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0571ca5-af1a-40a1-b7b2-c84ef84647cb admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:45:50.312539 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6a935a-471e-4fb3-a49c-02cdf8b10abf admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:45:50.326276 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6a935a-471e-4fb3-a49c-02cdf8b10abf admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:45:50.340935 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba35912-70ca-4796-9c2d-1717cd976919 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:45:50.341618 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba35912-70ca-4796-9c2d-1717cd976919 admin admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:50.341904 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba35912-70ca-4796-9c2d-1717cd976919 admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:50.342249 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba35912-70ca-4796-9c2d-1717cd976919 admin admin] PATH_INFO: `/v3/roles` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:50.343721 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba35912-70ca-4796-9c2d-1717cd976919 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:45:50.345184 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba35912-70ca-4796-9c2d-1717cd976919 admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:45:50.358791 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 780/1549] 10.222.0.26 () {60 vars in 1144 bytes} [Wed Aug 24 05:45:50 2022] POST /identity/v3/users => generated 282 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:45:50.360550 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 770/1550] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Aug 24 05:45:50 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 05:45:50.362514 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0571ca5-af1a-40a1-b7b2-c84ef84647cb admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:45:50.365736 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba35912-70ca-4796-9c2d-1717cd976919 admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:45:50.376281 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba35912-70ca-4796-9c2d-1717cd976919 admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:45:50.380580 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0571ca5-af1a-40a1-b7b2-c84ef84647cb admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:45:50.390609 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f0eb07-2eae-41ce-9a97-82309d708ea2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:45:50.391246 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f0eb07-2eae-41ce-9a97-82309d708ea2 admin admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:50.391505 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f0eb07-2eae-41ce-9a97-82309d708ea2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:50.391781 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f0eb07-2eae-41ce-9a97-82309d708ea2 admin admin] PATH_INFO: `/v3/roles` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:50.392508 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f0eb07-2eae-41ce-9a97-82309d708ea2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:45:50.394162 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f0eb07-2eae-41ce-9a97-82309d708ea2 admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:45:50.394654 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb769d17-e67a-41ac-93b3-203a75191e8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:45:50.395290 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb769d17-e67a-41ac-93b3-203a75191e8e admin admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:50.395687 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb769d17-e67a-41ac-93b3-203a75191e8e admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:50.395874 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb769d17-e67a-41ac-93b3-203a75191e8e admin admin] PATH_INFO: `/v3/roles` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:50.396507 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb769d17-e67a-41ac-93b3-203a75191e8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:45:50.398136 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb769d17-e67a-41ac-93b3-203a75191e8e admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:45:50.411712 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 781/1551] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Aug 24 05:45:50 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:45:50.414644 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 771/1552] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Aug 24 05:45:50 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:45:50.415319 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f0eb07-2eae-41ce-9a97-82309d708ea2 admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:45:50.418676 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb769d17-e67a-41ac-93b3-203a75191e8e admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:45:50.432253 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f0eb07-2eae-41ce-9a97-82309d708ea2 admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:45:50.432607 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb769d17-e67a-41ac-93b3-203a75191e8e admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:45:50.454170 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8255a7c-38f5-4eab-a972-19e6c34a2b4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:45:50.454816 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8255a7c-38f5-4eab-a972-19e6c34a2b4d admin admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:50.455093 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8255a7c-38f5-4eab-a972-19e6c34a2b4d admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:50.455367 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8255a7c-38f5-4eab-a972-19e6c34a2b4d admin admin] PATH_INFO: `/v3/roles` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:50.456038 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8255a7c-38f5-4eab-a972-19e6c34a2b4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:45:50.457697 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8255a7c-38f5-4eab-a972-19e6c34a2b4d admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:45:50.458765 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22803a8-8397-4b80-9677-dd329275d398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:45:50.459467 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22803a8-8397-4b80-9677-dd329275d398 admin admin] REQUEST_METHOD: `PUT` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:50.459754 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22803a8-8397-4b80-9677-dd329275d398 admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:50.460034 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22803a8-8397-4b80-9677-dd329275d398 admin admin] PATH_INFO: `/v3/projects/e99a17d277114c20b9a9eb5f6224ef2b/users/33cc1bac744d4b20ae586a5897afb73f/roles/f7aa4a2c74c94c1b9ca8ecdcccccda5c` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:50.475907 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 782/1553] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Aug 24 05:45:50 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:45:50.477214 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8feaa8-ea0a-406d-9bfe-6719191c5cc1 None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:50.477498 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8feaa8-ea0a-406d-9bfe-6719191c5cc1 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:50.477769 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8feaa8-ea0a-406d-9bfe-6719191c5cc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:50.487057 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22803a8-8397-4b80-9677-dd329275d398 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e99a17d277114c20b9a9eb5f6224ef2b, user_id=33cc1bac744d4b20ae586a5897afb73f, role_id=f7aa4a2c74c94c1b9ca8ecdcccccda5c)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:45:50.489823 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22803a8-8397-4b80-9677-dd329275d398 admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:45:50.508444 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:45:50.517170 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 772/1554] 10.222.0.26 () {60 vars in 1483 bytes} [Wed Aug 24 05:45:50 2022] PUT /identity/v3/projects/e99a17d277114c20b9a9eb5f6224ef2b/users/33cc1bac744d4b20ae586a5897afb73f/roles/f7aa4a2c74c94c1b9ca8ecdcccccda5c => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:45:50.518037 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22803a8-8397-4b80-9677-dd329275d398 admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:45:50.527085 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-7b8feaa8-ea0a-406d-9bfe-6719191c5cc1 None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:45:50.528312 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-7b8feaa8-ea0a-406d-9bfe-6719191c5cc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:45:50.600976 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 783/1555] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:45:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:45:50.602493 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22803a8-8397-4b80-9677-dd329275d398 admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:45:50.602678 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bce958-281b-439e-8209-a0a6b4f0b1cb None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:50.602972 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bce958-281b-439e-8209-a0a6b4f0b1cb None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:50.603239 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bce958-281b-439e-8209-a0a6b4f0b1cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:50.616459 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db32f1fa-2fc7-4c52-81f0-aa7f2497d621 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:45:50.617504 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db32f1fa-2fc7-4c52-81f0-aa7f2497d621 admin admin] REQUEST_METHOD: `PUT` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:50.618583 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db32f1fa-2fc7-4c52-81f0-aa7f2497d621 admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:50.619071 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db32f1fa-2fc7-4c52-81f0-aa7f2497d621 admin admin] PATH_INFO: `/v3/projects/a3bb48fbaa2a42daa851939bb33add59/users/416cb0ff691a407b81583043218c6cca/roles/f7aa4a2c74c94c1b9ca8ecdcccccda5c` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:50.624925 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-15bce958-281b-439e-8209-a0a6b4f0b1cb None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:45:50.628527 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-15bce958-281b-439e-8209-a0a6b4f0b1cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:45:50.637573 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 784/1556] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:45:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:45:50.638954 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31966e0-6204-4228-87c7-831960ee7db8 None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:50.639873 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31966e0-6204-4228-87c7-831960ee7db8 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:50.640203 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31966e0-6204-4228-87c7-831960ee7db8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:50.643236 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db32f1fa-2fc7-4c52-81f0-aa7f2497d621 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3bb48fbaa2a42daa851939bb33add59, user_id=416cb0ff691a407b81583043218c6cca, role_id=f7aa4a2c74c94c1b9ca8ecdcccccda5c)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:45:50.647051 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db32f1fa-2fc7-4c52-81f0-aa7f2497d621 admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:45:50.655873 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:45:50.665834 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 773/1557] 10.222.0.26 () {60 vars in 1483 bytes} [Wed Aug 24 05:45:50 2022] PUT /identity/v3/projects/a3bb48fbaa2a42daa851939bb33add59/users/416cb0ff691a407b81583043218c6cca/roles/f7aa4a2c74c94c1b9ca8ecdcccccda5c => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:45:50.667178 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efd0af0-a585-41f0-9ce7-c4cf317a8c3e None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:50.667477 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efd0af0-a585-41f0-9ce7-c4cf317a8c3e None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:50.667778 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efd0af0-a585-41f0-9ce7-c4cf317a8c3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:50.677456 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-a31966e0-6204-4228-87c7-831960ee7db8 None None] MFA Rules not processed for user `33cc1bac744d4b20ae586a5897afb73f`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:45:50.678890 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-a31966e0-6204-4228-87c7-831960ee7db8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:45:50.687558 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-7efd0af0-a585-41f0-9ce7-c4cf317a8c3e None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:45:50.688741 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-7efd0af0-a585-41f0-9ce7-c4cf317a8c3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:45:50.743302 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 785/1558] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:45:50 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:45:50.744474 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e512f527-dbe5-4eec-84c6-aedd9ac982ab None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:50.744766 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e512f527-dbe5-4eec-84c6-aedd9ac982ab None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:50.745050 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e512f527-dbe5-4eec-84c6-aedd9ac982ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:50.749588 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 774/1559] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:45:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:45:50.751235 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a230f12-2294-4ab5-a4c6-84281e1040fa None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:50.751681 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a230f12-2294-4ab5-a4c6-84281e1040fa None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:50.752055 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a230f12-2294-4ab5-a4c6-84281e1040fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:50.767597 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-e512f527-dbe5-4eec-84c6-aedd9ac982ab None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:45:50.768443 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-e512f527-dbe5-4eec-84c6-aedd9ac982ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:45:50.776752 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-5a230f12-2294-4ab5-a4c6-84281e1040fa None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:45:50.776912 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 786/1560] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:45:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:45:50.778159 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdadfce7-428c-4db4-8275-49f7c06eabe6 None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:50.778369 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-5a230f12-2294-4ab5-a4c6-84281e1040fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:45:50.778484 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdadfce7-428c-4db4-8275-49f7c06eabe6 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:50.778700 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdadfce7-428c-4db4-8275-49f7c06eabe6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:50.793064 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 775/1561] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:45:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:45:50.794440 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b45564-7e83-4ac3-af62-61b4ff5313b8 None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:50.794724 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b45564-7e83-4ac3-af62-61b4ff5313b8 None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:50.794994 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b45564-7e83-4ac3-af62-61b4ff5313b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:50.802344 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-fdadfce7-428c-4db4-8275-49f7c06eabe6 None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:45:50.803560 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-fdadfce7-428c-4db4-8275-49f7c06eabe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:45:50.812151 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 787/1562] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:45:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:45:50.813371 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4f2cdd-08cd-4d26-b7d1-8a844c6d8997 None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:50.813658 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4f2cdd-08cd-4d26-b7d1-8a844c6d8997 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:50.814040 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4f2cdd-08cd-4d26-b7d1-8a844c6d8997 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:50.815249 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-e3b45564-7e83-4ac3-af62-61b4ff5313b8 None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:45:50.816503 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-e3b45564-7e83-4ac3-af62-61b4ff5313b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:45:50.825783 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 776/1563] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:45:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:45:50.827613 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43fffbf-cbb0-4ce3-a511-ffd879e046ab None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:50.827890 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43fffbf-cbb0-4ce3-a511-ffd879e046ab None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:50.828154 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43fffbf-cbb0-4ce3-a511-ffd879e046ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:50.836095 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-cb4f2cdd-08cd-4d26-b7d1-8a844c6d8997 None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:45:50.837297 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-cb4f2cdd-08cd-4d26-b7d1-8a844c6d8997 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:45:50.845662 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 788/1564] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:45:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:45:50.846905 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50727f95-eb1a-47a4-8b07-11f8c375ab15 None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:50.847218 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50727f95-eb1a-47a4-8b07-11f8c375ab15 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:50.847469 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50727f95-eb1a-47a4-8b07-11f8c375ab15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:50.855851 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-d43fffbf-cbb0-4ce3-a511-ffd879e046ab None None] MFA Rules not processed for user `416cb0ff691a407b81583043218c6cca`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:45:50.856992 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-d43fffbf-cbb0-4ce3-a511-ffd879e046ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:45:50.868579 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-50727f95-eb1a-47a4-8b07-11f8c375ab15 None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:45:50.869753 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-50727f95-eb1a-47a4-8b07-11f8c375ab15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:45:50.878329 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 789/1565] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:45:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:45:50.879508 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bef793-2128-4bba-b1ad-47674a8b89f3 None None] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:50.879789 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bef793-2128-4bba-b1ad-47674a8b89f3 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:50.880062 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bef793-2128-4bba-b1ad-47674a8b89f3 None None] PATH_INFO: `/` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:50.881294 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 790/1566] 10.222.0.26 () {54 vars in 962 bytes} [Wed Aug 24 05:45:50 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:45:50.882326 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcab5b3f-1a4b-4cf4-b469-bc2053688ac0 None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:50.882615 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcab5b3f-1a4b-4cf4-b469-bc2053688ac0 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:50.882891 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcab5b3f-1a4b-4cf4-b469-bc2053688ac0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:50.901334 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-fcab5b3f-1a4b-4cf4-b469-bc2053688ac0 None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:45:50.902554 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-fcab5b3f-1a4b-4cf4-b469-bc2053688ac0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:45:50.910551 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 791/1567] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:45:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:45:50.911318 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcab5b3f-1a4b-4cf4-b469-bc2053688ac0 None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:45:50.919435 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:45:50.923375 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcab5b3f-1a4b-4cf4-b469-bc2053688ac0 None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:45:50.923607 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 777/1568] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:45:50 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:45:50.924914 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2689c806-7928-46af-8627-0f5f04ab2dcb None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:50.925537 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2689c806-7928-46af-8627-0f5f04ab2dcb None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:50.926160 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2689c806-7928-46af-8627-0f5f04ab2dcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:50.928320 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a777880-6cad-4afb-81d7-0cf711d67508 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:45:50.928925 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a777880-6cad-4afb-81d7-0cf711d67508 admin admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:50.929203 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a777880-6cad-4afb-81d7-0cf711d67508 admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:50.929473 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a777880-6cad-4afb-81d7-0cf711d67508 admin admin] PATH_INFO: `/v3/domains` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:50.930151 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a777880-6cad-4afb-81d7-0cf711d67508 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:45:50.930458 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a777880-6cad-4afb-81d7-0cf711d67508 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:45:50.932036 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a777880-6cad-4afb-81d7-0cf711d67508 admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:45:50.944343 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 792/1569] 10.222.0.26 () {58 vars in 1153 bytes} [Wed Aug 24 05:45:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:45:50.947111 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a777880-6cad-4afb-81d7-0cf711d67508 admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:45:50.947720 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-2689c806-7928-46af-8627-0f5f04ab2dcb None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:45:50.949059 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-2689c806-7928-46af-8627-0f5f04ab2dcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:45:50.956723 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a777880-6cad-4afb-81d7-0cf711d67508 admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:45:50.957449 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 778/1570] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:45:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:45:50.958697 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b36f52c-0dc4-44a5-bfcd-1b8b9c29fd06 None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:50.958978 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b36f52c-0dc4-44a5-bfcd-1b8b9c29fd06 None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:50.959250 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b36f52c-0dc4-44a5-bfcd-1b8b9c29fd06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:50.964823 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d217fbb-1cb0-43b4-86d6-8e711237946b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:45:50.965406 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d217fbb-1cb0-43b4-86d6-8e711237946b admin admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:50.965678 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d217fbb-1cb0-43b4-86d6-8e711237946b admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:50.965963 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d217fbb-1cb0-43b4-86d6-8e711237946b admin admin] PATH_INFO: `/v3/domains` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:50.966833 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d217fbb-1cb0-43b4-86d6-8e711237946b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:45:50.967135 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d217fbb-1cb0-43b4-86d6-8e711237946b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:45:50.968776 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d217fbb-1cb0-43b4-86d6-8e711237946b admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:45:50.978420 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-9b36f52c-0dc4-44a5-bfcd-1b8b9c29fd06 None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:45:50.980123 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-9b36f52c-0dc4-44a5-bfcd-1b8b9c29fd06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:45:50.981912 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 793/1571] 10.222.0.26 () {58 vars in 1153 bytes} [Wed Aug 24 05:45:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:45:50.982687 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d217fbb-1cb0-43b4-86d6-8e711237946b admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:45:50.994409 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 779/1572] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:45:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:45:50.995618 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb3486a-6fee-4754-ba86-4537d3f0b554 None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:50.995907 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb3486a-6fee-4754-ba86-4537d3f0b554 None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:50.996181 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb3486a-6fee-4754-ba86-4537d3f0b554 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:50.999516 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d217fbb-1cb0-43b4-86d6-8e711237946b admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:45:51.004107 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f0b00c-03cd-452a-9a65-0b9a2c828f1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:45:51.004699 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f0b00c-03cd-452a-9a65-0b9a2c828f1a admin admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:51.005015 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f0b00c-03cd-452a-9a65-0b9a2c828f1a admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:51.005303 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f0b00c-03cd-452a-9a65-0b9a2c828f1a admin admin] PATH_INFO: `/v3/domains` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:51.005968 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f0b00c-03cd-452a-9a65-0b9a2c828f1a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:45:51.006277 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f0b00c-03cd-452a-9a65-0b9a2c828f1a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:45:51.007868 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f0b00c-03cd-452a-9a65-0b9a2c828f1a admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:45:51.019951 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 794/1573] 10.222.0.26 () {58 vars in 1153 bytes} [Wed Aug 24 05:45:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:45:51.027069 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f0b00c-03cd-452a-9a65-0b9a2c828f1a admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:45:51.032027 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f0b00c-03cd-452a-9a65-0b9a2c828f1a admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:45:51.033847 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-ecb3486a-6fee-4754-ba86-4537d3f0b554 None None] MFA Rules not processed for user `7b633e1aec6c4269bce13aa9c89e911a`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:45:51.035091 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-ecb3486a-6fee-4754-ba86-4537d3f0b554 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:45:51.036807 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75c700e-21cb-4dd0-ac90-e314bf844bde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:45:51.037402 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75c700e-21cb-4dd0-ac90-e314bf844bde admin admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:51.037684 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75c700e-21cb-4dd0-ac90-e314bf844bde admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:51.037977 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75c700e-21cb-4dd0-ac90-e314bf844bde admin admin] PATH_INFO: `/v3/domains` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:51.038621 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75c700e-21cb-4dd0-ac90-e314bf844bde admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:45:51.038927 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75c700e-21cb-4dd0-ac90-e314bf844bde admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:45:51.040514 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75c700e-21cb-4dd0-ac90-e314bf844bde admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:45:51.052823 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 795/1574] 10.222.0.26 () {58 vars in 1153 bytes} [Wed Aug 24 05:45:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:45:51.052823 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75c700e-21cb-4dd0-ac90-e314bf844bde admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:45:51.063455 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75c700e-21cb-4dd0-ac90-e314bf844bde admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:45:51.067992 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f706e8-766a-427e-a82c-86a035ed7fac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:45:51.068558 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f706e8-766a-427e-a82c-86a035ed7fac admin admin] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:51.068836 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f706e8-766a-427e-a82c-86a035ed7fac admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:51.069132 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f706e8-766a-427e-a82c-86a035ed7fac admin admin] PATH_INFO: `/v3/projects` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:51.069770 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f706e8-766a-427e-a82c-86a035ed7fac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:45:51.071946 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f706e8-766a-427e-a82c-86a035ed7fac admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:45:51.102341 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 796/1575] 10.222.0.26 () {60 vars in 1153 bytes} [Wed Aug 24 05:45:51 2022] POST /identity/v3/projects => generated 363 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:45:51.102341 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f706e8-766a-427e-a82c-86a035ed7fac admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:45:51.106758 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 780/1576] 10.222.0.26 () {58 vars in 1059 bytes} [Wed Aug 24 05:45:50 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:45:51.107580 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb3486a-6fee-4754-ba86-4537d3f0b554 None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:45:51.118830 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb3486a-6fee-4754-ba86-4537d3f0b554 None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:45:51.151468 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:45:51.165906 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f706e8-766a-427e-a82c-86a035ed7fac admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:45:51.171220 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc62133-cfb5-43cc-ba66-389c79fdedd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:45:51.171820 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc62133-cfb5-43cc-ba66-389c79fdedd5 admin admin] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:51.172099 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc62133-cfb5-43cc-ba66-389c79fdedd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:51.172364 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc62133-cfb5-43cc-ba66-389c79fdedd5 admin admin] PATH_INFO: `/v3/projects` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:51.172982 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc62133-cfb5-43cc-ba66-389c79fdedd5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:45:51.174926 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc62133-cfb5-43cc-ba66-389c79fdedd5 admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:45:51.177665 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df95251e-7291-431b-892c-aca8e7e524e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:45:51.178389 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df95251e-7291-431b-892c-aca8e7e524e6 admin admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:51.178745 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df95251e-7291-431b-892c-aca8e7e524e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:51.179111 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df95251e-7291-431b-892c-aca8e7e524e6 admin admin] PATH_INFO: `/v3/domains` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:51.179747 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df95251e-7291-431b-892c-aca8e7e524e6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:45:51.180247 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df95251e-7291-431b-892c-aca8e7e524e6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:45:51.181907 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df95251e-7291-431b-892c-aca8e7e524e6 admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:45:51.198006 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 781/1577] 10.222.0.26 () {58 vars in 1153 bytes} [Wed Aug 24 05:45:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:45:51.199047 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df95251e-7291-431b-892c-aca8e7e524e6 admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:45:51.206421 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 797/1578] 10.222.0.26 () {60 vars in 1153 bytes} [Wed Aug 24 05:45:51 2022] POST /identity/v3/projects => generated 385 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:45:51.206421 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc62133-cfb5-43cc-ba66-389c79fdedd5 admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:45:51.209190 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df95251e-7291-431b-892c-aca8e7e524e6 admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:45:51.269558 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc62133-cfb5-43cc-ba66-389c79fdedd5 admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:45:51.271279 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d17a92-7e0f-401c-a9fe-5c4efaa51e11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:45:51.271893 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d17a92-7e0f-401c-a9fe-5c4efaa51e11 admin admin] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:51.272173 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d17a92-7e0f-401c-a9fe-5c4efaa51e11 admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:51.272446 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d17a92-7e0f-401c-a9fe-5c4efaa51e11 admin admin] PATH_INFO: `/v3/projects` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:51.273105 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d17a92-7e0f-401c-a9fe-5c4efaa51e11 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:45:51.274278 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07db6038-ed4b-4ff3-a102-727a8737c087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:45:51.274911 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07db6038-ed4b-4ff3-a102-727a8737c087 admin admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:51.275019 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d17a92-7e0f-401c-a9fe-5c4efaa51e11 admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:45:51.275186 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07db6038-ed4b-4ff3-a102-727a8737c087 admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:51.275453 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07db6038-ed4b-4ff3-a102-727a8737c087 admin admin] PATH_INFO: `/v3/domains` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:51.276092 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07db6038-ed4b-4ff3-a102-727a8737c087 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:45:51.276390 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07db6038-ed4b-4ff3-a102-727a8737c087 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:45:51.277987 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07db6038-ed4b-4ff3-a102-727a8737c087 admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:45:51.279644 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:45:51.290491 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 798/1579] 10.222.0.26 () {58 vars in 1153 bytes} [Wed Aug 24 05:45:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:45:51.291310 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07db6038-ed4b-4ff3-a102-727a8737c087 admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:45:51.310804 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 782/1580] 10.222.0.26 () {60 vars in 1153 bytes} [Wed Aug 24 05:45:51 2022] POST /identity/v3/projects => generated 387 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:45:51.310804 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d17a92-7e0f-401c-a9fe-5c4efaa51e11 admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:45:51.314973 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07db6038-ed4b-4ff3-a102-727a8737c087 admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:45:51.390360 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f591b61-8a0d-4cb5-90c2-d3e5bb4d336f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:45:51.390873 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f591b61-8a0d-4cb5-90c2-d3e5bb4d336f admin admin] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:51.391153 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f591b61-8a0d-4cb5-90c2-d3e5bb4d336f admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:51.391427 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f591b61-8a0d-4cb5-90c2-d3e5bb4d336f admin admin] PATH_INFO: `/v3/projects` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:51.392050 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f591b61-8a0d-4cb5-90c2-d3e5bb4d336f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:45:51.393445 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d17a92-7e0f-401c-a9fe-5c4efaa51e11 admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:45:51.393978 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f591b61-8a0d-4cb5-90c2-d3e5bb4d336f admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:45:51.398438 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9156af1-4673-4364-aa54-50590d0a4b17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:45:51.399047 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9156af1-4673-4364-aa54-50590d0a4b17 admin admin] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:51.399326 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9156af1-4673-4364-aa54-50590d0a4b17 admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:51.399596 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9156af1-4673-4364-aa54-50590d0a4b17 admin admin] PATH_INFO: `/v3/projects` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:51.400214 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9156af1-4673-4364-aa54-50590d0a4b17 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:45:51.402156 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9156af1-4673-4364-aa54-50590d0a4b17 admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:45:51.421831 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 799/1581] 10.222.0.26 () {60 vars in 1153 bytes} [Wed Aug 24 05:45:51 2022] POST /identity/v3/projects => generated 405 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:45:51.422818 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f591b61-8a0d-4cb5-90c2-d3e5bb4d336f admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:45:51.433400 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 783/1582] 10.222.0.26 () {60 vars in 1153 bytes} [Wed Aug 24 05:45:51 2022] POST /identity/v3/projects => generated 377 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:45:51.434324 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9156af1-4673-4364-aa54-50590d0a4b17 admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:45:51.477199 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:45:51.489528 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f591b61-8a0d-4cb5-90c2-d3e5bb4d336f admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:45:51.511681 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9156af1-4673-4364-aa54-50590d0a4b17 admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:45:51.518107 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d88809-ffde-4e99-9725-8f2e3400e243 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b633e1aec6c4269bce13aa9c89e911a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:45:51.518107 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d88809-ffde-4e99-9725-8f2e3400e243 service nova] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:51.518649 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d88809-ffde-4e99-9725-8f2e3400e243 service nova] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:51.518985 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d88809-ffde-4e99-9725-8f2e3400e243 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:51.550710 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca1479b-e79c-40e8-8d22-b295a8dab9a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:45:51.551585 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca1479b-e79c-40e8-8d22-b295a8dab9a9 admin admin] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:51.552043 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca1479b-e79c-40e8-8d22-b295a8dab9a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:51.552473 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca1479b-e79c-40e8-8d22-b295a8dab9a9 admin admin] PATH_INFO: `/v3/users` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:51.553283 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca1479b-e79c-40e8-8d22-b295a8dab9a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:45:51.555223 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca1479b-e79c-40e8-8d22-b295a8dab9a9 admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:45:51.584932 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 800/1583] 10.222.0.26 () {60 vars in 1144 bytes} [Wed Aug 24 05:45:51 2022] POST /identity/v3/users => generated 288 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:45:51.586657 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d88809-ffde-4e99-9725-8f2e3400e243 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:45:51.586820 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca1479b-e79c-40e8-8d22-b295a8dab9a9 admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:45:51.590001 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d88809-ffde-4e99-9725-8f2e3400e243 service nova] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:45:51.598095 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca1479b-e79c-40e8-8d22-b295a8dab9a9 admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:45:51.601598 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 784/1584] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 24 05:45:51 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:45:51.602647 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d88809-ffde-4e99-9725-8f2e3400e243 service nova] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:45:51.613693 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d88809-ffde-4e99-9725-8f2e3400e243 service nova] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:45:51.619323 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0c9bc1-8c69-4fb0-9862-100015b37778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:45:51.619542 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c96faf-17a7-45b7-b9fd-eb6847cde4f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:45:51.620248 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c96faf-17a7-45b7-b9fd-eb6847cde4f3 admin admin] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:51.620444 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0c9bc1-8c69-4fb0-9862-100015b37778 admin admin] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:51.620653 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c96faf-17a7-45b7-b9fd-eb6847cde4f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:51.620992 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c96faf-17a7-45b7-b9fd-eb6847cde4f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:51.621285 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0c9bc1-8c69-4fb0-9862-100015b37778 admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:51.621716 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0c9bc1-8c69-4fb0-9862-100015b37778 admin admin] PATH_INFO: `/v3/users` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:51.621832 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c96faf-17a7-45b7-b9fd-eb6847cde4f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:45:51.622633 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0c9bc1-8c69-4fb0-9862-100015b37778 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:45:51.624035 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c96faf-17a7-45b7-b9fd-eb6847cde4f3 admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:45:51.624963 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0c9bc1-8c69-4fb0-9862-100015b37778 admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:45:51.634649 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:45:51.665249 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 785/1585] 10.222.0.26 () {60 vars in 1144 bytes} [Wed Aug 24 05:45:51 2022] POST /identity/v3/users => generated 293 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:45:51.666572 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0c9bc1-8c69-4fb0-9862-100015b37778 admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:45:51.670257 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 801/1586] 10.222.0.26 () {60 vars in 1153 bytes} [Wed Aug 24 05:45:51 2022] POST /identity/v3/projects => generated 373 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:45:51.671462 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c96faf-17a7-45b7-b9fd-eb6847cde4f3 admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:45:51.680309 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0c9bc1-8c69-4fb0-9862-100015b37778 admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:45:51.762290 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b25eab-6e7c-467a-8fac-1d25aff8e5aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:45:51.763122 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b25eab-6e7c-467a-8fac-1d25aff8e5aa admin admin] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:51.763433 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b25eab-6e7c-467a-8fac-1d25aff8e5aa admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:51.763813 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b25eab-6e7c-467a-8fac-1d25aff8e5aa admin admin] PATH_INFO: `/v3/projects` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:51.765260 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b25eab-6e7c-467a-8fac-1d25aff8e5aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:45:51.767472 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b25eab-6e7c-467a-8fac-1d25aff8e5aa admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:45:51.774020 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c96faf-17a7-45b7-b9fd-eb6847cde4f3 admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:45:51.779753 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e141a1d9-6c9a-41d3-a112-3dd9cf92c575 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:45:51.781987 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e141a1d9-6c9a-41d3-a112-3dd9cf92c575 admin admin] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:51.782301 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e141a1d9-6c9a-41d3-a112-3dd9cf92c575 admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:51.782582 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e141a1d9-6c9a-41d3-a112-3dd9cf92c575 admin admin] PATH_INFO: `/v3/users` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:51.783916 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e141a1d9-6c9a-41d3-a112-3dd9cf92c575 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:45:51.786601 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e141a1d9-6c9a-41d3-a112-3dd9cf92c575 admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:45:51.807618 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 786/1587] 10.222.0.26 () {60 vars in 1153 bytes} [Wed Aug 24 05:45:51 2022] POST /identity/v3/projects => generated 405 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:45:51.808764 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b25eab-6e7c-467a-8fac-1d25aff8e5aa admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:45:51.821975 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 802/1588] 10.222.0.26 () {60 vars in 1144 bytes} [Wed Aug 24 05:45:51 2022] POST /identity/v3/users => generated 294 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:45:51.821975 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e141a1d9-6c9a-41d3-a112-3dd9cf92c575 admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:45:51.830382 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e141a1d9-6c9a-41d3-a112-3dd9cf92c575 admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:45:51.884046 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b25eab-6e7c-467a-8fac-1d25aff8e5aa admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:45:51.888977 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe6e4b1-131b-4952-897b-99567a5de41f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:45:51.890261 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe6e4b1-131b-4952-897b-99567a5de41f admin admin] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:51.890638 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe6e4b1-131b-4952-897b-99567a5de41f admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:51.890983 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe6e4b1-131b-4952-897b-99567a5de41f admin admin] PATH_INFO: `/v3/users` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:51.891673 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe6e4b1-131b-4952-897b-99567a5de41f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:45:51.893017 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:45:51.893657 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe6e4b1-131b-4952-897b-99567a5de41f admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:45:51.900171 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c3974c-238e-433d-8b3f-60340243e3df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:45:51.900880 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c3974c-238e-433d-8b3f-60340243e3df admin admin] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:51.901312 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c3974c-238e-433d-8b3f-60340243e3df admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:51.901858 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c3974c-238e-433d-8b3f-60340243e3df admin admin] PATH_INFO: `/v3/users` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:51.902509 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c3974c-238e-433d-8b3f-60340243e3df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:45:51.904543 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c3974c-238e-433d-8b3f-60340243e3df admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:45:51.916144 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 787/1589] 10.222.0.26 () {60 vars in 1144 bytes} [Wed Aug 24 05:45:51 2022] POST /identity/v3/users => generated 303 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:45:51.917520 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe6e4b1-131b-4952-897b-99567a5de41f admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:45:51.927861 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe6e4b1-131b-4952-897b-99567a5de41f admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:45:51.928209 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 803/1590] 10.222.0.26 () {60 vars in 1144 bytes} [Wed Aug 24 05:45:51 2022] POST /identity/v3/users => generated 289 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:45:51.929066 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c3974c-238e-433d-8b3f-60340243e3df admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:45:51.934651 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f786f8cb-f21f-4f46-b0c7-efb64618b167 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:45:51.935350 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f786f8cb-f21f-4f46-b0c7-efb64618b167 admin admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:51.935701 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f786f8cb-f21f-4f46-b0c7-efb64618b167 admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:51.936497 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f786f8cb-f21f-4f46-b0c7-efb64618b167 admin admin] PATH_INFO: `/v3/roles` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:51.937165 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f786f8cb-f21f-4f46-b0c7-efb64618b167 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:45:51.938823 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f786f8cb-f21f-4f46-b0c7-efb64618b167 admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:45:51.939218 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c3974c-238e-433d-8b3f-60340243e3df admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:45:51.943791 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626017cc-2b25-41a0-bf5a-ad44b5edc9a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:45:51.944398 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626017cc-2b25-41a0-bf5a-ad44b5edc9a9 admin admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:51.944704 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626017cc-2b25-41a0-bf5a-ad44b5edc9a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:51.945111 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626017cc-2b25-41a0-bf5a-ad44b5edc9a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:51.945749 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626017cc-2b25-41a0-bf5a-ad44b5edc9a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:45:51.947693 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626017cc-2b25-41a0-bf5a-ad44b5edc9a9 admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:45:51.949155 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 788/1591] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Aug 24 05:45:51 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:45:51.949936 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f786f8cb-f21f-4f46-b0c7-efb64618b167 admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:45:51.960922 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f786f8cb-f21f-4f46-b0c7-efb64618b167 admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:45:51.963450 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 804/1592] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Aug 24 05:45:51 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:45:51.964222 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626017cc-2b25-41a0-bf5a-ad44b5edc9a9 admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:45:51.965635 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3a576d-8916-487e-b694-d427fc89603b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:45:51.966397 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3a576d-8916-487e-b694-d427fc89603b admin admin] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:51.966685 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3a576d-8916-487e-b694-d427fc89603b admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:51.966960 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3a576d-8916-487e-b694-d427fc89603b admin admin] PATH_INFO: `/v3/users` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:51.967613 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3a576d-8916-487e-b694-d427fc89603b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:45:51.969573 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3a576d-8916-487e-b694-d427fc89603b admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:45:51.974956 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626017cc-2b25-41a0-bf5a-ad44b5edc9a9 admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:45:51.979543 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc204cec-d25f-4e99-a424-c462ba4d6fbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:45:51.980206 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc204cec-d25f-4e99-a424-c462ba4d6fbd admin admin] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:51.980531 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc204cec-d25f-4e99-a424-c462ba4d6fbd admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:51.981270 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc204cec-d25f-4e99-a424-c462ba4d6fbd admin admin] PATH_INFO: `/v3/users` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:51.981579 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc204cec-d25f-4e99-a424-c462ba4d6fbd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:45:51.983654 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc204cec-d25f-4e99-a424-c462ba4d6fbd admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:45:51.991723 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 789/1593] 10.222.0.26 () {60 vars in 1144 bytes} [Wed Aug 24 05:45:51 2022] POST /identity/v3/users => generated 287 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:45:51.992543 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3a576d-8916-487e-b694-d427fc89603b admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:45:52.003254 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3a576d-8916-487e-b694-d427fc89603b admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:45:52.008943 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 805/1594] 10.222.0.26 () {60 vars in 1144 bytes} [Wed Aug 24 05:45:51 2022] POST /identity/v3/users => generated 303 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:45:52.008943 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b67e79e-68d1-44e9-9f11-5f3126cf8c8a None None] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:52.008943 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b67e79e-68d1-44e9-9f11-5f3126cf8c8a None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:52.008943 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b67e79e-68d1-44e9-9f11-5f3126cf8c8a None None] PATH_INFO: `/` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:52.009668 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7fc59a-6f78-4c04-a184-a35e343f7c75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:45:52.009668 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7fc59a-6f78-4c04-a184-a35e343f7c75 admin admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:52.009842 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 806/1595] 10.222.0.26 () {54 vars in 912 bytes} [Wed Aug 24 05:45:52 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:45:52.010107 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7fc59a-6f78-4c04-a184-a35e343f7c75 admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:52.010107 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7fc59a-6f78-4c04-a184-a35e343f7c75 admin admin] PATH_INFO: `/v3/roles` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:52.010107 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7fc59a-6f78-4c04-a184-a35e343f7c75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:45:52.011930 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7fc59a-6f78-4c04-a184-a35e343f7c75 admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:45:52.015667 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b67e79e-68d1-44e9-9f11-5f3126cf8c8a None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:45:52.023053 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 790/1596] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Aug 24 05:45:51 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:45:52.024127 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7fc59a-6f78-4c04-a184-a35e343f7c75 admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:45:52.030916 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b67e79e-68d1-44e9-9f11-5f3126cf8c8a None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:45:52.033622 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7fc59a-6f78-4c04-a184-a35e343f7c75 admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:45:52.035343 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425c1fed-04dd-491c-bcff-b990c80bcdeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:45:52.035988 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425c1fed-04dd-491c-bcff-b990c80bcdeb admin admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:52.036288 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425c1fed-04dd-491c-bcff-b990c80bcdeb admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:52.036556 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425c1fed-04dd-491c-bcff-b990c80bcdeb admin admin] PATH_INFO: `/v3/roles` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:52.037222 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425c1fed-04dd-491c-bcff-b990c80bcdeb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:45:52.038130 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0c7a60-4bba-4ffc-837c-22e6de7c15ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:45:52.038707 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0c7a60-4bba-4ffc-837c-22e6de7c15ad admin admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:52.038887 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425c1fed-04dd-491c-bcff-b990c80bcdeb admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:45:52.039016 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0c7a60-4bba-4ffc-837c-22e6de7c15ad admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:52.039241 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0c7a60-4bba-4ffc-837c-22e6de7c15ad admin admin] PATH_INFO: `/v3/roles` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:52.039870 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0c7a60-4bba-4ffc-837c-22e6de7c15ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:45:52.041451 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0c7a60-4bba-4ffc-837c-22e6de7c15ad admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:45:52.048891 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 807/1597] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Aug 24 05:45:52 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:45:52.049732 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425c1fed-04dd-491c-bcff-b990c80bcdeb admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:45:52.051536 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 791/1598] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Aug 24 05:45:52 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:45:52.052331 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0c7a60-4bba-4ffc-837c-22e6de7c15ad admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:45:52.062562 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0c7a60-4bba-4ffc-837c-22e6de7c15ad admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:45:52.062912 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425c1fed-04dd-491c-bcff-b990c80bcdeb admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:45:52.067566 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228f299a-b762-4f65-83e0-8121741c385a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:45:52.068135 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228f299a-b762-4f65-83e0-8121741c385a admin admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:52.068413 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228f299a-b762-4f65-83e0-8121741c385a admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:52.068680 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228f299a-b762-4f65-83e0-8121741c385a admin admin] PATH_INFO: `/v3/roles` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:52.069303 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228f299a-b762-4f65-83e0-8121741c385a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:45:52.069534 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dcfb55-3313-4265-830f-460b0c28f843 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:45:52.070207 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dcfb55-3313-4265-830f-460b0c28f843 admin admin] REQUEST_METHOD: `PUT` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:52.070487 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dcfb55-3313-4265-830f-460b0c28f843 admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:52.070766 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dcfb55-3313-4265-830f-460b0c28f843 admin admin] PATH_INFO: `/v3/projects/4e2ad929ef9d451ab0e692769bfbde49/users/e6dd2f14ef284422a43da62b58dda569/roles/640bda0879494e60b72680ee505285f0` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:52.070916 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228f299a-b762-4f65-83e0-8121741c385a admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:45:52.082215 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 792/1599] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Aug 24 05:45:52 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:45:52.083241 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228f299a-b762-4f65-83e0-8121741c385a admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:45:52.087420 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99dcfb55-3313-4265-830f-460b0c28f843 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e2ad929ef9d451ab0e692769bfbde49, user_id=e6dd2f14ef284422a43da62b58dda569, role_id=640bda0879494e60b72680ee505285f0)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:45:52.088212 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:INSERT=10,keystone:SELECT=90 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:45:52.088477 dv-cinder-854268-1-smb devstack@keystone.service[88113]: WARNING py.warnings [None req-99dcfb55-3313-4265-830f-460b0c28f843 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 05:45:52.088477 dv-cinder-854268-1-smb devstack@keystone.service[88113]: warnings.warn(msg) Aug 24 05:45:52.088477 dv-cinder-854268-1-smb devstack@keystone.service[88113]: Aug 24 05:45:52.090540 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99dcfb55-3313-4265-830f-460b0c28f843 admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:45:52.093855 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228f299a-b762-4f65-83e0-8121741c385a admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:45:52.100290 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7892466-c343-4513-8ea3-7b0554818eb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:45:52.100880 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7892466-c343-4513-8ea3-7b0554818eb6 admin admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:52.101156 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7892466-c343-4513-8ea3-7b0554818eb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:52.101436 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7892466-c343-4513-8ea3-7b0554818eb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:52.102112 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7892466-c343-4513-8ea3-7b0554818eb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:45:52.103693 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7892466-c343-4513-8ea3-7b0554818eb6 admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:45:52.104079 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 808/1600] 10.222.0.26 () {60 vars in 1483 bytes} [Wed Aug 24 05:45:52 2022] PUT /identity/v3/projects/4e2ad929ef9d451ab0e692769bfbde49/users/e6dd2f14ef284422a43da62b58dda569/roles/640bda0879494e60b72680ee505285f0 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:45:52.104874 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dcfb55-3313-4265-830f-460b0c28f843 admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:45:52.116318 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 793/1601] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Aug 24 05:45:52 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:45:52.117864 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29e5840-59e2-4fd6-8b55-1ab258569b80 None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:52.118343 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29e5840-59e2-4fd6-8b55-1ab258569b80 None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:52.118598 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29e5840-59e2-4fd6-8b55-1ab258569b80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:52.137431 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-e29e5840-59e2-4fd6-8b55-1ab258569b80 None None] MFA Rules not processed for user `7b633e1aec6c4269bce13aa9c89e911a`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:45:52.138700 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-e29e5840-59e2-4fd6-8b55-1ab258569b80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:45:52.169213 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dcfb55-3313-4265-830f-460b0c28f843 admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:45:52.174118 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c667e74-30f0-4b49-8d5e-3b7781db1898 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:45:52.174779 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c667e74-30f0-4b49-8d5e-3b7781db1898 admin admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:52.175065 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c667e74-30f0-4b49-8d5e-3b7781db1898 admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:52.175337 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c667e74-30f0-4b49-8d5e-3b7781db1898 admin admin] PATH_INFO: `/v3/roles` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:52.176020 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c667e74-30f0-4b49-8d5e-3b7781db1898 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:45:52.177626 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c667e74-30f0-4b49-8d5e-3b7781db1898 admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:45:52.188140 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 809/1602] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Aug 24 05:45:52 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:45:52.189090 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c667e74-30f0-4b49-8d5e-3b7781db1898 admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:45:52.198653 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c667e74-30f0-4b49-8d5e-3b7781db1898 admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:45:52.203746 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e90b6c-7248-44e9-a9b4-962d6a054609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:45:52.204326 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e90b6c-7248-44e9-a9b4-962d6a054609 admin admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:52.204603 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e90b6c-7248-44e9-a9b4-962d6a054609 admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:52.204872 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e90b6c-7248-44e9-a9b4-962d6a054609 admin admin] PATH_INFO: `/v3/roles` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:52.205495 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e90b6c-7248-44e9-a9b4-962d6a054609 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:45:52.207076 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e90b6c-7248-44e9-a9b4-962d6a054609 admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:45:52.210244 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 794/1603] 10.222.0.26 () {58 vars in 1009 bytes} [Wed Aug 24 05:45:52 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:45:52.211139 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29e5840-59e2-4fd6-8b55-1ab258569b80 None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:45:52.216824 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 810/1604] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Aug 24 05:45:52 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:45:52.218166 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e90b6c-7248-44e9-a9b4-962d6a054609 admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:45:52.225006 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29e5840-59e2-4fd6-8b55-1ab258569b80 None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:45:52.227749 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e90b6c-7248-44e9-a9b4-962d6a054609 admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:45:52.229630 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f743b4-297c-4254-9472-99eba4f10123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:45:52.230260 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f743b4-297c-4254-9472-99eba4f10123 admin admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:52.230543 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f743b4-297c-4254-9472-99eba4f10123 admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:52.230820 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f743b4-297c-4254-9472-99eba4f10123 admin admin] PATH_INFO: `/v3/roles` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:52.231466 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f743b4-297c-4254-9472-99eba4f10123 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:45:52.232378 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565ba72c-ac04-48e2-bc7b-2ba48674b815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:45:52.232984 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565ba72c-ac04-48e2-bc7b-2ba48674b815 admin admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:52.233107 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f743b4-297c-4254-9472-99eba4f10123 admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:45:52.233263 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565ba72c-ac04-48e2-bc7b-2ba48674b815 admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:52.233533 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565ba72c-ac04-48e2-bc7b-2ba48674b815 admin admin] PATH_INFO: `/v3/roles` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:52.234192 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565ba72c-ac04-48e2-bc7b-2ba48674b815 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:45:52.235765 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565ba72c-ac04-48e2-bc7b-2ba48674b815 admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:45:52.243099 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 795/1605] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Aug 24 05:45:52 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:45:52.243878 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f743b4-297c-4254-9472-99eba4f10123 admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:45:52.246387 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 811/1606] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Aug 24 05:45:52 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:45:52.247365 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565ba72c-ac04-48e2-bc7b-2ba48674b815 admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:45:52.254899 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f743b4-297c-4254-9472-99eba4f10123 admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:45:52.257080 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565ba72c-ac04-48e2-bc7b-2ba48674b815 admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:45:52.259589 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933294ee-eaf7-4bf8-a387-d9845d6e5073 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:45:52.260230 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933294ee-eaf7-4bf8-a387-d9845d6e5073 admin admin] REQUEST_METHOD: `PUT` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:52.260510 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933294ee-eaf7-4bf8-a387-d9845d6e5073 admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:52.260782 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933294ee-eaf7-4bf8-a387-d9845d6e5073 admin admin] PATH_INFO: `/v3/projects/2a4d71caaba544369ced7c8272c02eec/users/7ea384c1544c424eb2b524760e1d6d22/roles/f7aa4a2c74c94c1b9ca8ecdcccccda5c` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:52.261801 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34b84a5-8bbd-428e-9007-c7d4b6253c8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:45:52.262395 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34b84a5-8bbd-428e-9007-c7d4b6253c8b admin admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:52.262673 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34b84a5-8bbd-428e-9007-c7d4b6253c8b admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:52.262942 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34b84a5-8bbd-428e-9007-c7d4b6253c8b admin admin] PATH_INFO: `/v3/roles` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:52.263564 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34b84a5-8bbd-428e-9007-c7d4b6253c8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:45:52.265731 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34b84a5-8bbd-428e-9007-c7d4b6253c8b admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:45:52.275421 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 812/1607] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Aug 24 05:45:52 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:45:52.276191 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34b84a5-8bbd-428e-9007-c7d4b6253c8b admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:45:52.279703 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933294ee-eaf7-4bf8-a387-d9845d6e5073 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a4d71caaba544369ced7c8272c02eec, user_id=7ea384c1544c424eb2b524760e1d6d22, role_id=f7aa4a2c74c94c1b9ca8ecdcccccda5c)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:45:52.283402 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933294ee-eaf7-4bf8-a387-d9845d6e5073 admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:45:52.288006 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34b84a5-8bbd-428e-9007-c7d4b6253c8b admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:45:52.293547 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b72b31a-5ad2-4bf7-93e9-3c4806e42e10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:45:52.294220 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b72b31a-5ad2-4bf7-93e9-3c4806e42e10 admin admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:52.294649 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b72b31a-5ad2-4bf7-93e9-3c4806e42e10 admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:52.294931 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b72b31a-5ad2-4bf7-93e9-3c4806e42e10 admin admin] PATH_INFO: `/v3/roles` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:52.295601 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b72b31a-5ad2-4bf7-93e9-3c4806e42e10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:45:52.297334 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b72b31a-5ad2-4bf7-93e9-3c4806e42e10 admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:45:52.303174 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 796/1608] 10.222.0.26 () {60 vars in 1483 bytes} [Wed Aug 24 05:45:52 2022] PUT /identity/v3/projects/2a4d71caaba544369ced7c8272c02eec/users/7ea384c1544c424eb2b524760e1d6d22/roles/f7aa4a2c74c94c1b9ca8ecdcccccda5c => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:45:52.306958 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933294ee-eaf7-4bf8-a387-d9845d6e5073 admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:45:52.307319 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 813/1609] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Aug 24 05:45:52 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:45:52.308075 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b72b31a-5ad2-4bf7-93e9-3c4806e42e10 admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:45:52.320775 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b72b31a-5ad2-4bf7-93e9-3c4806e42e10 admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:45:52.356090 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:45:52.372658 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933294ee-eaf7-4bf8-a387-d9845d6e5073 admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:45:52.377980 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f140ee20-2b9a-490e-9e6d-4ce4d3b9d9fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:45:52.378573 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f140ee20-2b9a-490e-9e6d-4ce4d3b9d9fe admin admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:52.378848 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f140ee20-2b9a-490e-9e6d-4ce4d3b9d9fe admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:52.379117 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f140ee20-2b9a-490e-9e6d-4ce4d3b9d9fe admin admin] PATH_INFO: `/v3/roles` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:52.379757 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f140ee20-2b9a-490e-9e6d-4ce4d3b9d9fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:45:52.381342 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f140ee20-2b9a-490e-9e6d-4ce4d3b9d9fe admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:45:52.384043 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5c77bb-d42a-4e44-9b6a-1afb06326283 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:45:52.384702 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5c77bb-d42a-4e44-9b6a-1afb06326283 admin admin] REQUEST_METHOD: `PUT` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:52.384983 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5c77bb-d42a-4e44-9b6a-1afb06326283 admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:52.385255 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5c77bb-d42a-4e44-9b6a-1afb06326283 admin admin] PATH_INFO: `/v3/projects/70285544fbc045ea8c685e7f84309fdc/users/568d477011b84cc89b9285b5172d091f/roles/f7aa4a2c74c94c1b9ca8ecdcccccda5c` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:52.391200 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 797/1610] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Aug 24 05:45:52 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:45:52.394824 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f140ee20-2b9a-490e-9e6d-4ce4d3b9d9fe admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:45:52.401719 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5c77bb-d42a-4e44-9b6a-1afb06326283 admin admin] RBAC: Authorizing `identity:create_grant(project_id=70285544fbc045ea8c685e7f84309fdc, user_id=568d477011b84cc89b9285b5172d091f, role_id=f7aa4a2c74c94c1b9ca8ecdcccccda5c)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:45:52.406131 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5c77bb-d42a-4e44-9b6a-1afb06326283 admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:45:52.421900 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 814/1611] 10.222.0.26 () {60 vars in 1483 bytes} [Wed Aug 24 05:45:52 2022] PUT /identity/v3/projects/70285544fbc045ea8c685e7f84309fdc/users/568d477011b84cc89b9285b5172d091f/roles/f7aa4a2c74c94c1b9ca8ecdcccccda5c => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:45:52.422370 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5c77bb-d42a-4e44-9b6a-1afb06326283 admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:45:52.444313 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:45:52.454472 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f140ee20-2b9a-490e-9e6d-4ce4d3b9d9fe admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:45:52.488722 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5c77bb-d42a-4e44-9b6a-1afb06326283 admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:45:52.493332 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257f3c9d-5f5d-4831-a6a2-77a70b45418c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:45:52.494137 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257f3c9d-5f5d-4831-a6a2-77a70b45418c admin admin] REQUEST_METHOD: `PUT` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:52.494415 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257f3c9d-5f5d-4831-a6a2-77a70b45418c admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:52.494713 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257f3c9d-5f5d-4831-a6a2-77a70b45418c admin admin] PATH_INFO: `/v3/projects/e6f502d8cf63494abf3218be014ed916/users/3ab358239f22426589b1ea4a2269de15/roles/f7aa4a2c74c94c1b9ca8ecdcccccda5c` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:52.504318 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d449c88-0757-4710-99c7-b788892bd3ef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17b450afe795495680fc70f522c83750', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:45:52.504934 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d449c88-0757-4710-99c7-b788892bd3ef service cinder] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:52.505243 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d449c88-0757-4710-99c7-b788892bd3ef service cinder] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:52.505517 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d449c88-0757-4710-99c7-b788892bd3ef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:52.510434 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257f3c9d-5f5d-4831-a6a2-77a70b45418c admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6f502d8cf63494abf3218be014ed916, user_id=3ab358239f22426589b1ea4a2269de15, role_id=f7aa4a2c74c94c1b9ca8ecdcccccda5c)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:45:52.513048 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257f3c9d-5f5d-4831-a6a2-77a70b45418c admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:45:52.526925 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 815/1612] 10.222.0.26 () {60 vars in 1483 bytes} [Wed Aug 24 05:45:52 2022] PUT /identity/v3/projects/e6f502d8cf63494abf3218be014ed916/users/3ab358239f22426589b1ea4a2269de15/roles/f7aa4a2c74c94c1b9ca8ecdcccccda5c => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:45:52.531577 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257f3c9d-5f5d-4831-a6a2-77a70b45418c admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:45:52.576170 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d449c88-0757-4710-99c7-b788892bd3ef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:45:52.577610 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d449c88-0757-4710-99c7-b788892bd3ef service cinder] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:45:52.588596 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 798/1613] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 24 05:45:52 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:45:52.589371 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d449c88-0757-4710-99c7-b788892bd3ef service cinder] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:45:52.599000 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d449c88-0757-4710-99c7-b788892bd3ef service cinder] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:45:52.600166 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257f3c9d-5f5d-4831-a6a2-77a70b45418c admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:45:52.603594 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa58d294-2bc0-4f46-b981-75d53990b973 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:45:52.604269 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa58d294-2bc0-4f46-b981-75d53990b973 admin admin] REQUEST_METHOD: `PUT` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:52.604549 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa58d294-2bc0-4f46-b981-75d53990b973 admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:52.604818 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa58d294-2bc0-4f46-b981-75d53990b973 admin admin] PATH_INFO: `/v3/projects/4e2ad929ef9d451ab0e692769bfbde49/users/e6dd2f14ef284422a43da62b58dda569/roles/640bda0879494e60b72680ee505285f0` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:52.605309 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c872368-2f7a-4ef7-8a58-d999184aabdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:45:52.605974 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c872368-2f7a-4ef7-8a58-d999184aabdc admin admin] REQUEST_METHOD: `PUT` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:52.606275 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c872368-2f7a-4ef7-8a58-d999184aabdc admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:52.606547 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c872368-2f7a-4ef7-8a58-d999184aabdc admin admin] PATH_INFO: `/v3/projects/9d16aa67bef1460d8bfeaaf93abe4204/users/73d475856548486db6fa9277475c80fe/roles/f7aa4a2c74c94c1b9ca8ecdcccccda5c` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:52.606874 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa58d294-2bc0-4f46-b981-75d53990b973 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e2ad929ef9d451ab0e692769bfbde49, user_id=e6dd2f14ef284422a43da62b58dda569, role_id=640bda0879494e60b72680ee505285f0)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:45:52.610140 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa58d294-2bc0-4f46-b981-75d53990b973 admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:45:52.620953 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 799/1614] 10.222.0.26 () {60 vars in 1483 bytes} [Wed Aug 24 05:45:52 2022] PUT /identity/v3/projects/4e2ad929ef9d451ab0e692769bfbde49/users/e6dd2f14ef284422a43da62b58dda569/roles/640bda0879494e60b72680ee505285f0 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:45:52.622224 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173bb6c8-e648-4a69-831b-6140ca41061d None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:52.622509 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173bb6c8-e648-4a69-831b-6140ca41061d None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:52.622779 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173bb6c8-e648-4a69-831b-6140ca41061d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:52.632563 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c872368-2f7a-4ef7-8a58-d999184aabdc admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d16aa67bef1460d8bfeaaf93abe4204, user_id=73d475856548486db6fa9277475c80fe, role_id=f7aa4a2c74c94c1b9ca8ecdcccccda5c)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:45:52.635267 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c872368-2f7a-4ef7-8a58-d999184aabdc admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:45:52.642588 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-173bb6c8-e648-4a69-831b-6140ca41061d None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:45:52.643739 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-173bb6c8-e648-4a69-831b-6140ca41061d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:45:52.650899 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 816/1615] 10.222.0.26 () {60 vars in 1483 bytes} [Wed Aug 24 05:45:52 2022] PUT /identity/v3/projects/9d16aa67bef1460d8bfeaaf93abe4204/users/73d475856548486db6fa9277475c80fe/roles/f7aa4a2c74c94c1b9ca8ecdcccccda5c => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:45:52.654903 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c872368-2f7a-4ef7-8a58-d999184aabdc admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:45:52.684607 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:45:52.716274 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 800/1616] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:45:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:45:52.718040 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173bb6c8-e648-4a69-831b-6140ca41061d None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:45:52.727956 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173bb6c8-e648-4a69-831b-6140ca41061d None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:45:52.730344 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c872368-2f7a-4ef7-8a58-d999184aabdc admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:45:52.732767 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333cd8ea-36b6-45dc-b427-42e1830d9fb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:45:52.734098 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333cd8ea-36b6-45dc-b427-42e1830d9fb5 admin admin] REQUEST_METHOD: `PUT` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:52.734337 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333cd8ea-36b6-45dc-b427-42e1830d9fb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:52.734614 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333cd8ea-36b6-45dc-b427-42e1830d9fb5 admin admin] PATH_INFO: `/v3/projects/66465a0efdf740a48e6d5c8587934c7b/users/92203f62c9d5424bb93ae6404f948ccd/roles/f7aa4a2c74c94c1b9ca8ecdcccccda5c` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:52.735752 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe64a04-1d3a-4916-9251-e8c4af0b3f7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:45:52.736431 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe64a04-1d3a-4916-9251-e8c4af0b3f7c admin admin] REQUEST_METHOD: `PUT` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:52.736927 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe64a04-1d3a-4916-9251-e8c4af0b3f7c admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:52.737206 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe64a04-1d3a-4916-9251-e8c4af0b3f7c admin admin] PATH_INFO: `/v3/projects/23e2b9b2a7fe49fdb5a6ccdbdca9859a/users/f2b14c8cd5e349d5b4ce4f0bc8d520b1/roles/f7aa4a2c74c94c1b9ca8ecdcccccda5c` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:52.750143 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333cd8ea-36b6-45dc-b427-42e1830d9fb5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=66465a0efdf740a48e6d5c8587934c7b, user_id=92203f62c9d5424bb93ae6404f948ccd, role_id=f7aa4a2c74c94c1b9ca8ecdcccccda5c)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:45:52.752659 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333cd8ea-36b6-45dc-b427-42e1830d9fb5 admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:45:52.754368 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe64a04-1d3a-4916-9251-e8c4af0b3f7c admin admin] RBAC: Authorizing `identity:create_grant(project_id=23e2b9b2a7fe49fdb5a6ccdbdca9859a, user_id=f2b14c8cd5e349d5b4ce4f0bc8d520b1, role_id=f7aa4a2c74c94c1b9ca8ecdcccccda5c)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:45:52.757356 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe64a04-1d3a-4916-9251-e8c4af0b3f7c admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:45:52.767681 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 801/1617] 10.222.0.26 () {60 vars in 1483 bytes} [Wed Aug 24 05:45:52 2022] PUT /identity/v3/projects/66465a0efdf740a48e6d5c8587934c7b/users/92203f62c9d5424bb93ae6404f948ccd/roles/f7aa4a2c74c94c1b9ca8ecdcccccda5c => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:45:52.769077 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac72871-d635-4ab3-8c89-6db2b7fefbbc None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:52.769425 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac72871-d635-4ab3-8c89-6db2b7fefbbc None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:52.769700 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac72871-d635-4ab3-8c89-6db2b7fefbbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:52.782132 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 817/1618] 10.222.0.26 () {60 vars in 1483 bytes} [Wed Aug 24 05:45:52 2022] PUT /identity/v3/projects/23e2b9b2a7fe49fdb5a6ccdbdca9859a/users/f2b14c8cd5e349d5b4ce4f0bc8d520b1/roles/f7aa4a2c74c94c1b9ca8ecdcccccda5c => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:45:52.782132 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd3c778-e5c2-4368-98db-076481f73f2b None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:52.782132 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd3c778-e5c2-4368-98db-076481f73f2b None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:52.782132 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd3c778-e5c2-4368-98db-076481f73f2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:52.789745 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:45:52.802943 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-dac72871-d635-4ab3-8c89-6db2b7fefbbc None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:45:52.804829 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-dac72871-d635-4ab3-8c89-6db2b7fefbbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:45:52.805896 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-4bd3c778-e5c2-4368-98db-076481f73f2b None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:45:52.807140 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-4bd3c778-e5c2-4368-98db-076481f73f2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:45:52.870508 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 818/1619] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:45:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:45:52.871807 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 802/1620] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:45:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:45:52.872325 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b44ed15-0514-439a-87cb-4d49803428cf None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:52.872789 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b44ed15-0514-439a-87cb-4d49803428cf None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:52.873193 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b44ed15-0514-439a-87cb-4d49803428cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:52.873315 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d12423b-1f56-4576-8f34-9ea7a2bb05b7 None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:52.873513 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d12423b-1f56-4576-8f34-9ea7a2bb05b7 None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:52.878504 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d12423b-1f56-4576-8f34-9ea7a2bb05b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:52.900504 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-5d12423b-1f56-4576-8f34-9ea7a2bb05b7 None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:45:52.902059 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-5d12423b-1f56-4576-8f34-9ea7a2bb05b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:45:52.904246 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-0b44ed15-0514-439a-87cb-4d49803428cf None None] MFA Rules not processed for user `e6dd2f14ef284422a43da62b58dda569`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:45:52.905988 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-0b44ed15-0514-439a-87cb-4d49803428cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:45:52.911481 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 803/1621] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:45:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:45:52.912110 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d12423b-1f56-4576-8f34-9ea7a2bb05b7 None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:45:52.972325 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d12423b-1f56-4576-8f34-9ea7a2bb05b7 None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:45:52.977863 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a479865-8818-4d53-85ba-97664a19886e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '874348b647194ac2b5ecbf12c33bf59e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:45:52.978630 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a479865-8818-4d53-85ba-97664a19886e service neutron] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:52.978912 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a479865-8818-4d53-85ba-97664a19886e service neutron] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:52.979188 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a479865-8818-4d53-85ba-97664a19886e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:52.989057 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a479865-8818-4d53-85ba-97664a19886e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:45:52.989475 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 819/1622] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:45:52 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:45:52.990910 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a479865-8818-4d53-85ba-97664a19886e service neutron] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:45:52.991936 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d427338-fd58-4d6a-8770-3c1b3eee7160 None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:52.992055 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d427338-fd58-4d6a-8770-3c1b3eee7160 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:52.992378 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d427338-fd58-4d6a-8770-3c1b3eee7160 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:53.002503 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 804/1623] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 24 05:45:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:45:53.014174 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8281be1e-2bef-469f-bd0a-9d34ded00adf None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:53.016988 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8281be1e-2bef-469f-bd0a-9d34ded00adf None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:53.017272 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8281be1e-2bef-469f-bd0a-9d34ded00adf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:53.026222 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-6d427338-fd58-4d6a-8770-3c1b3eee7160 None None] MFA Rules not processed for user `92203f62c9d5424bb93ae6404f948ccd`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:45:53.028035 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-6d427338-fd58-4d6a-8770-3c1b3eee7160 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:45:53.052381 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-8281be1e-2bef-469f-bd0a-9d34ded00adf None None] MFA Rules not processed for user `f2b14c8cd5e349d5b4ce4f0bc8d520b1`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:45:53.053809 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-8281be1e-2bef-469f-bd0a-9d34ded00adf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:45:53.065744 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:45:53.157942 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 805/1624] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:45:53 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:45:53.157942 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8281be1e-2bef-469f-bd0a-9d34ded00adf None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:45:53.171020 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 820/1625] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:45:52 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:45:53.171947 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d427338-fd58-4d6a-8770-3c1b3eee7160 None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:45:53.174092 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8281be1e-2bef-469f-bd0a-9d34ded00adf None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:45:53.181492 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bda9555-f698-4f2b-a9e7-e8076b74d7c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '874348b647194ac2b5ecbf12c33bf59e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:45:53.182526 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bda9555-f698-4f2b-a9e7-e8076b74d7c3 service neutron] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:53.183186 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bda9555-f698-4f2b-a9e7-e8076b74d7c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:53.183691 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bda9555-f698-4f2b-a9e7-e8076b74d7c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:53.195561 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d427338-fd58-4d6a-8770-3c1b3eee7160 None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:45:53.202388 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bda9555-f698-4f2b-a9e7-e8076b74d7c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:45:53.204667 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bda9555-f698-4f2b-a9e7-e8076b74d7c3 service neutron] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:45:53.212472 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861398f8-32e6-4e3e-ac8e-c6f736f429ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '874348b647194ac2b5ecbf12c33bf59e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:45:53.213098 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861398f8-32e6-4e3e-ac8e-c6f736f429ed service neutron] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:53.213377 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861398f8-32e6-4e3e-ac8e-c6f736f429ed service neutron] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:53.213650 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861398f8-32e6-4e3e-ac8e-c6f736f429ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:53.216435 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 806/1626] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 24 05:45:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:45:53.217990 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bda9555-f698-4f2b-a9e7-e8076b74d7c3 service neutron] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:45:53.227150 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bda9555-f698-4f2b-a9e7-e8076b74d7c3 service neutron] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:45:53.232778 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdd505c-5c69-4f83-b0d8-59e8830dbc6e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '874348b647194ac2b5ecbf12c33bf59e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:45:53.233483 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdd505c-5c69-4f83-b0d8-59e8830dbc6e service neutron] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:53.233906 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdd505c-5c69-4f83-b0d8-59e8830dbc6e service neutron] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:53.234418 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdd505c-5c69-4f83-b0d8-59e8830dbc6e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:53.238967 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861398f8-32e6-4e3e-ac8e-c6f736f429ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:45:53.240622 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861398f8-32e6-4e3e-ac8e-c6f736f429ed service neutron] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:45:53.245792 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdd505c-5c69-4f83-b0d8-59e8830dbc6e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:45:53.248171 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdd505c-5c69-4f83-b0d8-59e8830dbc6e service neutron] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:45:53.265805 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 821/1627] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 24 05:45:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:45:53.266903 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861398f8-32e6-4e3e-ac8e-c6f736f429ed service neutron] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:45:53.272979 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 807/1628] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 24 05:45:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:45:53.275728 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdd505c-5c69-4f83-b0d8-59e8830dbc6e service neutron] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:45:53.292742 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:45:53.303031 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdd505c-5c69-4f83-b0d8-59e8830dbc6e service neutron] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:45:53.311098 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e842a1c-0992-4bc0-9e39-47a3a6b2a16d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:45:53.311838 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e842a1c-0992-4bc0-9e39-47a3a6b2a16d admin admin] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:53.312010 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e842a1c-0992-4bc0-9e39-47a3a6b2a16d admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:53.316254 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e842a1c-0992-4bc0-9e39-47a3a6b2a16d admin admin] PATH_INFO: `/v3/projects` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:53.317085 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e842a1c-0992-4bc0-9e39-47a3a6b2a16d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:45:53.322210 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e842a1c-0992-4bc0-9e39-47a3a6b2a16d admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:45:53.346762 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861398f8-32e6-4e3e-ac8e-c6f736f429ed service neutron] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:45:53.351091 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3462c2a6-7e82-488f-9a26-d44ce3936a96 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17b450afe795495680fc70f522c83750', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:45:53.352070 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3462c2a6-7e82-488f-9a26-d44ce3936a96 service cinder] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:53.352439 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3462c2a6-7e82-488f-9a26-d44ce3936a96 service cinder] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:53.352757 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3462c2a6-7e82-488f-9a26-d44ce3936a96 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:53.366271 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3462c2a6-7e82-488f-9a26-d44ce3936a96 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:45:53.368368 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3462c2a6-7e82-488f-9a26-d44ce3936a96 service cinder] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:45:53.384754 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 822/1629] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 24 05:45:53 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:45:53.388230 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81ab54f-5e93-455b-a039-fdb7cf39b008 None None] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:53.388230 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81ab54f-5e93-455b-a039-fdb7cf39b008 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:53.388230 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81ab54f-5e93-455b-a039-fdb7cf39b008 None None] PATH_INFO: `/` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:53.388706 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 823/1630] 10.222.0.26 () {54 vars in 962 bytes} [Wed Aug 24 05:45:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:45:53.395536 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9760beab-2212-4154-8081-f3a9f8a8ad50 None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:53.395853 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9760beab-2212-4154-8081-f3a9f8a8ad50 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:53.396209 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9760beab-2212-4154-8081-f3a9f8a8ad50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:53.398107 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 808/1631] 10.222.0.26 () {60 vars in 1153 bytes} [Wed Aug 24 05:45:53 2022] POST /identity/v3/projects => generated 403 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:45:53.402789 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e842a1c-0992-4bc0-9e39-47a3a6b2a16d admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:45:53.431647 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-9760beab-2212-4154-8081-f3a9f8a8ad50 None None] MFA Rules not processed for user `7b633e1aec6c4269bce13aa9c89e911a`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:45:53.433142 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-9760beab-2212-4154-8081-f3a9f8a8ad50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:45:53.544346 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e842a1c-0992-4bc0-9e39-47a3a6b2a16d admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:45:53.560103 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891dfc8a-80f4-49c8-a9bd-dc819be1211a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:45:53.563290 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891dfc8a-80f4-49c8-a9bd-dc819be1211a admin admin] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:53.563574 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891dfc8a-80f4-49c8-a9bd-dc819be1211a admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:53.563864 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891dfc8a-80f4-49c8-a9bd-dc819be1211a admin admin] PATH_INFO: `/v3/users` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:53.564494 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891dfc8a-80f4-49c8-a9bd-dc819be1211a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:45:53.576348 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891dfc8a-80f4-49c8-a9bd-dc819be1211a admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:45:53.613783 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 824/1632] 10.222.0.26 () {58 vars in 1059 bytes} [Wed Aug 24 05:45:53 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:45:53.614813 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9760beab-2212-4154-8081-f3a9f8a8ad50 None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:45:53.665634 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 809/1633] 10.222.0.26 () {60 vars in 1144 bytes} [Wed Aug 24 05:45:53 2022] POST /identity/v3/users => generated 308 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:45:53.667060 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891dfc8a-80f4-49c8-a9bd-dc819be1211a admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:45:53.687745 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:45:53.688629 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891dfc8a-80f4-49c8-a9bd-dc819be1211a admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:45:53.698323 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65cdbf0-20e9-4633-878c-2681dfc913a4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b633e1aec6c4269bce13aa9c89e911a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:45:53.700179 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65cdbf0-20e9-4633-878c-2681dfc913a4 service nova] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:53.700465 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65cdbf0-20e9-4633-878c-2681dfc913a4 service nova] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:53.701162 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65cdbf0-20e9-4633-878c-2681dfc913a4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:53.705357 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9760beab-2212-4154-8081-f3a9f8a8ad50 None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:45:53.709384 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b54545c-2f93-45e4-af58-6836a5d46aa7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17b450afe795495680fc70f522c83750', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:45:53.710073 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b54545c-2f93-45e4-af58-6836a5d46aa7 service cinder] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:53.710355 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b54545c-2f93-45e4-af58-6836a5d46aa7 service cinder] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:53.710624 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b54545c-2f93-45e4-af58-6836a5d46aa7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:53.812690 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b54545c-2f93-45e4-af58-6836a5d46aa7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:45:53.814383 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b54545c-2f93-45e4-af58-6836a5d46aa7 service cinder] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:45:53.826304 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 825/1634] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 24 05:45:53 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:45:53.828341 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b54545c-2f93-45e4-af58-6836a5d46aa7 service cinder] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:45:53.841503 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b54545c-2f93-45e4-af58-6836a5d46aa7 service cinder] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:45:53.846945 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f97f96-670b-4f0b-91d9-d5785d2100dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:45:53.847548 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f97f96-670b-4f0b-91d9-d5785d2100dc admin admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:53.847914 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f97f96-670b-4f0b-91d9-d5785d2100dc admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:53.848354 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f97f96-670b-4f0b-91d9-d5785d2100dc admin admin] PATH_INFO: `/v3/roles` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:53.849072 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f97f96-670b-4f0b-91d9-d5785d2100dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:45:53.850944 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f97f96-670b-4f0b-91d9-d5785d2100dc admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:45:53.851884 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65cdbf0-20e9-4633-878c-2681dfc913a4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:45:53.853584 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65cdbf0-20e9-4633-878c-2681dfc913a4 service nova] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:45:53.867221 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 826/1635] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Aug 24 05:45:53 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:45:53.868142 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f97f96-670b-4f0b-91d9-d5785d2100dc admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:45:53.870205 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 810/1636] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 24 05:45:53 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:45:53.899450 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f97f96-670b-4f0b-91d9-d5785d2100dc admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:45:53.905237 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cc55a9-a3c2-4502-b995-d1dc3a107ff6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:45:53.905904 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cc55a9-a3c2-4502-b995-d1dc3a107ff6 admin admin] REQUEST_METHOD: `PUT` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:53.906211 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cc55a9-a3c2-4502-b995-d1dc3a107ff6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:53.906483 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cc55a9-a3c2-4502-b995-d1dc3a107ff6 admin admin] PATH_INFO: `/v3/projects/f7aabad3ec0a465aa0462d0a07214e02/users/4e7ffaa233ab424cb9b7f680491d1d6d/roles/640bda0879494e60b72680ee505285f0` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:53.925177 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cc55a9-a3c2-4502-b995-d1dc3a107ff6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7aabad3ec0a465aa0462d0a07214e02, user_id=4e7ffaa233ab424cb9b7f680491d1d6d, role_id=640bda0879494e60b72680ee505285f0)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:45:53.928740 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cc55a9-a3c2-4502-b995-d1dc3a107ff6 admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:45:53.951671 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 827/1637] 10.222.0.26 () {60 vars in 1483 bytes} [Wed Aug 24 05:45:53 2022] PUT /identity/v3/projects/f7aabad3ec0a465aa0462d0a07214e02/users/4e7ffaa233ab424cb9b7f680491d1d6d/roles/640bda0879494e60b72680ee505285f0 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:45:53.952922 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65cdbf0-20e9-4633-878c-2681dfc913a4 service nova] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:45:54.005155 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65cdbf0-20e9-4633-878c-2681dfc913a4 service nova] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:45:54.151916 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66593499-331d-41aa-bd92-cee30258ff3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:45:54.152560 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66593499-331d-41aa-bd92-cee30258ff3f admin admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:54.152876 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66593499-331d-41aa-bd92-cee30258ff3f admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:54.153093 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66593499-331d-41aa-bd92-cee30258ff3f admin admin] PATH_INFO: `/v3/roles` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:54.153821 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66593499-331d-41aa-bd92-cee30258ff3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:45:54.162090 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66593499-331d-41aa-bd92-cee30258ff3f admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:45:54.198664 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 811/1638] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Aug 24 05:45:53 2022] GET /identity/v3/roles => generated 1420 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:45:54.199889 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cc55a9-a3c2-4502-b995-d1dc3a107ff6 admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:45:54.216489 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cc55a9-a3c2-4502-b995-d1dc3a107ff6 admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:45:54.230424 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269a80c6-43b1-4d94-b44e-f74d617f41f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:45:54.231172 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269a80c6-43b1-4d94-b44e-f74d617f41f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:54.231484 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269a80c6-43b1-4d94-b44e-f74d617f41f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:54.231719 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269a80c6-43b1-4d94-b44e-f74d617f41f1 admin admin] PATH_INFO: `/v3/projects/f7aabad3ec0a465aa0462d0a07214e02/users/4e7ffaa233ab424cb9b7f680491d1d6d/roles/640bda0879494e60b72680ee505285f0` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:54.237803 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269a80c6-43b1-4d94-b44e-f74d617f41f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7aabad3ec0a465aa0462d0a07214e02, user_id=4e7ffaa233ab424cb9b7f680491d1d6d, role_id=640bda0879494e60b72680ee505285f0)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:45:54.249146 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269a80c6-43b1-4d94-b44e-f74d617f41f1 admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:45:54.282617 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 828/1639] 10.222.0.26 () {60 vars in 1483 bytes} [Wed Aug 24 05:45:54 2022] PUT /identity/v3/projects/f7aabad3ec0a465aa0462d0a07214e02/users/4e7ffaa233ab424cb9b7f680491d1d6d/roles/640bda0879494e60b72680ee505285f0 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:45:54.292743 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e081f834-7594-4383-a54e-fc59532ef1e5 None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:54.293100 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e081f834-7594-4383-a54e-fc59532ef1e5 None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:54.293447 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e081f834-7594-4383-a54e-fc59532ef1e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:54.315494 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:45:54.366009 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-e081f834-7594-4383-a54e-fc59532ef1e5 None None] MFA Rules not processed for user `4e7ffaa233ab424cb9b7f680491d1d6d`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:45:54.367260 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-e081f834-7594-4383-a54e-fc59532ef1e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:45:54.472381 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e25a27-ce73-4fbc-a16b-6f5fe4abf0bc None None] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:54.472678 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e25a27-ce73-4fbc-a16b-6f5fe4abf0bc None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:54.472968 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e25a27-ce73-4fbc-a16b-6f5fe4abf0bc None None] PATH_INFO: `/` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:54.474589 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 829/1640] 10.222.0.26 () {54 vars in 912 bytes} [Wed Aug 24 05:45:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:45:54.486864 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03315963-9adc-4eba-bb0c-83ba420ef94d None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:54.487159 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03315963-9adc-4eba-bb0c-83ba420ef94d None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:54.487451 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03315963-9adc-4eba-bb0c-83ba420ef94d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:54.539811 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-03315963-9adc-4eba-bb0c-83ba420ef94d None None] MFA Rules not processed for user `7b633e1aec6c4269bce13aa9c89e911a`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:45:54.543531 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-03315963-9adc-4eba-bb0c-83ba420ef94d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:45:54.563116 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 812/1641] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:45:54 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:45:54.570482 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e081f834-7594-4383-a54e-fc59532ef1e5 None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:45:54.735662 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e081f834-7594-4383-a54e-fc59532ef1e5 None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:45:54.743503 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 830/1642] 10.222.0.26 () {58 vars in 1009 bytes} [Wed Aug 24 05:45:54 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 05:45:54.753783 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74523dc-31fd-40b8-960d-fcac7d2de3ab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17b450afe795495680fc70f522c83750', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:45:54.755566 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74523dc-31fd-40b8-960d-fcac7d2de3ab service cinder] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:54.756882 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74523dc-31fd-40b8-960d-fcac7d2de3ab service cinder] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:54.758232 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74523dc-31fd-40b8-960d-fcac7d2de3ab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:54.782942 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74523dc-31fd-40b8-960d-fcac7d2de3ab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:45:54.789666 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74523dc-31fd-40b8-960d-fcac7d2de3ab service cinder] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:45:54.792740 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03315963-9adc-4eba-bb0c-83ba420ef94d None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:45:54.802848 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 813/1643] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 24 05:45:54 2022] GET /identity/v3/auth/tokens => generated 3347 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:45:54.806325 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03315963-9adc-4eba-bb0c-83ba420ef94d None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:45:54.816288 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf953af-38e4-4658-8ba4-7513e561a2c3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17b450afe795495680fc70f522c83750', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:45:54.819405 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf953af-38e4-4658-8ba4-7513e561a2c3 service cinder] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:54.822843 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf953af-38e4-4658-8ba4-7513e561a2c3 service cinder] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:54.824484 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf953af-38e4-4658-8ba4-7513e561a2c3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:54.843575 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf953af-38e4-4658-8ba4-7513e561a2c3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:45:54.846074 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf953af-38e4-4658-8ba4-7513e561a2c3 service cinder] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:45:54.865175 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 831/1644] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 24 05:45:54 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 05:45:55.131818 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74523dc-31fd-40b8-960d-fcac7d2de3ab service cinder] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:45:55.151366 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf953af-38e4-4658-8ba4-7513e561a2c3 service cinder] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:45:55.194029 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:45:55.239177 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf953af-38e4-4658-8ba4-7513e561a2c3 service cinder] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:45:55.244346 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75041c09-d266-40a8-94d8-2577d8dc48f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:45:55.245483 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75041c09-d266-40a8-94d8-2577d8dc48f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:55.245483 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75041c09-d266-40a8-94d8-2577d8dc48f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:55.247754 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75041c09-d266-40a8-94d8-2577d8dc48f7 admin admin] PATH_INFO: `/v3/users/92203f62c9d5424bb93ae6404f948ccd` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:55.249182 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75041c09-d266-40a8-94d8-2577d8dc48f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=92203f62c9d5424bb93ae6404f948ccd)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:45:55.250351 dv-cinder-854268-1-smb devstack@keystone.service[88113]: WARNING py.warnings [None req-75041c09-d266-40a8-94d8-2577d8dc48f7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 05:45:55.250351 dv-cinder-854268-1-smb devstack@keystone.service[88113]: warnings.warn(msg) Aug 24 05:45:55.250351 dv-cinder-854268-1-smb devstack@keystone.service[88113]: Aug 24 05:45:55.251717 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75041c09-d266-40a8-94d8-2577d8dc48f7 admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:45:55.290867 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74523dc-31fd-40b8-960d-fcac7d2de3ab service cinder] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:45:55.304603 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8317e6-6494-49a3-8627-6ac65c7e377d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:45:55.305530 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8317e6-6494-49a3-8627-6ac65c7e377d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:55.305815 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8317e6-6494-49a3-8627-6ac65c7e377d admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:55.306199 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8317e6-6494-49a3-8627-6ac65c7e377d admin admin] PATH_INFO: `/v3/users/f2b14c8cd5e349d5b4ce4f0bc8d520b1` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:55.310949 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8317e6-6494-49a3-8627-6ac65c7e377d admin admin] RBAC: Authorizing `identity:delete_user(user_id=f2b14c8cd5e349d5b4ce4f0bc8d520b1)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:45:55.316149 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8317e6-6494-49a3-8627-6ac65c7e377d admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:45:55.374230 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-75041c09-d266-40a8-94d8-2577d8dc48f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '92203f62c9d5424bb93ae6404f948ccd'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:45:55.391254 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-75041c09-d266-40a8-94d8-2577d8dc48f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '92203f62c9d5424bb93ae6404f948ccd'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:45:55.396112 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-75041c09-d266-40a8-94d8-2577d8dc48f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '92203f62c9d5424bb93ae6404f948ccd'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:45:55.413739 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:45:55.433242 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-3e8317e6-6494-49a3-8627-6ac65c7e377d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f2b14c8cd5e349d5b4ce4f0bc8d520b1'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:45:55.450064 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-75041c09-d266-40a8-94d8-2577d8dc48f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '92203f62c9d5424bb93ae6404f948ccd'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:45:55.454920 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-3e8317e6-6494-49a3-8627-6ac65c7e377d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f2b14c8cd5e349d5b4ce4f0bc8d520b1'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:45:55.474599 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-75041c09-d266-40a8-94d8-2577d8dc48f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '92203f62c9d5424bb93ae6404f948ccd'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:45:55.498178 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-3e8317e6-6494-49a3-8627-6ac65c7e377d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f2b14c8cd5e349d5b4ce4f0bc8d520b1'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:45:55.503336 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 832/1645] 10.222.0.26 () {58 vars in 1224 bytes} [Wed Aug 24 05:45:55 2022] DELETE /identity/v3/users/92203f62c9d5424bb93ae6404f948ccd => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 05:45:55.506335 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6f9341-12de-4ec3-b6c8-f7026a993b5a None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:55.507631 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6f9341-12de-4ec3-b6c8-f7026a993b5a None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:55.508066 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6f9341-12de-4ec3-b6c8-f7026a993b5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:55.516722 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-3e8317e6-6494-49a3-8627-6ac65c7e377d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f2b14c8cd5e349d5b4ce4f0bc8d520b1'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:45:55.518834 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-3e8317e6-6494-49a3-8627-6ac65c7e377d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f2b14c8cd5e349d5b4ce4f0bc8d520b1'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:45:55.535219 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 814/1646] 10.222.0.26 () {58 vars in 1224 bytes} [Wed Aug 24 05:45:55 2022] DELETE /identity/v3/users/f2b14c8cd5e349d5b4ce4f0bc8d520b1 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:45:55.537528 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ba4cec-a658-462c-bb90-1bf90fe00f89 None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:55.540718 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ba4cec-a658-462c-bb90-1bf90fe00f89 None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:55.540718 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ba4cec-a658-462c-bb90-1bf90fe00f89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:55.563975 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-bb6f9341-12de-4ec3-b6c8-f7026a993b5a None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:45:55.566822 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-bb6f9341-12de-4ec3-b6c8-f7026a993b5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:45:55.589455 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-11ba4cec-a658-462c-bb90-1bf90fe00f89 None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:45:55.599185 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-11ba4cec-a658-462c-bb90-1bf90fe00f89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:45:55.666090 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 833/1647] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:45:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:45:55.704227 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 815/1648] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:45:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:45:55.715700 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6f9341-12de-4ec3-b6c8-f7026a993b5a None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:45:55.718295 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-bb6f9341-12de-4ec3-b6c8-f7026a993b5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:45:55.774440 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c292c36-8ff0-4cdd-9526-b79d17bcf69e None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:55.775729 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c292c36-8ff0-4cdd-9526-b79d17bcf69e None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:55.776261 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c292c36-8ff0-4cdd-9526-b79d17bcf69e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:55.825889 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-9c292c36-8ff0-4cdd-9526-b79d17bcf69e None None] MFA Rules not processed for user `3ab358239f22426589b1ea4a2269de15`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:45:55.828531 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-9c292c36-8ff0-4cdd-9526-b79d17bcf69e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:45:55.850189 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:45:55.857924 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6f9341-12de-4ec3-b6c8-f7026a993b5a None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:45:55.867772 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c77cfc-f468-4d82-b02a-5c016dc16180 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '874348b647194ac2b5ecbf12c33bf59e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:45:55.868941 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c77cfc-f468-4d82-b02a-5c016dc16180 service neutron] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:55.869656 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c77cfc-f468-4d82-b02a-5c016dc16180 service neutron] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:55.870998 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c77cfc-f468-4d82-b02a-5c016dc16180 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:55.903911 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c77cfc-f468-4d82-b02a-5c016dc16180 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:45:55.905590 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c77cfc-f468-4d82-b02a-5c016dc16180 service neutron] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:45:55.927633 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 834/1649] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 24 05:45:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:45:55.928695 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c77cfc-f468-4d82-b02a-5c016dc16180 service neutron] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:45:55.952712 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c77cfc-f468-4d82-b02a-5c016dc16180 service neutron] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:45:55.964107 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3fea67-56b9-4fbf-afa8-2c3a59c19347 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '874348b647194ac2b5ecbf12c33bf59e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:45:55.964740 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3fea67-56b9-4fbf-afa8-2c3a59c19347 service neutron] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:55.965022 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3fea67-56b9-4fbf-afa8-2c3a59c19347 service neutron] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:55.965290 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3fea67-56b9-4fbf-afa8-2c3a59c19347 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:55.981193 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 816/1650] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:45:55 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 05:45:55.982560 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c292c36-8ff0-4cdd-9526-b79d17bcf69e None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:45:55.984241 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-9c292c36-8ff0-4cdd-9526-b79d17bcf69e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:45:55.994415 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3fea67-56b9-4fbf-afa8-2c3a59c19347 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:45:55.996691 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3fea67-56b9-4fbf-afa8-2c3a59c19347 service neutron] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:45:56.030241 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c292c36-8ff0-4cdd-9526-b79d17bcf69e None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:45:56.043018 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997c0317-3a55-4e0a-a95b-d436250a0cff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:45:56.043645 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997c0317-3a55-4e0a-a95b-d436250a0cff admin admin] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:56.043879 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 835/1651] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 24 05:45:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:45:56.044010 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997c0317-3a55-4e0a-a95b-d436250a0cff admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:56.046257 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997c0317-3a55-4e0a-a95b-d436250a0cff admin admin] PATH_INFO: `/v3/projects` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:56.048483 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997c0317-3a55-4e0a-a95b-d436250a0cff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:45:56.054313 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997c0317-3a55-4e0a-a95b-d436250a0cff admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:45:56.080716 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3fea67-56b9-4fbf-afa8-2c3a59c19347 service neutron] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:45:56.082599 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-1b3fea67-56b9-4fbf-afa8-2c3a59c19347 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:45:56.115004 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3fea67-56b9-4fbf-afa8-2c3a59c19347 service neutron] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:45:56.116089 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 817/1652] 10.222.0.26 () {60 vars in 1153 bytes} [Wed Aug 24 05:45:55 2022] POST /identity/v3/projects => generated 405 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:45:56.120314 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997c0317-3a55-4e0a-a95b-d436250a0cff admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:45:56.169011 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:45:56.239957 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997c0317-3a55-4e0a-a95b-d436250a0cff admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:45:56.245626 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd4ce2d-a41b-451d-8b23-b26dd87ec732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:45:56.246633 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd4ce2d-a41b-451d-8b23-b26dd87ec732 admin admin] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:56.247541 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd4ce2d-a41b-451d-8b23-b26dd87ec732 admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:56.247541 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd4ce2d-a41b-451d-8b23-b26dd87ec732 admin admin] PATH_INFO: `/v3/users` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:56.249039 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd4ce2d-a41b-451d-8b23-b26dd87ec732 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:45:56.251063 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd4ce2d-a41b-451d-8b23-b26dd87ec732 admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:45:56.275612 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622c3c1e-8d62-4a8f-903d-ba849678f5aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:45:56.276274 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622c3c1e-8d62-4a8f-903d-ba849678f5aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:56.276619 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622c3c1e-8d62-4a8f-903d-ba849678f5aa admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:56.276911 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622c3c1e-8d62-4a8f-903d-ba849678f5aa admin admin] PATH_INFO: `/v3/users/33cc1bac744d4b20ae586a5897afb73f` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:56.278030 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622c3c1e-8d62-4a8f-903d-ba849678f5aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=33cc1bac744d4b20ae586a5897afb73f)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:45:56.280643 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622c3c1e-8d62-4a8f-903d-ba849678f5aa admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:45:56.288423 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 818/1653] 10.222.0.26 () {60 vars in 1144 bytes} [Wed Aug 24 05:45:56 2022] POST /identity/v3/users => generated 309 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 05:45:56.292028 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd4ce2d-a41b-451d-8b23-b26dd87ec732 admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:45:56.320956 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd4ce2d-a41b-451d-8b23-b26dd87ec732 admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:45:56.338319 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ceddbf7-971a-44a1-ab5a-bdec338d1eba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:45:56.339250 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceddbf7-971a-44a1-ab5a-bdec338d1eba admin admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:56.339608 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceddbf7-971a-44a1-ab5a-bdec338d1eba admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:56.340008 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceddbf7-971a-44a1-ab5a-bdec338d1eba admin admin] PATH_INFO: `/v3/roles` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:56.340819 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ceddbf7-971a-44a1-ab5a-bdec338d1eba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:45:56.342981 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ceddbf7-971a-44a1-ab5a-bdec338d1eba admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:45:56.369454 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 819/1654] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Aug 24 05:45:56 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:45:56.381316 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-622c3c1e-8d62-4a8f-903d-ba849678f5aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '33cc1bac744d4b20ae586a5897afb73f'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:45:56.382102 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ceddbf7-971a-44a1-ab5a-bdec338d1eba admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:45:56.391246 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-622c3c1e-8d62-4a8f-903d-ba849678f5aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '33cc1bac744d4b20ae586a5897afb73f'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:45:56.391997 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-622c3c1e-8d62-4a8f-903d-ba849678f5aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '33cc1bac744d4b20ae586a5897afb73f'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:45:56.398574 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ceddbf7-971a-44a1-ab5a-bdec338d1eba admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:45:56.414910 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9acef2-116b-44a2-99e6-0c9c52d349a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:45:56.415692 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9acef2-116b-44a2-99e6-0c9c52d349a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:56.415815 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-622c3c1e-8d62-4a8f-903d-ba849678f5aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '33cc1bac744d4b20ae586a5897afb73f'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:45:56.416144 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9acef2-116b-44a2-99e6-0c9c52d349a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:56.416512 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9acef2-116b-44a2-99e6-0c9c52d349a1 admin admin] PATH_INFO: `/v3/projects/f46ee80adf294402b7ead7d1a50ce7d8/users/03ec8115674d43f1bc6c6b58461ed17e/roles/640bda0879494e60b72680ee505285f0` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:56.456734 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-622c3c1e-8d62-4a8f-903d-ba849678f5aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '33cc1bac744d4b20ae586a5897afb73f'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:45:56.456734 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 836/1655] 10.222.0.26 () {58 vars in 1224 bytes} [Wed Aug 24 05:45:56 2022] DELETE /identity/v3/users/33cc1bac744d4b20ae586a5897afb73f => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:45:56.456734 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0d3b8a-fb15-4624-bc46-39279b84105a None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:56.456734 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0d3b8a-fb15-4624-bc46-39279b84105a None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:56.456734 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0d3b8a-fb15-4624-bc46-39279b84105a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:56.471402 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9acef2-116b-44a2-99e6-0c9c52d349a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f46ee80adf294402b7ead7d1a50ce7d8, user_id=03ec8115674d43f1bc6c6b58461ed17e, role_id=640bda0879494e60b72680ee505285f0)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:45:56.485131 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9acef2-116b-44a2-99e6-0c9c52d349a1 admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:45:56.512196 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-4f0d3b8a-fb15-4624-bc46-39279b84105a None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:45:56.513463 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 820/1656] 10.222.0.26 () {60 vars in 1483 bytes} [Wed Aug 24 05:45:56 2022] PUT /identity/v3/projects/f46ee80adf294402b7ead7d1a50ce7d8/users/03ec8115674d43f1bc6c6b58461ed17e/roles/640bda0879494e60b72680ee505285f0 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 05:45:56.516866 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-4f0d3b8a-fb15-4624-bc46-39279b84105a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:45:56.519208 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9acef2-116b-44a2-99e6-0c9c52d349a1 admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:45:56.521616 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-fb9acef2-116b-44a2-99e6-0c9c52d349a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:45:56.632920 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:45:56.659755 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 837/1657] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:45:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:45:56.664079 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9acef2-116b-44a2-99e6-0c9c52d349a1 admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:45:56.677512 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a23fc2-f436-4f4a-8137-d9a314c10dfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:45:56.677678 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0d3b8a-fb15-4624-bc46-39279b84105a None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:45:56.678582 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a23fc2-f436-4f4a-8137-d9a314c10dfc admin admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:56.679196 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a23fc2-f436-4f4a-8137-d9a314c10dfc admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:56.679654 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a23fc2-f436-4f4a-8137-d9a314c10dfc admin admin] PATH_INFO: `/v3/roles` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:56.679814 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-4f0d3b8a-fb15-4624-bc46-39279b84105a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:45:56.681494 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a23fc2-f436-4f4a-8137-d9a314c10dfc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:45:56.685555 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a23fc2-f436-4f4a-8137-d9a314c10dfc admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:45:56.699937 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 821/1658] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Aug 24 05:45:56 2022] GET /identity/v3/roles => generated 1420 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:45:56.705714 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a23fc2-f436-4f4a-8137-d9a314c10dfc admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:45:56.723139 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a23fc2-f436-4f4a-8137-d9a314c10dfc admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:45:56.736298 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb202ee-3cf9-41dd-b8b8-b83717e56738 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:45:56.737153 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb202ee-3cf9-41dd-b8b8-b83717e56738 admin admin] REQUEST_METHOD: `PUT` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:56.737584 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb202ee-3cf9-41dd-b8b8-b83717e56738 admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:56.738637 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb202ee-3cf9-41dd-b8b8-b83717e56738 admin admin] PATH_INFO: `/v3/projects/f46ee80adf294402b7ead7d1a50ce7d8/users/03ec8115674d43f1bc6c6b58461ed17e/roles/640bda0879494e60b72680ee505285f0` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:56.741602 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb202ee-3cf9-41dd-b8b8-b83717e56738 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f46ee80adf294402b7ead7d1a50ce7d8, user_id=03ec8115674d43f1bc6c6b58461ed17e, role_id=640bda0879494e60b72680ee505285f0)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:45:56.744571 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb202ee-3cf9-41dd-b8b8-b83717e56738 admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:45:56.760479 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 822/1659] 10.222.0.26 () {60 vars in 1483 bytes} [Wed Aug 24 05:45:56 2022] PUT /identity/v3/projects/f46ee80adf294402b7ead7d1a50ce7d8/users/03ec8115674d43f1bc6c6b58461ed17e/roles/640bda0879494e60b72680ee505285f0 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:45:56.799423 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0d3b8a-fb15-4624-bc46-39279b84105a None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:45:56.900377 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb202ee-3cf9-41dd-b8b8-b83717e56738 admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:45:56.902199 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-0eb202ee-3cf9-41dd-b8b8-b83717e56738 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:45:56.929110 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ebef20-5d3f-49d2-b3c0-6bce94addce7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '874348b647194ac2b5ecbf12c33bf59e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:45:56.932223 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ebef20-5d3f-49d2-b3c0-6bce94addce7 service neutron] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:56.932692 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ebef20-5d3f-49d2-b3c0-6bce94addce7 service neutron] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:56.933985 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ebef20-5d3f-49d2-b3c0-6bce94addce7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:57.026190 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb202ee-3cf9-41dd-b8b8-b83717e56738 admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:45:57.034315 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942c77f8-763b-440d-9209-b412eb819e04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:45:57.034315 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942c77f8-763b-440d-9209-b412eb819e04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:57.034315 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942c77f8-763b-440d-9209-b412eb819e04 admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:57.034638 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942c77f8-763b-440d-9209-b412eb819e04 admin admin] PATH_INFO: `/v3/projects/66465a0efdf740a48e6d5c8587934c7b` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:57.038352 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942c77f8-763b-440d-9209-b412eb819e04 admin admin] RBAC: Authorizing `identity:delete_project(project_id=66465a0efdf740a48e6d5c8587934c7b)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:45:57.038352 dv-cinder-854268-1-smb devstack@keystone.service[88112]: WARNING py.warnings [None req-942c77f8-763b-440d-9209-b412eb819e04 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 05:45:57.038352 dv-cinder-854268-1-smb devstack@keystone.service[88112]: warnings.warn(msg) Aug 24 05:45:57.038352 dv-cinder-854268-1-smb devstack@keystone.service[88112]: Aug 24 05:45:57.038899 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942c77f8-763b-440d-9209-b412eb819e04 admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:45:57.044878 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:45:57.116807 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ebef20-5d3f-49d2-b3c0-6bce94addce7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:45:57.119690 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ebef20-5d3f-49d2-b3c0-6bce94addce7 service neutron] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:45:57.148557 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 838/1660] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 24 05:45:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 471 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:45:57.151488 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-942c77f8-763b-440d-9209-b412eb819e04 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '66465a0efdf740a48e6d5c8587934c7b', 'request_id': 'req-942c77f8-763b-440d-9209-b412eb819e04'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:45:57.153086 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ebef20-5d3f-49d2-b3c0-6bce94addce7 service neutron] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:45:57.159311 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-15ebef20-5d3f-49d2-b3c0-6bce94addce7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:45:57.163629 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-942c77f8-763b-440d-9209-b412eb819e04 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '66465a0efdf740a48e6d5c8587934c7b', 'request_id': 'req-942c77f8-763b-440d-9209-b412eb819e04'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:45:57.198590 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ebef20-5d3f-49d2-b3c0-6bce94addce7 service neutron] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:45:57.203994 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-942c77f8-763b-440d-9209-b412eb819e04 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '66465a0efdf740a48e6d5c8587934c7b', 'request_id': 'req-942c77f8-763b-440d-9209-b412eb819e04'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:45:57.233895 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-942c77f8-763b-440d-9209-b412eb819e04 admin admin] The token cache is being invalidate because project 66465a0efdf740a48e6d5c8587934c7b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88112) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:45:57.237334 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-942c77f8-763b-440d-9209-b412eb819e04 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:45:57.238493 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-942c77f8-763b-440d-9209-b412eb819e04 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:45:57.244735 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 823/1661] 10.222.0.26 () {58 vars in 1233 bytes} [Wed Aug 24 05:45:56 2022] DELETE /identity/v3/projects/66465a0efdf740a48e6d5c8587934c7b => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:45:57.251263 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942c77f8-763b-440d-9209-b412eb819e04 admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:45:57.253913 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-942c77f8-763b-440d-9209-b412eb819e04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:45:57.359814 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fa4905-1e67-4312-bda3-fd1c03e32a96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:45:57.360902 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fa4905-1e67-4312-bda3-fd1c03e32a96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:57.361281 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fa4905-1e67-4312-bda3-fd1c03e32a96 admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:57.361699 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fa4905-1e67-4312-bda3-fd1c03e32a96 admin admin] PATH_INFO: `/v3/projects/23e2b9b2a7fe49fdb5a6ccdbdca9859a` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:57.365584 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fa4905-1e67-4312-bda3-fd1c03e32a96 admin admin] RBAC: Authorizing `identity:delete_project(project_id=23e2b9b2a7fe49fdb5a6ccdbdca9859a)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:45:57.369485 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fa4905-1e67-4312-bda3-fd1c03e32a96 admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:45:57.390480 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:45:57.436955 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942c77f8-763b-440d-9209-b412eb819e04 admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:45:57.450560 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0699c3-a32d-4290-982c-d8622bef41fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:45:57.452514 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0699c3-a32d-4290-982c-d8622bef41fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:57.452943 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0699c3-a32d-4290-982c-d8622bef41fa admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:57.453641 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0699c3-a32d-4290-982c-d8622bef41fa admin admin] PATH_INFO: `/v3/users/4e7ffaa233ab424cb9b7f680491d1d6d` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:57.455353 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0699c3-a32d-4290-982c-d8622bef41fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e7ffaa233ab424cb9b7f680491d1d6d)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:45:57.465180 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0699c3-a32d-4290-982c-d8622bef41fa admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:45:57.489160 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-f8fa4905-1e67-4312-bda3-fd1c03e32a96 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '23e2b9b2a7fe49fdb5a6ccdbdca9859a', 'request_id': 'req-f8fa4905-1e67-4312-bda3-fd1c03e32a96'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:45:57.511603 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-f8fa4905-1e67-4312-bda3-fd1c03e32a96 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '23e2b9b2a7fe49fdb5a6ccdbdca9859a', 'request_id': 'req-f8fa4905-1e67-4312-bda3-fd1c03e32a96'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:45:57.521882 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-f8fa4905-1e67-4312-bda3-fd1c03e32a96 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '23e2b9b2a7fe49fdb5a6ccdbdca9859a', 'request_id': 'req-f8fa4905-1e67-4312-bda3-fd1c03e32a96'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:45:57.552219 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-f8fa4905-1e67-4312-bda3-fd1c03e32a96 admin admin] The token cache is being invalidate because project 23e2b9b2a7fe49fdb5a6ccdbdca9859a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:45:57.552830 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-f8fa4905-1e67-4312-bda3-fd1c03e32a96 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:45:57.555392 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-f8fa4905-1e67-4312-bda3-fd1c03e32a96 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:45:57.559522 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 839/1662] 10.222.0.26 () {58 vars in 1233 bytes} [Wed Aug 24 05:45:57 2022] DELETE /identity/v3/projects/23e2b9b2a7fe49fdb5a6ccdbdca9859a => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:45:57.565060 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b08897-93c0-4a59-a892-63f05b91e6a5 None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:57.565513 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b08897-93c0-4a59-a892-63f05b91e6a5 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:57.565887 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b08897-93c0-4a59-a892-63f05b91e6a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:57.579775 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-4a0699c3-a32d-4290-982c-d8622bef41fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e7ffaa233ab424cb9b7f680491d1d6d'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:45:57.598322 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-4a0699c3-a32d-4290-982c-d8622bef41fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e7ffaa233ab424cb9b7f680491d1d6d'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:45:57.612301 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-34b08897-93c0-4a59-a892-63f05b91e6a5 None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:45:57.613940 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-34b08897-93c0-4a59-a892-63f05b91e6a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:45:57.662438 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-4a0699c3-a32d-4290-982c-d8622bef41fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e7ffaa233ab424cb9b7f680491d1d6d'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:45:57.700300 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-4a0699c3-a32d-4290-982c-d8622bef41fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e7ffaa233ab424cb9b7f680491d1d6d'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:45:57.702059 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-4a0699c3-a32d-4290-982c-d8622bef41fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e7ffaa233ab424cb9b7f680491d1d6d'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:45:57.738214 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 824/1663] 10.222.0.26 () {58 vars in 1224 bytes} [Wed Aug 24 05:45:57 2022] DELETE /identity/v3/users/4e7ffaa233ab424cb9b7f680491d1d6d => generated 0 bytes in 488 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:45:57.817021 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 840/1664] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:45:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:45:57.818868 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461d866d-89f7-4dd7-a8b5-c41f575c60c9 None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:57.819373 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461d866d-89f7-4dd7-a8b5-c41f575c60c9 None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:57.819789 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461d866d-89f7-4dd7-a8b5-c41f575c60c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:57.865378 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-461d866d-89f7-4dd7-a8b5-c41f575c60c9 None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:45:57.866890 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-461d866d-89f7-4dd7-a8b5-c41f575c60c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:45:57.871889 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:45:58.008673 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 825/1665] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:45:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:45:58.011052 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b08897-93c0-4a59-a892-63f05b91e6a5 None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:45:58.024000 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b08897-93c0-4a59-a892-63f05b91e6a5 None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:45:58.063246 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540e0119-a7f1-464f-b845-a304f064e4a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:45:58.064223 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540e0119-a7f1-464f-b845-a304f064e4a8 admin admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:58.064684 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540e0119-a7f1-464f-b845-a304f064e4a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:58.065132 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540e0119-a7f1-464f-b845-a304f064e4a8 admin admin] PATH_INFO: `/v3/domains` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:58.066199 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540e0119-a7f1-464f-b845-a304f064e4a8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:45:58.068482 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540e0119-a7f1-464f-b845-a304f064e4a8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:45:58.070442 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540e0119-a7f1-464f-b845-a304f064e4a8 admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:45:58.089226 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 841/1666] 10.222.0.26 () {58 vars in 1153 bytes} [Wed Aug 24 05:45:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:45:58.090979 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461d866d-89f7-4dd7-a8b5-c41f575c60c9 None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:45:58.115896 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461d866d-89f7-4dd7-a8b5-c41f575c60c9 None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:45:58.130054 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ed72b5-18af-4838-93c1-fdc1869627ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:45:58.137497 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ed72b5-18af-4838-93c1-fdc1869627ba admin admin] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:58.137789 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ed72b5-18af-4838-93c1-fdc1869627ba admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:58.140144 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ed72b5-18af-4838-93c1-fdc1869627ba admin admin] PATH_INFO: `/v3/projects` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:58.142602 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ed72b5-18af-4838-93c1-fdc1869627ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:45:58.148187 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ed72b5-18af-4838-93c1-fdc1869627ba admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:45:58.202658 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540e0119-a7f1-464f-b845-a304f064e4a8 admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:45:58.203706 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 826/1667] 10.222.0.26 () {60 vars in 1153 bytes} [Wed Aug 24 05:45:58 2022] POST /identity/v3/projects => generated 363 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:45:58.220520 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540e0119-a7f1-464f-b845-a304f064e4a8 admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:45:58.325026 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffce9e4-5d39-4146-9cc1-da361e46b50f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:45:58.325651 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffce9e4-5d39-4146-9cc1-da361e46b50f admin admin] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:58.327608 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffce9e4-5d39-4146-9cc1-da361e46b50f admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:58.327890 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffce9e4-5d39-4146-9cc1-da361e46b50f admin admin] PATH_INFO: `/v3/users` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:58.328757 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffce9e4-5d39-4146-9cc1-da361e46b50f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:45:58.334363 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffce9e4-5d39-4146-9cc1-da361e46b50f admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:45:58.450654 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ed72b5-18af-4838-93c1-fdc1869627ba admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:45:58.456234 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 842/1668] 10.222.0.26 () {60 vars in 1144 bytes} [Wed Aug 24 05:45:58 2022] POST /identity/v3/users => generated 282 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:45:58.475440 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ed72b5-18af-4838-93c1-fdc1869627ba admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:45:58.501715 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7b6f95-50a1-4caa-8311-355aa9362ad1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:45:58.502590 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7b6f95-50a1-4caa-8311-355aa9362ad1 admin admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:58.503022 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7b6f95-50a1-4caa-8311-355aa9362ad1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:58.503444 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7b6f95-50a1-4caa-8311-355aa9362ad1 admin admin] PATH_INFO: `/v3/roles` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:58.504533 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7b6f95-50a1-4caa-8311-355aa9362ad1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:45:58.506608 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7b6f95-50a1-4caa-8311-355aa9362ad1 admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:45:58.541132 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 827/1669] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Aug 24 05:45:58 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:45:58.542475 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffce9e4-5d39-4146-9cc1-da361e46b50f admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:45:58.560685 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffce9e4-5d39-4146-9cc1-da361e46b50f admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:45:58.566363 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f9bfe3-5d6b-44c7-8b95-68e87ccb1ecd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:45:58.567066 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f9bfe3-5d6b-44c7-8b95-68e87ccb1ecd admin admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:58.567417 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f9bfe3-5d6b-44c7-8b95-68e87ccb1ecd admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:58.567930 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f9bfe3-5d6b-44c7-8b95-68e87ccb1ecd admin admin] PATH_INFO: `/v3/roles` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:58.568488 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f9bfe3-5d6b-44c7-8b95-68e87ccb1ecd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:45:58.570395 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f9bfe3-5d6b-44c7-8b95-68e87ccb1ecd admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:45:58.579326 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:45:58.590029 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 843/1670] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Aug 24 05:45:58 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:45:58.594357 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7b6f95-50a1-4caa-8311-355aa9362ad1 admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:45:58.611660 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7b6f95-50a1-4caa-8311-355aa9362ad1 admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:45:58.634370 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661aac64-14c2-4159-9520-095466a95daa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:45:58.640316 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661aac64-14c2-4159-9520-095466a95daa admin admin] REQUEST_METHOD: `PUT` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:58.643543 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661aac64-14c2-4159-9520-095466a95daa admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:58.644128 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661aac64-14c2-4159-9520-095466a95daa admin admin] PATH_INFO: `/v3/projects/913768c432af4149af8afcbb097c09cb/users/c0659cfdaf054d26804ced545c62a465/roles/f7aa4a2c74c94c1b9ca8ecdcccccda5c` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:58.706282 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661aac64-14c2-4159-9520-095466a95daa admin admin] RBAC: Authorizing `identity:create_grant(project_id=913768c432af4149af8afcbb097c09cb, user_id=c0659cfdaf054d26804ced545c62a465, role_id=f7aa4a2c74c94c1b9ca8ecdcccccda5c)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:45:58.720595 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661aac64-14c2-4159-9520-095466a95daa admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:45:58.750266 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 828/1671] 10.222.0.26 () {60 vars in 1483 bytes} [Wed Aug 24 05:45:58 2022] PUT /identity/v3/projects/913768c432af4149af8afcbb097c09cb/users/c0659cfdaf054d26804ced545c62a465/roles/f7aa4a2c74c94c1b9ca8ecdcccccda5c => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:45:58.760825 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c141bcbb-ff98-47f6-aab0-6c7ba674960c None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:58.761340 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c141bcbb-ff98-47f6-aab0-6c7ba674960c None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:58.761730 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c141bcbb-ff98-47f6-aab0-6c7ba674960c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:58.868953 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-c141bcbb-ff98-47f6-aab0-6c7ba674960c None None] MFA Rules not processed for user `c0659cfdaf054d26804ced545c62a465`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:45:58.875679 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-c141bcbb-ff98-47f6-aab0-6c7ba674960c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:45:59.002810 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 844/1672] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:45:58 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:45:59.003503 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661aac64-14c2-4159-9520-095466a95daa admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:45:59.158550 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661aac64-14c2-4159-9520-095466a95daa admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:45:59.177600 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c224bd-4597-402e-9fae-18e759aa1381 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:45:59.178691 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c224bd-4597-402e-9fae-18e759aa1381 admin admin] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:59.179187 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c224bd-4597-402e-9fae-18e759aa1381 admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:59.179800 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c224bd-4597-402e-9fae-18e759aa1381 admin admin] PATH_INFO: `/v3/projects` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:59.180776 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c224bd-4597-402e-9fae-18e759aa1381 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:45:59.192315 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c224bd-4597-402e-9fae-18e759aa1381 admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:45:59.244063 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c141bcbb-ff98-47f6-aab0-6c7ba674960c None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:45:59.250154 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-c141bcbb-ff98-47f6-aab0-6c7ba674960c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:45:59.268359 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 829/1673] 10.222.0.26 () {60 vars in 1153 bytes} [Wed Aug 24 05:45:59 2022] POST /identity/v3/projects => generated 365 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:45:59.273829 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c224bd-4597-402e-9fae-18e759aa1381 admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:45:59.282999 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c141bcbb-ff98-47f6-aab0-6c7ba674960c None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:45:59.416577 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:45:59.434307 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868549aa-c975-42fb-ab08-2d64b4ab36fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:45:59.434713 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868549aa-c975-42fb-ab08-2d64b4ab36fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:59.434996 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868549aa-c975-42fb-ab08-2d64b4ab36fd admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:59.435249 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868549aa-c975-42fb-ab08-2d64b4ab36fd admin admin] PATH_INFO: `/v3/projects/e99a17d277114c20b9a9eb5f6224ef2b` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:59.437339 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868549aa-c975-42fb-ab08-2d64b4ab36fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=e99a17d277114c20b9a9eb5f6224ef2b)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:45:59.439305 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868549aa-c975-42fb-ab08-2d64b4ab36fd admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:45:59.518556 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c224bd-4597-402e-9fae-18e759aa1381 admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:45:59.541231 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f352c97-d276-4454-82f0-2973568808c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:45:59.542232 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f352c97-d276-4454-82f0-2973568808c9 admin admin] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:59.542529 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f352c97-d276-4454-82f0-2973568808c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:59.543338 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f352c97-d276-4454-82f0-2973568808c9 admin admin] PATH_INFO: `/v3/users` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:59.544297 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f352c97-d276-4454-82f0-2973568808c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:45:59.554002 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f352c97-d276-4454-82f0-2973568808c9 admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:45:59.568104 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-868549aa-c975-42fb-ab08-2d64b4ab36fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e99a17d277114c20b9a9eb5f6224ef2b', 'request_id': 'req-868549aa-c975-42fb-ab08-2d64b4ab36fd'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:45:59.586965 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-868549aa-c975-42fb-ab08-2d64b4ab36fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e99a17d277114c20b9a9eb5f6224ef2b', 'request_id': 'req-868549aa-c975-42fb-ab08-2d64b4ab36fd'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:45:59.605616 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-868549aa-c975-42fb-ab08-2d64b4ab36fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e99a17d277114c20b9a9eb5f6224ef2b', 'request_id': 'req-868549aa-c975-42fb-ab08-2d64b4ab36fd'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:45:59.608702 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 830/1674] 10.222.0.26 () {60 vars in 1144 bytes} [Wed Aug 24 05:45:59 2022] POST /identity/v3/users => generated 289 bytes in 335 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:45:59.611374 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f352c97-d276-4454-82f0-2973568808c9 admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:45:59.632494 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f352c97-d276-4454-82f0-2973568808c9 admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:45:59.634513 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-868549aa-c975-42fb-ab08-2d64b4ab36fd admin admin] The token cache is being invalidate because project e99a17d277114c20b9a9eb5f6224ef2b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:45:59.634808 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-868549aa-c975-42fb-ab08-2d64b4ab36fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:45:59.635738 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-868549aa-c975-42fb-ab08-2d64b4ab36fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:45:59.638200 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 845/1675] 10.222.0.26 () {58 vars in 1233 bytes} [Wed Aug 24 05:45:59 2022] DELETE /identity/v3/projects/e99a17d277114c20b9a9eb5f6224ef2b => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:45:59.643840 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f6fda1-ac29-4943-a98f-f4044acae4c6 None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:59.644125 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f6fda1-ac29-4943-a98f-f4044acae4c6 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:59.644442 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f6fda1-ac29-4943-a98f-f4044acae4c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:59.691495 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-d5f6fda1-ac29-4943-a98f-f4044acae4c6 None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:45:59.692732 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-d5f6fda1-ac29-4943-a98f-f4044acae4c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:45:59.728587 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:45:59.784082 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8750779-7711-429e-b942-8566c9811929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:45:59.784906 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8750779-7711-429e-b942-8566c9811929 admin admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:59.785812 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8750779-7711-429e-b942-8566c9811929 admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:59.785812 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8750779-7711-429e-b942-8566c9811929 admin admin] PATH_INFO: `/v3/roles` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:59.787476 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8750779-7711-429e-b942-8566c9811929 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:45:59.788377 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8750779-7711-429e-b942-8566c9811929 admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:45:59.842677 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 831/1676] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Aug 24 05:45:59 2022] GET /identity/v3/roles => generated 1420 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:45:59.842677 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8750779-7711-429e-b942-8566c9811929 admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:45:59.849117 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-d8750779-7711-429e-b942-8566c9811929 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:45:59.869409 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 846/1677] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:45:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:45:59.874656 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f6fda1-ac29-4943-a98f-f4044acae4c6 None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:45:59.878884 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-d5f6fda1-ac29-4943-a98f-f4044acae4c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:45:59.888569 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8750779-7711-429e-b942-8566c9811929 admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:45:59.898043 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17660b4-6ca2-40c7-b5f7-52c0db65ecb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:45:59.901482 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17660b4-6ca2-40c7-b5f7-52c0db65ecb1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:59.901736 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17660b4-6ca2-40c7-b5f7-52c0db65ecb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:59.902054 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17660b4-6ca2-40c7-b5f7-52c0db65ecb1 admin admin] PATH_INFO: `/v3/projects/f7aabad3ec0a465aa0462d0a07214e02` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:59.904041 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17660b4-6ca2-40c7-b5f7-52c0db65ecb1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f7aabad3ec0a465aa0462d0a07214e02)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:45:59.914674 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f6fda1-ac29-4943-a98f-f4044acae4c6 None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:45:59.922813 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f86276-d217-4bea-885a-5b010d8b5321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:45:59.923505 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f86276-d217-4bea-885a-5b010d8b5321 admin admin] REQUEST_METHOD: `PUT` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:59.923785 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f86276-d217-4bea-885a-5b010d8b5321 admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:59.924501 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f86276-d217-4bea-885a-5b010d8b5321 admin admin] PATH_INFO: `/v3/projects/6190e2e887c149598d5e905d7ac4d658/users/282f09dc75eb495a972802c0e18f319d/roles/640bda0879494e60b72680ee505285f0` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:45:59.927828 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17660b4-6ca2-40c7-b5f7-52c0db65ecb1 admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:45:59.948902 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f86276-d217-4bea-885a-5b010d8b5321 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6190e2e887c149598d5e905d7ac4d658, user_id=282f09dc75eb495a972802c0e18f319d, role_id=640bda0879494e60b72680ee505285f0)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:45:59.954065 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f86276-d217-4bea-885a-5b010d8b5321 admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:45:59.989356 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 847/1678] 10.222.0.26 () {60 vars in 1483 bytes} [Wed Aug 24 05:45:59 2022] PUT /identity/v3/projects/6190e2e887c149598d5e905d7ac4d658/users/282f09dc75eb495a972802c0e18f319d/roles/640bda0879494e60b72680ee505285f0 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:45:59.990847 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5b18dc-59c4-4f42-b672-5cc3f6b5c276 None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:45:59.991135 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5b18dc-59c4-4f42-b672-5cc3f6b5c276 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:45:59.991411 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5b18dc-59c4-4f42-b672-5cc3f6b5c276 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:00.043980 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-cf5b18dc-59c4-4f42-b672-5cc3f6b5c276 None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:46:00.045250 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-cf5b18dc-59c4-4f42-b672-5cc3f6b5c276 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:00.076080 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-c17660b4-6ca2-40c7-b5f7-52c0db65ecb1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f7aabad3ec0a465aa0462d0a07214e02', 'request_id': 'req-c17660b4-6ca2-40c7-b5f7-52c0db65ecb1'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:00.097261 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-c17660b4-6ca2-40c7-b5f7-52c0db65ecb1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f7aabad3ec0a465aa0462d0a07214e02', 'request_id': 'req-c17660b4-6ca2-40c7-b5f7-52c0db65ecb1'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:00.113031 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-c17660b4-6ca2-40c7-b5f7-52c0db65ecb1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f7aabad3ec0a465aa0462d0a07214e02', 'request_id': 'req-c17660b4-6ca2-40c7-b5f7-52c0db65ecb1'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:00.151419 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-c17660b4-6ca2-40c7-b5f7-52c0db65ecb1 admin admin] The token cache is being invalidate because project f7aabad3ec0a465aa0462d0a07214e02 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88112) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:46:00.151731 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-c17660b4-6ca2-40c7-b5f7-52c0db65ecb1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:00.156565 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-c17660b4-6ca2-40c7-b5f7-52c0db65ecb1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:00.164601 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 832/1679] 10.222.0.26 () {58 vars in 1233 bytes} [Wed Aug 24 05:45:59 2022] DELETE /identity/v3/projects/f7aabad3ec0a465aa0462d0a07214e02 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:46:00.165609 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17660b4-6ca2-40c7-b5f7-52c0db65ecb1 admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:00.172019 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-c17660b4-6ca2-40c7-b5f7-52c0db65ecb1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:00.232630 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 848/1680] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:45:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:46:00.234255 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6528685b-769f-4abd-8da2-88c7a27853c3 None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:00.238602 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6528685b-769f-4abd-8da2-88c7a27853c3 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:00.238861 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6528685b-769f-4abd-8da2-88c7a27853c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:00.313884 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-6528685b-769f-4abd-8da2-88c7a27853c3 None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:46:00.315136 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-6528685b-769f-4abd-8da2-88c7a27853c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:00.337359 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:46:00.348388 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 849/1681] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:46:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:46:00.362665 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6528685b-769f-4abd-8da2-88c7a27853c3 None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:00.385766 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6528685b-769f-4abd-8da2-88c7a27853c3 None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:00.398376 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17660b4-6ca2-40c7-b5f7-52c0db65ecb1 admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:00.407796 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9267ad-e673-4507-9bf3-b3dda6871c7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:00.409854 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921fdfd5-3eef-48d2-b4c5-1b3823c8d88d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:00.410624 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921fdfd5-3eef-48d2-b4c5-1b3823c8d88d admin admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:00.410936 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921fdfd5-3eef-48d2-b4c5-1b3823c8d88d admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:00.411236 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921fdfd5-3eef-48d2-b4c5-1b3823c8d88d admin admin] PATH_INFO: `/v3/roles` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:00.411946 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9267ad-e673-4507-9bf3-b3dda6871c7e admin admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:00.415308 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9267ad-e673-4507-9bf3-b3dda6871c7e admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:00.415610 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9267ad-e673-4507-9bf3-b3dda6871c7e admin admin] PATH_INFO: `/v3/domains` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:00.416332 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9267ad-e673-4507-9bf3-b3dda6871c7e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:46:00.416638 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9267ad-e673-4507-9bf3-b3dda6871c7e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:00.422410 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921fdfd5-3eef-48d2-b4c5-1b3823c8d88d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:00.426897 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9267ad-e673-4507-9bf3-b3dda6871c7e admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:00.427431 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921fdfd5-3eef-48d2-b4c5-1b3823c8d88d admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:00.452215 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 833/1682] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Aug 24 05:46:00 2022] GET /identity/v3/roles => generated 1420 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:46:00.458492 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cded4e-d2ca-4fb7-8ae5-26f7afa6df0c None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:00.458492 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cded4e-d2ca-4fb7-8ae5-26f7afa6df0c None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:00.458492 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cded4e-d2ca-4fb7-8ae5-26f7afa6df0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:00.459422 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 850/1683] 10.222.0.26 () {58 vars in 1153 bytes} [Wed Aug 24 05:46:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:46:00.460506 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9267ad-e673-4507-9bf3-b3dda6871c7e admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:00.486073 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9267ad-e673-4507-9bf3-b3dda6871c7e admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:00.503544 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-66cded4e-d2ca-4fb7-8ae5-26f7afa6df0c None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:46:00.506037 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-66cded4e-d2ca-4fb7-8ae5-26f7afa6df0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:00.507382 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d6ea11-394d-4f38-80f3-832c68dfe1b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:00.508075 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d6ea11-394d-4f38-80f3-832c68dfe1b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:00.508357 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d6ea11-394d-4f38-80f3-832c68dfe1b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:00.508633 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d6ea11-394d-4f38-80f3-832c68dfe1b3 admin admin] PATH_INFO: `/v3/projects/6190e2e887c149598d5e905d7ac4d658/users/282f09dc75eb495a972802c0e18f319d/roles/640bda0879494e60b72680ee505285f0` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:00.510949 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d6ea11-394d-4f38-80f3-832c68dfe1b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6190e2e887c149598d5e905d7ac4d658, user_id=282f09dc75eb495a972802c0e18f319d, role_id=640bda0879494e60b72680ee505285f0)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:00.518966 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d6ea11-394d-4f38-80f3-832c68dfe1b3 admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:00.526150 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 834/1684] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:46:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:46:00.533512 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cded4e-d2ca-4fb7-8ae5-26f7afa6df0c None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:00.565816 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 851/1685] 10.222.0.26 () {60 vars in 1483 bytes} [Wed Aug 24 05:46:00 2022] PUT /identity/v3/projects/6190e2e887c149598d5e905d7ac4d658/users/282f09dc75eb495a972802c0e18f319d/roles/640bda0879494e60b72680ee505285f0 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:46:00.567373 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d6ea11-394d-4f38-80f3-832c68dfe1b3 admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:00.567504 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cded4e-d2ca-4fb7-8ae5-26f7afa6df0c None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:00.699352 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595bd47e-6fcd-4442-ba9f-167321325c04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:00.701286 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595bd47e-6fcd-4442-ba9f-167321325c04 admin admin] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:00.703712 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595bd47e-6fcd-4442-ba9f-167321325c04 admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:00.704823 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595bd47e-6fcd-4442-ba9f-167321325c04 admin admin] PATH_INFO: `/v3/projects` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:00.705500 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595bd47e-6fcd-4442-ba9f-167321325c04 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:00.709530 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595bd47e-6fcd-4442-ba9f-167321325c04 admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:00.738678 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d6ea11-394d-4f38-80f3-832c68dfe1b3 admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:00.748938 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa794451-f136-42db-8230-4867c8a3d2f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:00.749444 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa794451-f136-42db-8230-4867c8a3d2f3 admin admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:00.749727 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa794451-f136-42db-8230-4867c8a3d2f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:00.750024 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa794451-f136-42db-8230-4867c8a3d2f3 admin admin] PATH_INFO: `/v3/domains` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:00.752309 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa794451-f136-42db-8230-4867c8a3d2f3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:46:00.752671 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa794451-f136-42db-8230-4867c8a3d2f3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:00.754727 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa794451-f136-42db-8230-4867c8a3d2f3 admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:00.784571 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 835/1686] 10.222.0.26 () {60 vars in 1153 bytes} [Wed Aug 24 05:46:00 2022] POST /identity/v3/projects => generated 373 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:46:00.787472 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:46:00.787949 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af315929-04d6-4418-af7d-97c5c5141ce1 None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:00.788237 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af315929-04d6-4418-af7d-97c5c5141ce1 None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:00.789252 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af315929-04d6-4418-af7d-97c5c5141ce1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:00.801272 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 852/1687] 10.222.0.26 () {58 vars in 1153 bytes} [Wed Aug 24 05:46:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:46:00.802418 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa794451-f136-42db-8230-4867c8a3d2f3 admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:00.828928 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa794451-f136-42db-8230-4867c8a3d2f3 admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:00.864402 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-af315929-04d6-4418-af7d-97c5c5141ce1 None None] MFA Rules not processed for user `282f09dc75eb495a972802c0e18f319d`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:46:00.866833 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-af315929-04d6-4418-af7d-97c5c5141ce1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:01.015956 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece2e43e-4a5b-447c-8044-2b18bd486e40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:01.027160 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece2e43e-4a5b-447c-8044-2b18bd486e40 admin admin] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:01.028279 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece2e43e-4a5b-447c-8044-2b18bd486e40 admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:01.028575 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece2e43e-4a5b-447c-8044-2b18bd486e40 admin admin] PATH_INFO: `/v3/users` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:01.031642 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece2e43e-4a5b-447c-8044-2b18bd486e40 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:01.041745 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece2e43e-4a5b-447c-8044-2b18bd486e40 admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:01.109323 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 836/1688] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:46:00 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 324 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:46:01.110569 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af315929-04d6-4418-af7d-97c5c5141ce1 None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:01.110690 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 853/1689] 10.222.0.26 () {60 vars in 1144 bytes} [Wed Aug 24 05:46:00 2022] POST /identity/v3/users => generated 287 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:46:01.111424 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece2e43e-4a5b-447c-8044-2b18bd486e40 admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:01.118819 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-ece2e43e-4a5b-447c-8044-2b18bd486e40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:01.141695 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af315929-04d6-4418-af7d-97c5c5141ce1 None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:01.147138 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc2aa34-94a3-4faf-99cc-ee7d56fbb49a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:01.147954 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc2aa34-94a3-4faf-99cc-ee7d56fbb49a admin admin] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:01.148187 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc2aa34-94a3-4faf-99cc-ee7d56fbb49a admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:01.148457 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc2aa34-94a3-4faf-99cc-ee7d56fbb49a admin admin] PATH_INFO: `/v3/projects` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:01.150440 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc2aa34-94a3-4faf-99cc-ee7d56fbb49a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:01.152484 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc2aa34-94a3-4faf-99cc-ee7d56fbb49a admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:01.211315 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 837/1690] 10.222.0.26 () {60 vars in 1153 bytes} [Wed Aug 24 05:46:01 2022] POST /identity/v3/projects => generated 367 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:46:01.211315 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc2aa34-94a3-4faf-99cc-ee7d56fbb49a admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:01.283005 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:46:01.286650 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece2e43e-4a5b-447c-8044-2b18bd486e40 admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:01.389744 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc2aa34-94a3-4faf-99cc-ee7d56fbb49a admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:01.409502 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f84db94-b207-4aa4-b553-8d07e97cd6ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:01.410696 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b23b2ec-b522-4038-86fc-f39eb9ccca49 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17b450afe795495680fc70f522c83750', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:01.411476 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b23b2ec-b522-4038-86fc-f39eb9ccca49 service cinder] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:01.412608 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b23b2ec-b522-4038-86fc-f39eb9ccca49 service cinder] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:01.412953 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b23b2ec-b522-4038-86fc-f39eb9ccca49 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:01.416684 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f84db94-b207-4aa4-b553-8d07e97cd6ab admin admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:01.417325 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f84db94-b207-4aa4-b553-8d07e97cd6ab admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:01.418177 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f84db94-b207-4aa4-b553-8d07e97cd6ab admin admin] PATH_INFO: `/v3/roles` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:01.423879 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f84db94-b207-4aa4-b553-8d07e97cd6ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:01.426213 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f84db94-b207-4aa4-b553-8d07e97cd6ab admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:01.477550 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 838/1691] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Aug 24 05:46:01 2022] GET /identity/v3/roles => generated 1420 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:46:01.480759 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f84db94-b207-4aa4-b553-8d07e97cd6ab admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:01.527914 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f84db94-b207-4aa4-b553-8d07e97cd6ab admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:01.551089 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78820c5-cd2b-40ce-8778-5dec666a56a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:01.551866 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78820c5-cd2b-40ce-8778-5dec666a56a5 admin admin] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:01.556325 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78820c5-cd2b-40ce-8778-5dec666a56a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:01.557405 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78820c5-cd2b-40ce-8778-5dec666a56a5 admin admin] PATH_INFO: `/v3/users` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:01.558958 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78820c5-cd2b-40ce-8778-5dec666a56a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:01.562949 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78820c5-cd2b-40ce-8778-5dec666a56a5 admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:01.563278 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:46:01.572714 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b23b2ec-b522-4038-86fc-f39eb9ccca49 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:01.575282 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b23b2ec-b522-4038-86fc-f39eb9ccca49 service cinder] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:01.630934 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 854/1692] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 24 05:46:01 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 520 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:46:01.631976 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b23b2ec-b522-4038-86fc-f39eb9ccca49 service cinder] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:01.636916 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 839/1693] 10.222.0.26 () {60 vars in 1144 bytes} [Wed Aug 24 05:46:01 2022] POST /identity/v3/users => generated 284 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:46:01.637873 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78820c5-cd2b-40ce-8778-5dec666a56a5 admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:01.664645 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b23b2ec-b522-4038-86fc-f39eb9ccca49 service cinder] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:01.665639 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78820c5-cd2b-40ce-8778-5dec666a56a5 admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:01.677170 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be31a6e5-6160-4c4d-af70-92c47ad6cc49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:01.677847 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be31a6e5-6160-4c4d-af70-92c47ad6cc49 admin admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:01.679840 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be31a6e5-6160-4c4d-af70-92c47ad6cc49 admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:01.680129 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be31a6e5-6160-4c4d-af70-92c47ad6cc49 admin admin] PATH_INFO: `/v3/roles` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:01.680857 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be31a6e5-6160-4c4d-af70-92c47ad6cc49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:01.687120 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759dd5a4-162e-44dc-857f-89fe29db6e2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:01.687895 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759dd5a4-162e-44dc-857f-89fe29db6e2f admin admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:01.688277 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759dd5a4-162e-44dc-857f-89fe29db6e2f admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:01.688682 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be31a6e5-6160-4c4d-af70-92c47ad6cc49 admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:01.688895 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759dd5a4-162e-44dc-857f-89fe29db6e2f admin admin] PATH_INFO: `/v3/roles` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:01.689660 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759dd5a4-162e-44dc-857f-89fe29db6e2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:01.694814 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759dd5a4-162e-44dc-857f-89fe29db6e2f admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:01.723515 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 855/1694] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Aug 24 05:46:01 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:46:01.724838 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759dd5a4-162e-44dc-857f-89fe29db6e2f admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:01.730830 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 840/1695] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Aug 24 05:46:01 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:46:01.731924 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be31a6e5-6160-4c4d-af70-92c47ad6cc49 admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:01.761382 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be31a6e5-6160-4c4d-af70-92c47ad6cc49 admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:01.762688 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759dd5a4-162e-44dc-857f-89fe29db6e2f admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:01.781145 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab7ff0f-a3a3-43fa-a0ff-7cecc263b32e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:01.781837 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab7ff0f-a3a3-43fa-a0ff-7cecc263b32e admin admin] REQUEST_METHOD: `PUT` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:01.786304 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab7ff0f-a3a3-43fa-a0ff-7cecc263b32e admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:01.786996 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab7ff0f-a3a3-43fa-a0ff-7cecc263b32e admin admin] PATH_INFO: `/v3/projects/2ee97507178242e8a0010a4cd19a5578/users/de0c11a177ed46f48613adda772262a9/roles/f7aa4a2c74c94c1b9ca8ecdcccccda5c` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:01.789835 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f6641c-dc4a-4bea-83c7-e607ef8786cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:01.792714 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f6641c-dc4a-4bea-83c7-e607ef8786cd admin admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:01.793252 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f6641c-dc4a-4bea-83c7-e607ef8786cd admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:01.794126 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f6641c-dc4a-4bea-83c7-e607ef8786cd admin admin] PATH_INFO: `/v3/roles` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:01.796260 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f6641c-dc4a-4bea-83c7-e607ef8786cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:01.801974 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f6641c-dc4a-4bea-83c7-e607ef8786cd admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:01.828770 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 841/1696] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Aug 24 05:46:01 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:46:01.833811 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f6641c-dc4a-4bea-83c7-e607ef8786cd admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:01.849550 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab7ff0f-a3a3-43fa-a0ff-7cecc263b32e admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ee97507178242e8a0010a4cd19a5578, user_id=de0c11a177ed46f48613adda772262a9, role_id=f7aa4a2c74c94c1b9ca8ecdcccccda5c)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:01.852294 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab7ff0f-a3a3-43fa-a0ff-7cecc263b32e admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:01.852888 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f6641c-dc4a-4bea-83c7-e607ef8786cd admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:01.862728 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e071dd6c-bd1f-4c4b-8ba6-62e881f17e9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:01.873537 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e071dd6c-bd1f-4c4b-8ba6-62e881f17e9f admin admin] REQUEST_METHOD: `PUT` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:01.874322 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e071dd6c-bd1f-4c4b-8ba6-62e881f17e9f admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:01.874836 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e071dd6c-bd1f-4c4b-8ba6-62e881f17e9f admin admin] PATH_INFO: `/v3/projects/e86176aee1dc46d896986c161b93aa86/users/83509ee7cfbb458c9fc6ed8f6faa0784/roles/f7aa4a2c74c94c1b9ca8ecdcccccda5c` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:01.899553 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 856/1697] 10.222.0.26 () {60 vars in 1483 bytes} [Wed Aug 24 05:46:01 2022] PUT /identity/v3/projects/2ee97507178242e8a0010a4cd19a5578/users/de0c11a177ed46f48613adda772262a9/roles/f7aa4a2c74c94c1b9ca8ecdcccccda5c => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:46:01.911406 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bcb822-61b9-4b0f-8a3f-d79a2ff4ef1d None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:01.911602 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bcb822-61b9-4b0f-8a3f-d79a2ff4ef1d None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:01.911882 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bcb822-61b9-4b0f-8a3f-d79a2ff4ef1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:01.929093 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e071dd6c-bd1f-4c4b-8ba6-62e881f17e9f admin admin] RBAC: Authorizing `identity:create_grant(project_id=e86176aee1dc46d896986c161b93aa86, user_id=83509ee7cfbb458c9fc6ed8f6faa0784, role_id=f7aa4a2c74c94c1b9ca8ecdcccccda5c)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:01.932551 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e071dd6c-bd1f-4c4b-8ba6-62e881f17e9f admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:01.966789 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 842/1698] 10.222.0.26 () {60 vars in 1483 bytes} [Wed Aug 24 05:46:01 2022] PUT /identity/v3/projects/e86176aee1dc46d896986c161b93aa86/users/83509ee7cfbb458c9fc6ed8f6faa0784/roles/f7aa4a2c74c94c1b9ca8ecdcccccda5c => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:46:01.981932 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55db94b-1651-4bb4-91de-5a79f6b60c87 None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:01.982370 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55db94b-1651-4bb4-91de-5a79f6b60c87 None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:01.984065 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55db94b-1651-4bb4-91de-5a79f6b60c87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:02.006197 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-b4bcb822-61b9-4b0f-8a3f-d79a2ff4ef1d None None] MFA Rules not processed for user `de0c11a177ed46f48613adda772262a9`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:46:02.008008 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-b4bcb822-61b9-4b0f-8a3f-d79a2ff4ef1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:02.059550 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-c55db94b-1651-4bb4-91de-5a79f6b60c87 None None] MFA Rules not processed for user `83509ee7cfbb458c9fc6ed8f6faa0784`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:46:02.062808 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-c55db94b-1651-4bb4-91de-5a79f6b60c87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:02.230033 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 857/1699] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:46:01 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 320 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 05:46:02.235233 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bcb822-61b9-4b0f-8a3f-d79a2ff4ef1d None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:02.326096 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 843/1700] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:46:01 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 355 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:46:02.333552 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55db94b-1651-4bb4-91de-5a79f6b60c87 None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:02.469271 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bcb822-61b9-4b0f-8a3f-d79a2ff4ef1d None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:02.474956 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2322bddd-f448-407c-939e-2c611e7c968f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:02.475839 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:46:02.478106 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2322bddd-f448-407c-939e-2c611e7c968f admin admin] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:02.478607 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2322bddd-f448-407c-939e-2c611e7c968f admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:02.479572 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2322bddd-f448-407c-939e-2c611e7c968f admin admin] PATH_INFO: `/v3/projects` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:02.480462 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2322bddd-f448-407c-939e-2c611e7c968f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:02.483522 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2322bddd-f448-407c-939e-2c611e7c968f admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:02.516930 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55db94b-1651-4bb4-91de-5a79f6b60c87 None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:02.554813 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b22524e-3802-4460-b446-6f951fc1b4c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:02.556441 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b22524e-3802-4460-b446-6f951fc1b4c0 admin admin] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:02.556802 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b22524e-3802-4460-b446-6f951fc1b4c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:02.557809 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b22524e-3802-4460-b446-6f951fc1b4c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:02.559995 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b22524e-3802-4460-b446-6f951fc1b4c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:02.569668 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b22524e-3802-4460-b446-6f951fc1b4c0 admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:02.569816 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 858/1701] 10.222.0.26 () {60 vars in 1153 bytes} [Wed Aug 24 05:46:02 2022] POST /identity/v3/projects => generated 371 bytes in 335 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:46:02.571136 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75b67bb-5199-4094-aa60-6d9faa0f1af6 None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:02.571828 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75b67bb-5199-4094-aa60-6d9faa0f1af6 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:02.574523 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75b67bb-5199-4094-aa60-6d9faa0f1af6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:02.654205 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 844/1702] 10.222.0.26 () {60 vars in 1153 bytes} [Wed Aug 24 05:46:02 2022] POST /identity/v3/projects => generated 369 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 05:46:02.656494 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b22524e-3802-4460-b446-6f951fc1b4c0 admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:02.664708 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-d75b67bb-5199-4094-aa60-6d9faa0f1af6 None None] MFA Rules not processed for user `03ec8115674d43f1bc6c6b58461ed17e`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:46:02.665939 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-d75b67bb-5199-4094-aa60-6d9faa0f1af6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:02.719913 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:46:02.762762 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b22524e-3802-4460-b446-6f951fc1b4c0 admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:02.770011 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4e1a90-d19c-4b59-ad5c-43943633fa13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:02.772274 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4e1a90-d19c-4b59-ad5c-43943633fa13 admin admin] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:02.773806 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4e1a90-d19c-4b59-ad5c-43943633fa13 admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:02.773806 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4e1a90-d19c-4b59-ad5c-43943633fa13 admin admin] PATH_INFO: `/v3/users` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:02.774347 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4e1a90-d19c-4b59-ad5c-43943633fa13 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:02.776470 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4e1a90-d19c-4b59-ad5c-43943633fa13 admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:02.847913 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 845/1703] 10.222.0.26 () {60 vars in 1144 bytes} [Wed Aug 24 05:46:02 2022] POST /identity/v3/users => generated 292 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:46:02.849364 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4e1a90-d19c-4b59-ad5c-43943633fa13 admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:02.868259 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 859/1704] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:46:02 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:46:02.869405 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75b67bb-5199-4094-aa60-6d9faa0f1af6 None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:02.883739 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4e1a90-d19c-4b59-ad5c-43943633fa13 admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:02.895007 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f668b2d9-9756-4df3-a4ec-b76e6d490dc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:02.895777 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f668b2d9-9756-4df3-a4ec-b76e6d490dc5 admin admin] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:02.895964 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f668b2d9-9756-4df3-a4ec-b76e6d490dc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:02.896192 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f668b2d9-9756-4df3-a4ec-b76e6d490dc5 admin admin] PATH_INFO: `/v3/users` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:02.896832 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f668b2d9-9756-4df3-a4ec-b76e6d490dc5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:02.897187 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75b67bb-5199-4094-aa60-6d9faa0f1af6 None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:02.898810 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f668b2d9-9756-4df3-a4ec-b76e6d490dc5 admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:02.910426 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83ec79f-b822-4648-934e-b37f9015716c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:02.911078 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83ec79f-b822-4648-934e-b37f9015716c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:02.911656 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83ec79f-b822-4648-934e-b37f9015716c admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:02.911935 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83ec79f-b822-4648-934e-b37f9015716c admin admin] PATH_INFO: `/v3/users/c0659cfdaf054d26804ced545c62a465` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:02.918656 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83ec79f-b822-4648-934e-b37f9015716c admin admin] RBAC: Authorizing `identity:delete_user(user_id=c0659cfdaf054d26804ced545c62a465)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:02.921732 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83ec79f-b822-4648-934e-b37f9015716c admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:02.947343 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 846/1705] 10.222.0.26 () {60 vars in 1144 bytes} [Wed Aug 24 05:46:02 2022] POST /identity/v3/users => generated 291 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:46:02.949020 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f668b2d9-9756-4df3-a4ec-b76e6d490dc5 admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:02.973495 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f668b2d9-9756-4df3-a4ec-b76e6d490dc5 admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:02.988392 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23865d50-70bf-495d-8e8b-c840f94ab22c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:02.991741 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23865d50-70bf-495d-8e8b-c840f94ab22c admin admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:02.992627 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23865d50-70bf-495d-8e8b-c840f94ab22c admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:02.993750 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23865d50-70bf-495d-8e8b-c840f94ab22c admin admin] PATH_INFO: `/v3/roles` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:02.994819 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23865d50-70bf-495d-8e8b-c840f94ab22c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:02.996955 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23865d50-70bf-495d-8e8b-c840f94ab22c admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:03.028348 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 847/1706] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Aug 24 05:46:02 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:46:03.032441 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-a83ec79f-b822-4648-934e-b37f9015716c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c0659cfdaf054d26804ced545c62a465'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:03.034500 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23865d50-70bf-495d-8e8b-c840f94ab22c admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:03.054249 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-a83ec79f-b822-4648-934e-b37f9015716c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c0659cfdaf054d26804ced545c62a465'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:03.057549 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-a83ec79f-b822-4648-934e-b37f9015716c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c0659cfdaf054d26804ced545c62a465'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:03.063038 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23865d50-70bf-495d-8e8b-c840f94ab22c admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:03.076128 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e500a8-bde9-4dfd-9e34-a3c81e63b030 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:03.077191 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e500a8-bde9-4dfd-9e34-a3c81e63b030 admin admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:03.078991 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e500a8-bde9-4dfd-9e34-a3c81e63b030 admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:03.080325 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e500a8-bde9-4dfd-9e34-a3c81e63b030 admin admin] PATH_INFO: `/v3/roles` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:03.080991 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e500a8-bde9-4dfd-9e34-a3c81e63b030 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:03.084751 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e500a8-bde9-4dfd-9e34-a3c81e63b030 admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:03.092698 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-a83ec79f-b822-4648-934e-b37f9015716c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c0659cfdaf054d26804ced545c62a465'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:03.106936 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 848/1707] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Aug 24 05:46:03 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:46:03.108191 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e500a8-bde9-4dfd-9e34-a3c81e63b030 admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:03.110432 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-a83ec79f-b822-4648-934e-b37f9015716c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c0659cfdaf054d26804ced545c62a465'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:03.117290 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-24e500a8-bde9-4dfd-9e34-a3c81e63b030 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:03.123327 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 860/1708] 10.222.0.26 () {58 vars in 1224 bytes} [Wed Aug 24 05:46:02 2022] DELETE /identity/v3/users/c0659cfdaf054d26804ced545c62a465 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:46:03.123327 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83ec79f-b822-4648-934e-b37f9015716c admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:03.126474 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-a83ec79f-b822-4648-934e-b37f9015716c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:03.157051 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e500a8-bde9-4dfd-9e34-a3c81e63b030 admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:03.363929 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83ec79f-b822-4648-934e-b37f9015716c admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:03.372272 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb814eab-da72-4bee-82a0-fedf91307640 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:03.374446 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb814eab-da72-4bee-82a0-fedf91307640 admin admin] REQUEST_METHOD: `PUT` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:03.374829 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb814eab-da72-4bee-82a0-fedf91307640 admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:03.375343 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb814eab-da72-4bee-82a0-fedf91307640 admin admin] PATH_INFO: `/v3/projects/a7efca8b40bd41aea934ea0b27ba9335/users/4bc547397de541a0a9ab8272dc67fc28/roles/640bda0879494e60b72680ee505285f0` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:03.376924 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebd371f-e690-49d4-8b85-ff24b521b0b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:03.378733 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebd371f-e690-49d4-8b85-ff24b521b0b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:03.379314 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebd371f-e690-49d4-8b85-ff24b521b0b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:03.379620 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebd371f-e690-49d4-8b85-ff24b521b0b7 admin admin] PATH_INFO: `/v3/projects/b5e39618b77346dab91c43de4708f4f7/users/0ab6179e57c94794884b5fe3b40d66d4/roles/640bda0879494e60b72680ee505285f0` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:03.402996 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebd371f-e690-49d4-8b85-ff24b521b0b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5e39618b77346dab91c43de4708f4f7, user_id=0ab6179e57c94794884b5fe3b40d66d4, role_id=640bda0879494e60b72680ee505285f0)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:03.406827 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebd371f-e690-49d4-8b85-ff24b521b0b7 admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:03.441496 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 861/1709] 10.222.0.26 () {60 vars in 1483 bytes} [Wed Aug 24 05:46:03 2022] PUT /identity/v3/projects/b5e39618b77346dab91c43de4708f4f7/users/0ab6179e57c94794884b5fe3b40d66d4/roles/640bda0879494e60b72680ee505285f0 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:46:03.443337 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbea9f3f-f3fb-4227-9e73-12cb962e2b36 None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:03.443627 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbea9f3f-f3fb-4227-9e73-12cb962e2b36 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:03.443897 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbea9f3f-f3fb-4227-9e73-12cb962e2b36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:03.444431 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb814eab-da72-4bee-82a0-fedf91307640 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7efca8b40bd41aea934ea0b27ba9335, user_id=4bc547397de541a0a9ab8272dc67fc28, role_id=640bda0879494e60b72680ee505285f0)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:03.449820 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb814eab-da72-4bee-82a0-fedf91307640 admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:03.479928 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 849/1710] 10.222.0.26 () {60 vars in 1483 bytes} [Wed Aug 24 05:46:03 2022] PUT /identity/v3/projects/a7efca8b40bd41aea934ea0b27ba9335/users/4bc547397de541a0a9ab8272dc67fc28/roles/640bda0879494e60b72680ee505285f0 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:46:03.481263 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb814eab-da72-4bee-82a0-fedf91307640 admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:03.489973 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:46:03.501256 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-bbea9f3f-f3fb-4227-9e73-12cb962e2b36 None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:46:03.506098 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-bbea9f3f-f3fb-4227-9e73-12cb962e2b36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:03.532784 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:46:03.615515 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb814eab-da72-4bee-82a0-fedf91307640 admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:03.621548 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7ebf5b-a994-4224-a8b8-00e22682a885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:03.622504 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7ebf5b-a994-4224-a8b8-00e22682a885 admin admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:03.623452 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7ebf5b-a994-4224-a8b8-00e22682a885 admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:03.623995 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7ebf5b-a994-4224-a8b8-00e22682a885 admin admin] PATH_INFO: `/v3/roles` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:03.624684 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7ebf5b-a994-4224-a8b8-00e22682a885 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:03.630483 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7ebf5b-a994-4224-a8b8-00e22682a885 admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:03.651394 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 862/1711] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:46:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:46:03.652495 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbea9f3f-f3fb-4227-9e73-12cb962e2b36 None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:03.663526 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 850/1712] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Aug 24 05:46:03 2022] GET /identity/v3/roles => generated 1420 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:46:03.665234 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7ebf5b-a994-4224-a8b8-00e22682a885 admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:03.668362 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-6e7ebf5b-a994-4224-a8b8-00e22682a885 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:03.679405 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbea9f3f-f3fb-4227-9e73-12cb962e2b36 None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:03.685755 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc666a6-8cbe-424b-acd6-b93633552811 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:03.686406 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc666a6-8cbe-424b-acd6-b93633552811 admin admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:03.686681 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc666a6-8cbe-424b-acd6-b93633552811 admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:03.687015 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc666a6-8cbe-424b-acd6-b93633552811 admin admin] PATH_INFO: `/v3/roles` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:03.688294 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc666a6-8cbe-424b-acd6-b93633552811 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:03.689051 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7ebf5b-a994-4224-a8b8-00e22682a885 admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:03.689980 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc666a6-8cbe-424b-acd6-b93633552811 admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:03.696463 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dab8e1-a09d-454e-bbd7-c11f6eaae20c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:03.697389 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dab8e1-a09d-454e-bbd7-c11f6eaae20c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:03.697673 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dab8e1-a09d-454e-bbd7-c11f6eaae20c admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:03.697975 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dab8e1-a09d-454e-bbd7-c11f6eaae20c admin admin] PATH_INFO: `/v3/users/416cb0ff691a407b81583043218c6cca` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:03.699149 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47dab8e1-a09d-454e-bbd7-c11f6eaae20c admin admin] RBAC: Authorizing `identity:delete_user(user_id=416cb0ff691a407b81583043218c6cca)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:03.702278 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47dab8e1-a09d-454e-bbd7-c11f6eaae20c admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:03.721441 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 863/1713] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Aug 24 05:46:03 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:46:03.725090 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc666a6-8cbe-424b-acd6-b93633552811 admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:03.738562 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc666a6-8cbe-424b-acd6-b93633552811 admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:03.745065 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8421337d-8f75-4aba-bc8a-a56405113a27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:03.745773 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8421337d-8f75-4aba-bc8a-a56405113a27 admin admin] REQUEST_METHOD: `PUT` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:03.746449 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8421337d-8f75-4aba-bc8a-a56405113a27 admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:03.746743 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8421337d-8f75-4aba-bc8a-a56405113a27 admin admin] PATH_INFO: `/v3/projects/b5e39618b77346dab91c43de4708f4f7/users/0ab6179e57c94794884b5fe3b40d66d4/roles/640bda0879494e60b72680ee505285f0` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:03.748863 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8421337d-8f75-4aba-bc8a-a56405113a27 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5e39618b77346dab91c43de4708f4f7, user_id=0ab6179e57c94794884b5fe3b40d66d4, role_id=640bda0879494e60b72680ee505285f0)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:03.751902 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8421337d-8f75-4aba-bc8a-a56405113a27 admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:03.770266 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 864/1714] 10.222.0.26 () {60 vars in 1483 bytes} [Wed Aug 24 05:46:03 2022] PUT /identity/v3/projects/b5e39618b77346dab91c43de4708f4f7/users/0ab6179e57c94794884b5fe3b40d66d4/roles/640bda0879494e60b72680ee505285f0 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:46:03.771775 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8421337d-8f75-4aba-bc8a-a56405113a27 admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:03.774128 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-8421337d-8f75-4aba-bc8a-a56405113a27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:03.815715 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-47dab8e1-a09d-454e-bbd7-c11f6eaae20c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '416cb0ff691a407b81583043218c6cca'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:03.834024 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-47dab8e1-a09d-454e-bbd7-c11f6eaae20c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '416cb0ff691a407b81583043218c6cca'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:03.864743 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-47dab8e1-a09d-454e-bbd7-c11f6eaae20c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '416cb0ff691a407b81583043218c6cca'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:03.880200 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-47dab8e1-a09d-454e-bbd7-c11f6eaae20c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '416cb0ff691a407b81583043218c6cca'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:03.881020 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-47dab8e1-a09d-454e-bbd7-c11f6eaae20c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '416cb0ff691a407b81583043218c6cca'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:03.890121 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 851/1715] 10.222.0.26 () {58 vars in 1224 bytes} [Wed Aug 24 05:46:03 2022] DELETE /identity/v3/users/416cb0ff691a407b81583043218c6cca => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:46:03.894202 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dab8e1-a09d-454e-bbd7-c11f6eaae20c admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:03.896157 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-47dab8e1-a09d-454e-bbd7-c11f6eaae20c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:03.904432 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8421337d-8f75-4aba-bc8a-a56405113a27 admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:04.018334 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0711ec-f760-499d-8ea3-d104c11055c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '874348b647194ac2b5ecbf12c33bf59e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:04.019328 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0711ec-f760-499d-8ea3-d104c11055c2 service neutron] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:04.020882 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0711ec-f760-499d-8ea3-d104c11055c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:04.022044 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0711ec-f760-499d-8ea3-d104c11055c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:04.027368 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-5b0711ec-f760-499d-8ea3-d104c11055c2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:04.049300 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dab8e1-a09d-454e-bbd7-c11f6eaae20c admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:04.060191 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0711ec-f760-499d-8ea3-d104c11055c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:04.063159 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0711ec-f760-499d-8ea3-d104c11055c2 service neutron] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:04.068941 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e299cc-f591-4c4e-ac21-ca82396faa56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:04.069753 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e299cc-f591-4c4e-ac21-ca82396faa56 admin admin] REQUEST_METHOD: `PUT` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:04.070137 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e299cc-f591-4c4e-ac21-ca82396faa56 admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:04.071196 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e299cc-f591-4c4e-ac21-ca82396faa56 admin admin] PATH_INFO: `/v3/projects/a7efca8b40bd41aea934ea0b27ba9335/users/4bc547397de541a0a9ab8272dc67fc28/roles/640bda0879494e60b72680ee505285f0` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:04.098638 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e299cc-f591-4c4e-ac21-ca82396faa56 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7efca8b40bd41aea934ea0b27ba9335, user_id=4bc547397de541a0a9ab8272dc67fc28, role_id=640bda0879494e60b72680ee505285f0)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:04.103482 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e299cc-f591-4c4e-ac21-ca82396faa56 admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:04.114926 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 865/1716] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 24 05:46:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:46:04.116342 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dc2ea9-a3dd-4664-bdb7-7db11d62f58c None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:04.116738 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dc2ea9-a3dd-4664-bdb7-7db11d62f58c None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:04.117126 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dc2ea9-a3dd-4664-bdb7-7db11d62f58c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:04.147377 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 852/1717] 10.222.0.26 () {60 vars in 1483 bytes} [Wed Aug 24 05:46:03 2022] PUT /identity/v3/projects/a7efca8b40bd41aea934ea0b27ba9335/users/4bc547397de541a0a9ab8272dc67fc28/roles/640bda0879494e60b72680ee505285f0 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:46:04.154030 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11589bbd-2e07-4dad-a60b-b06e475fdeff None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:04.155274 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11589bbd-2e07-4dad-a60b-b06e475fdeff None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:04.155567 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11589bbd-2e07-4dad-a60b-b06e475fdeff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:04.177033 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-56dc2ea9-a3dd-4664-bdb7-7db11d62f58c None None] MFA Rules not processed for user `0ab6179e57c94794884b5fe3b40d66d4`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:46:04.179758 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-56dc2ea9-a3dd-4664-bdb7-7db11d62f58c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:04.182991 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:46:04.205925 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-11589bbd-2e07-4dad-a60b-b06e475fdeff None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:46:04.208692 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-11589bbd-2e07-4dad-a60b-b06e475fdeff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:04.277862 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:46:04.310157 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 853/1718] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:46:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:46:04.313498 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b979b62b-7312-493a-8f8b-e16165b733fd None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:04.313498 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b979b62b-7312-493a-8f8b-e16165b733fd None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:04.313498 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b979b62b-7312-493a-8f8b-e16165b733fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:04.345927 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 866/1719] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:46:04 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:46:04.345927 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65244400-07b4-4837-84f9-70447ee72364 None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:04.345927 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65244400-07b4-4837-84f9-70447ee72364 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:04.345927 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65244400-07b4-4837-84f9-70447ee72364 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:04.369153 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-b979b62b-7312-493a-8f8b-e16165b733fd None None] MFA Rules not processed for user `7ea384c1544c424eb2b524760e1d6d22`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:46:04.370434 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-b979b62b-7312-493a-8f8b-e16165b733fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:04.420828 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-65244400-07b4-4837-84f9-70447ee72364 None None] MFA Rules not processed for user `4bc547397de541a0a9ab8272dc67fc28`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:46:04.426191 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-65244400-07b4-4837-84f9-70447ee72364 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:04.487196 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 854/1720] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:46:04 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:46:04.487196 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b979b62b-7312-493a-8f8b-e16165b733fd None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:04.498759 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-b979b62b-7312-493a-8f8b-e16165b733fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:04.575055 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 867/1721] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:46:04 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:46:04.577323 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65244400-07b4-4837-84f9-70447ee72364 None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:04.578944 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-65244400-07b4-4837-84f9-70447ee72364 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:04.631484 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b979b62b-7312-493a-8f8b-e16165b733fd None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:04.639413 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012f07e8-964a-4ffa-ac0d-2d1c6994d09f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17b450afe795495680fc70f522c83750', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:04.640108 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012f07e8-964a-4ffa-ac0d-2d1c6994d09f service cinder] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:04.640521 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012f07e8-964a-4ffa-ac0d-2d1c6994d09f service cinder] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:04.640796 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012f07e8-964a-4ffa-ac0d-2d1c6994d09f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:04.660470 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012f07e8-964a-4ffa-ac0d-2d1c6994d09f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:04.662131 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012f07e8-964a-4ffa-ac0d-2d1c6994d09f service cinder] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:04.705281 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 855/1722] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 24 05:46:04 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:46:04.708108 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012f07e8-964a-4ffa-ac0d-2d1c6994d09f service cinder] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:04.710537 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-012f07e8-964a-4ffa-ac0d-2d1c6994d09f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:04.775698 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65244400-07b4-4837-84f9-70447ee72364 None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:04.790798 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fd400b-2eb4-49f9-aac1-ccca220b236d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b633e1aec6c4269bce13aa9c89e911a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:04.791894 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fd400b-2eb4-49f9-aac1-ccca220b236d service nova] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:04.792186 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fd400b-2eb4-49f9-aac1-ccca220b236d service nova] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:04.792465 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fd400b-2eb4-49f9-aac1-ccca220b236d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:04.810443 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fd400b-2eb4-49f9-aac1-ccca220b236d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:04.812926 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fd400b-2eb4-49f9-aac1-ccca220b236d service nova] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:04.834178 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:46:04.835869 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 868/1723] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 24 05:46:04 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:46:04.852328 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fd400b-2eb4-49f9-aac1-ccca220b236d service nova] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:04.856997 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-c8fd400b-2eb4-49f9-aac1-ccca220b236d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:04.895276 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012f07e8-964a-4ffa-ac0d-2d1c6994d09f service cinder] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:04.897018 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fd400b-2eb4-49f9-aac1-ccca220b236d service nova] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:04.902180 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84616289-192c-4a2a-947f-163ea979fbac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '874348b647194ac2b5ecbf12c33bf59e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:04.904527 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19235d6b-7216-4e6b-b071-641d10ce47b1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17b450afe795495680fc70f522c83750', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:04.905507 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19235d6b-7216-4e6b-b071-641d10ce47b1 service cinder] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:04.905507 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19235d6b-7216-4e6b-b071-641d10ce47b1 service cinder] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:04.905675 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19235d6b-7216-4e6b-b071-641d10ce47b1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:04.906203 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84616289-192c-4a2a-947f-163ea979fbac service neutron] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:04.907064 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84616289-192c-4a2a-947f-163ea979fbac service neutron] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:04.907338 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84616289-192c-4a2a-947f-163ea979fbac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:04.945447 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84616289-192c-4a2a-947f-163ea979fbac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:04.947297 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84616289-192c-4a2a-947f-163ea979fbac service neutron] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:04.957222 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19235d6b-7216-4e6b-b071-641d10ce47b1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:04.959469 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19235d6b-7216-4e6b-b071-641d10ce47b1 service cinder] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:04.993646 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 869/1724] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 24 05:46:04 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:46:04.994260 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 856/1725] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 24 05:46:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:46:04.995930 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a0523f-f098-49e7-a3cd-c9ef02c70f98 None None] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:04.996220 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a0523f-f098-49e7-a3cd-c9ef02c70f98 None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:04.996489 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a0523f-f098-49e7-a3cd-c9ef02c70f98 None None] PATH_INFO: `/` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:04.999338 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19235d6b-7216-4e6b-b071-641d10ce47b1 service cinder] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:05.008696 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 857/1726] 10.222.0.26 () {54 vars in 921 bytes} [Wed Aug 24 05:46:04 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:46:05.021203 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19235d6b-7216-4e6b-b071-641d10ce47b1 service cinder] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:05.037008 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982a536b-1bc9-45c5-bd81-8b87e75f9145 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17b450afe795495680fc70f522c83750', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:05.037917 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982a536b-1bc9-45c5-bd81-8b87e75f9145 service cinder] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:05.038448 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982a536b-1bc9-45c5-bd81-8b87e75f9145 service cinder] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:05.046446 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982a536b-1bc9-45c5-bd81-8b87e75f9145 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:05.050338 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-982a536b-1bc9-45c5-bd81-8b87e75f9145 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:05.062656 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c221fe-8121-4bd9-a9a4-565cbc685161 None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:05.063737 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c221fe-8121-4bd9-a9a4-565cbc685161 None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:05.064227 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c221fe-8121-4bd9-a9a4-565cbc685161 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:05.124396 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-39c221fe-8121-4bd9-a9a4-565cbc685161 None None] MFA Rules not processed for user `995ebe690b7748c9842bc0696415fc52`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:46:05.125644 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-39c221fe-8121-4bd9-a9a4-565cbc685161 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:05.169266 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:46:05.243206 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982a536b-1bc9-45c5-bd81-8b87e75f9145 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:05.245650 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982a536b-1bc9-45c5-bd81-8b87e75f9145 service cinder] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:05.266071 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 870/1727] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 24 05:46:04 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:46:05.267865 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982a536b-1bc9-45c5-bd81-8b87e75f9145 service cinder] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:05.296924 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982a536b-1bc9-45c5-bd81-8b87e75f9145 service cinder] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:05.302160 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 858/1728] 10.222.0.26 () {58 vars in 1018 bytes} [Wed Aug 24 05:46:05 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:46:05.306840 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569cc19a-ded9-47f8-8635-b9345c0ed81d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17b450afe795495680fc70f522c83750', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:05.308880 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569cc19a-ded9-47f8-8635-b9345c0ed81d service cinder] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:05.309175 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569cc19a-ded9-47f8-8635-b9345c0ed81d service cinder] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:05.309465 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569cc19a-ded9-47f8-8635-b9345c0ed81d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:05.316165 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-569cc19a-ded9-47f8-8635-b9345c0ed81d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:05.327318 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e099e908-5e53-4716-a8d8-9e56d4bcf741 None None] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:05.327614 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e099e908-5e53-4716-a8d8-9e56d4bcf741 None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:05.327871 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e099e908-5e53-4716-a8d8-9e56d4bcf741 None None] PATH_INFO: `/` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:05.330152 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 859/1729] 10.222.0.26 () {54 vars in 961 bytes} [Wed Aug 24 05:46:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:46:05.336748 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95118468-d349-4ffb-bc81-f774ae589503 None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:05.338954 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95118468-d349-4ffb-bc81-f774ae589503 None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:05.339315 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95118468-d349-4ffb-bc81-f774ae589503 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:05.386105 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-95118468-d349-4ffb-bc81-f774ae589503 None None] MFA Rules not processed for user `995ebe690b7748c9842bc0696415fc52`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:46:05.391777 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-95118468-d349-4ffb-bc81-f774ae589503 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:05.416906 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 860/1730] 10.222.0.26 () {58 vars in 1058 bytes} [Wed Aug 24 05:46:05 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 05:46:05.428150 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95118468-d349-4ffb-bc81-f774ae589503 None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:05.445006 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95118468-d349-4ffb-bc81-f774ae589503 None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:05.460718 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa603e6-285a-49f8-a535-3cd7a5aa5bb1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '995ebe690b7748c9842bc0696415fc52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:05.461355 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa603e6-285a-49f8-a535-3cd7a5aa5bb1 service placement] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:05.461635 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa603e6-285a-49f8-a535-3cd7a5aa5bb1 service placement] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:05.461910 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa603e6-285a-49f8-a535-3cd7a5aa5bb1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:05.483862 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa603e6-285a-49f8-a535-3cd7a5aa5bb1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:05.485476 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa603e6-285a-49f8-a535-3cd7a5aa5bb1 service placement] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:05.487429 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569cc19a-ded9-47f8-8635-b9345c0ed81d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:05.489064 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569cc19a-ded9-47f8-8635-b9345c0ed81d service cinder] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:05.512815 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 861/1731] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 24 05:46:05 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:46:05.520408 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 871/1732] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 24 05:46:05 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:46:06.218838 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa603e6-285a-49f8-a535-3cd7a5aa5bb1 service placement] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:06.220466 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-1fa603e6-285a-49f8-a535-3cd7a5aa5bb1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:06.246305 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa603e6-285a-49f8-a535-3cd7a5aa5bb1 service placement] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:06.258956 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08785840-5212-4e83-a89f-44efb8d9e7c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:06.259815 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08785840-5212-4e83-a89f-44efb8d9e7c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:06.261034 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08785840-5212-4e83-a89f-44efb8d9e7c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:06.261468 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08785840-5212-4e83-a89f-44efb8d9e7c4 admin admin] PATH_INFO: `/v3/projects/a3bb48fbaa2a42daa851939bb33add59` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:06.263319 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08785840-5212-4e83-a89f-44efb8d9e7c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a3bb48fbaa2a42daa851939bb33add59)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:06.267854 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08785840-5212-4e83-a89f-44efb8d9e7c4 admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:06.355323 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-08785840-5212-4e83-a89f-44efb8d9e7c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a3bb48fbaa2a42daa851939bb33add59', 'request_id': 'req-08785840-5212-4e83-a89f-44efb8d9e7c4'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:06.368861 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-08785840-5212-4e83-a89f-44efb8d9e7c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a3bb48fbaa2a42daa851939bb33add59', 'request_id': 'req-08785840-5212-4e83-a89f-44efb8d9e7c4'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:06.381010 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569cc19a-ded9-47f8-8635-b9345c0ed81d service cinder] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:06.382578 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-569cc19a-ded9-47f8-8635-b9345c0ed81d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:06.384119 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-08785840-5212-4e83-a89f-44efb8d9e7c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a3bb48fbaa2a42daa851939bb33add59', 'request_id': 'req-08785840-5212-4e83-a89f-44efb8d9e7c4'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:06.412520 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569cc19a-ded9-47f8-8635-b9345c0ed81d service cinder] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:06.420834 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-08785840-5212-4e83-a89f-44efb8d9e7c4 admin admin] The token cache is being invalidate because project a3bb48fbaa2a42daa851939bb33add59 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88112) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:46:06.421177 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-08785840-5212-4e83-a89f-44efb8d9e7c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:06.422094 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-08785840-5212-4e83-a89f-44efb8d9e7c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:06.429912 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 862/1733] 10.222.0.26 () {58 vars in 1233 bytes} [Wed Aug 24 05:46:06 2022] DELETE /identity/v3/projects/a3bb48fbaa2a42daa851939bb33add59 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:46:06.431890 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08785840-5212-4e83-a89f-44efb8d9e7c4 admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:06.434620 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-08785840-5212-4e83-a89f-44efb8d9e7c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:06.544054 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8004976-8400-448f-879f-5aa1d61e1c5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:06.546419 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:46:06.546540 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8004976-8400-448f-879f-5aa1d61e1c5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:06.548230 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8004976-8400-448f-879f-5aa1d61e1c5e admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:06.548606 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8004976-8400-448f-879f-5aa1d61e1c5e admin admin] PATH_INFO: `/v3/projects/913768c432af4149af8afcbb097c09cb` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:06.550736 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8004976-8400-448f-879f-5aa1d61e1c5e admin admin] RBAC: Authorizing `identity:delete_project(project_id=913768c432af4149af8afcbb097c09cb)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:06.556863 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8004976-8400-448f-879f-5aa1d61e1c5e admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:06.601249 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08785840-5212-4e83-a89f-44efb8d9e7c4 admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:06.612714 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15b7fa3-de9d-42a1-8b99-e35dd13b3fe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:06.614824 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15b7fa3-de9d-42a1-8b99-e35dd13b3fe1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:06.615172 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15b7fa3-de9d-42a1-8b99-e35dd13b3fe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:06.615449 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15b7fa3-de9d-42a1-8b99-e35dd13b3fe1 admin admin] PATH_INFO: `/v3/users/e6dd2f14ef284422a43da62b58dda569` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:06.618179 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15b7fa3-de9d-42a1-8b99-e35dd13b3fe1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e6dd2f14ef284422a43da62b58dda569)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:06.624890 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15b7fa3-de9d-42a1-8b99-e35dd13b3fe1 admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:06.658142 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-b8004976-8400-448f-879f-5aa1d61e1c5e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '913768c432af4149af8afcbb097c09cb', 'request_id': 'req-b8004976-8400-448f-879f-5aa1d61e1c5e'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:06.672482 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-b8004976-8400-448f-879f-5aa1d61e1c5e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '913768c432af4149af8afcbb097c09cb', 'request_id': 'req-b8004976-8400-448f-879f-5aa1d61e1c5e'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:06.680987 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-b8004976-8400-448f-879f-5aa1d61e1c5e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '913768c432af4149af8afcbb097c09cb', 'request_id': 'req-b8004976-8400-448f-879f-5aa1d61e1c5e'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:06.699057 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:46:06.705205 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-b8004976-8400-448f-879f-5aa1d61e1c5e admin admin] The token cache is being invalidate because project 913768c432af4149af8afcbb097c09cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:46:06.707518 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-b8004976-8400-448f-879f-5aa1d61e1c5e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:06.708248 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-b8004976-8400-448f-879f-5aa1d61e1c5e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:06.710268 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 872/1734] 10.222.0.26 () {58 vars in 1233 bytes} [Wed Aug 24 05:46:06 2022] DELETE /identity/v3/projects/913768c432af4149af8afcbb097c09cb => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:46:06.714473 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8004976-8400-448f-879f-5aa1d61e1c5e admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:06.724725 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-b8004976-8400-448f-879f-5aa1d61e1c5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:06.733563 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-e15b7fa3-de9d-42a1-8b99-e35dd13b3fe1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e6dd2f14ef284422a43da62b58dda569'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:06.752365 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-e15b7fa3-de9d-42a1-8b99-e35dd13b3fe1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e6dd2f14ef284422a43da62b58dda569'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:06.772850 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-e15b7fa3-de9d-42a1-8b99-e35dd13b3fe1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e6dd2f14ef284422a43da62b58dda569'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:06.784917 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-e15b7fa3-de9d-42a1-8b99-e35dd13b3fe1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e6dd2f14ef284422a43da62b58dda569'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:06.785860 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-e15b7fa3-de9d-42a1-8b99-e35dd13b3fe1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e6dd2f14ef284422a43da62b58dda569'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:06.794210 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 863/1735] 10.222.0.26 () {58 vars in 1224 bytes} [Wed Aug 24 05:46:06 2022] DELETE /identity/v3/users/e6dd2f14ef284422a43da62b58dda569 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:46:06.873730 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8004976-8400-448f-879f-5aa1d61e1c5e admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:06.957251 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20421487-d961-4d35-b34d-7e23cbf18b04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:06.957993 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20421487-d961-4d35-b34d-7e23cbf18b04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:06.958289 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20421487-d961-4d35-b34d-7e23cbf18b04 admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:06.958566 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20421487-d961-4d35-b34d-7e23cbf18b04 admin admin] PATH_INFO: `/v3/users/282f09dc75eb495a972802c0e18f319d` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:06.960375 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20421487-d961-4d35-b34d-7e23cbf18b04 admin admin] RBAC: Authorizing `identity:delete_user(user_id=282f09dc75eb495a972802c0e18f319d)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:06.962724 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20421487-d961-4d35-b34d-7e23cbf18b04 admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:07.068523 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-20421487-d961-4d35-b34d-7e23cbf18b04 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '282f09dc75eb495a972802c0e18f319d'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:07.098810 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-20421487-d961-4d35-b34d-7e23cbf18b04 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '282f09dc75eb495a972802c0e18f319d'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:07.099882 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-20421487-d961-4d35-b34d-7e23cbf18b04 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '282f09dc75eb495a972802c0e18f319d'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:07.130274 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-20421487-d961-4d35-b34d-7e23cbf18b04 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '282f09dc75eb495a972802c0e18f319d'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:07.173358 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-20421487-d961-4d35-b34d-7e23cbf18b04 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '282f09dc75eb495a972802c0e18f319d'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:07.197884 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 873/1736] 10.222.0.26 () {58 vars in 1224 bytes} [Wed Aug 24 05:46:06 2022] DELETE /identity/v3/users/282f09dc75eb495a972802c0e18f319d => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 05:46:07.410557 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc85296-addb-4e35-95fb-7c6ca8a8dc04 None None] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:07.411884 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc85296-addb-4e35-95fb-7c6ca8a8dc04 None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:07.412333 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc85296-addb-4e35-95fb-7c6ca8a8dc04 None None] PATH_INFO: `/` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:07.413919 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 864/1737] 10.222.0.26 () {54 vars in 921 bytes} [Wed Aug 24 05:46:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:46:07.448685 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa247cbf-3b88-4720-9129-34249146e269 None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:07.449280 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa247cbf-3b88-4720-9129-34249146e269 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:07.449633 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa247cbf-3b88-4720-9129-34249146e269 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:07.494034 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-fa247cbf-3b88-4720-9129-34249146e269 None None] MFA Rules not processed for user `995ebe690b7748c9842bc0696415fc52`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:46:07.499863 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-fa247cbf-3b88-4720-9129-34249146e269 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:07.554846 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:46:07.714279 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 874/1738] 10.222.0.26 () {58 vars in 1018 bytes} [Wed Aug 24 05:46:07 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:46:07.943926 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc85296-addb-4e35-95fb-7c6ca8a8dc04 None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:07.946342 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-0cc85296-addb-4e35-95fb-7c6ca8a8dc04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:07.982865 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa247cbf-3b88-4720-9129-34249146e269 None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:07.984890 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-fa247cbf-3b88-4720-9129-34249146e269 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:08.033062 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa247cbf-3b88-4720-9129-34249146e269 None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:08.047840 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be86d3a-22a6-4c66-9a12-33e1093e2580 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '995ebe690b7748c9842bc0696415fc52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:08.048501 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be86d3a-22a6-4c66-9a12-33e1093e2580 service placement] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:08.048828 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be86d3a-22a6-4c66-9a12-33e1093e2580 service placement] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:08.049850 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be86d3a-22a6-4c66-9a12-33e1093e2580 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:08.075573 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be86d3a-22a6-4c66-9a12-33e1093e2580 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:08.077787 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be86d3a-22a6-4c66-9a12-33e1093e2580 service placement] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:08.122186 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 875/1739] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 24 05:46:07 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:46:08.173726 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc85296-addb-4e35-95fb-7c6ca8a8dc04 None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:08.179267 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10902b45-92ab-411b-8042-0c7e1b74fdea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:08.179984 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10902b45-92ab-411b-8042-0c7e1b74fdea admin admin] REQUEST_METHOD: `DELETE` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:08.180269 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10902b45-92ab-411b-8042-0c7e1b74fdea admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:08.180559 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10902b45-92ab-411b-8042-0c7e1b74fdea admin admin] PATH_INFO: `/v3/users/3ab358239f22426589b1ea4a2269de15` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:08.181895 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10902b45-92ab-411b-8042-0c7e1b74fdea admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ab358239f22426589b1ea4a2269de15)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:08.184218 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10902b45-92ab-411b-8042-0c7e1b74fdea admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:08.269152 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-10902b45-92ab-411b-8042-0c7e1b74fdea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ab358239f22426589b1ea4a2269de15'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:08.282394 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-10902b45-92ab-411b-8042-0c7e1b74fdea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ab358239f22426589b1ea4a2269de15'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:08.290556 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=81,keystone:DELETE=18,keystone:INSERT=1 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:46:08.307029 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-10902b45-92ab-411b-8042-0c7e1b74fdea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ab358239f22426589b1ea4a2269de15'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:08.319155 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-10902b45-92ab-411b-8042-0c7e1b74fdea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ab358239f22426589b1ea4a2269de15'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:08.320242 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-10902b45-92ab-411b-8042-0c7e1b74fdea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ab358239f22426589b1ea4a2269de15'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:08.335534 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 865/1740] 10.222.0.26 () {58 vars in 1224 bytes} [Wed Aug 24 05:46:07 2022] DELETE /identity/v3/users/3ab358239f22426589b1ea4a2269de15 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:46:08.759624 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be86d3a-22a6-4c66-9a12-33e1093e2580 service placement] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:08.761209 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-2be86d3a-22a6-4c66-9a12-33e1093e2580 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:08.784461 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be86d3a-22a6-4c66-9a12-33e1093e2580 service placement] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:08.934690 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccbbe75-3450-4287-828c-1fb67899a876 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:08.935359 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccbbe75-3450-4287-828c-1fb67899a876 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:08.935730 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccbbe75-3450-4287-828c-1fb67899a876 admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:08.936032 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccbbe75-3450-4287-828c-1fb67899a876 admin admin] PATH_INFO: `/v3/projects/4e2ad929ef9d451ab0e692769bfbde49` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:08.943827 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccbbe75-3450-4287-828c-1fb67899a876 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e2ad929ef9d451ab0e692769bfbde49)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:08.949805 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccbbe75-3450-4287-828c-1fb67899a876 admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:09.106404 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-0ccbbe75-3450-4287-828c-1fb67899a876 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e2ad929ef9d451ab0e692769bfbde49', 'request_id': 'req-0ccbbe75-3450-4287-828c-1fb67899a876'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:09.119670 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-0ccbbe75-3450-4287-828c-1fb67899a876 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e2ad929ef9d451ab0e692769bfbde49', 'request_id': 'req-0ccbbe75-3450-4287-828c-1fb67899a876'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:09.139304 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-0ccbbe75-3450-4287-828c-1fb67899a876 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e2ad929ef9d451ab0e692769bfbde49', 'request_id': 'req-0ccbbe75-3450-4287-828c-1fb67899a876'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:09.161170 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10902b45-92ab-411b-8042-0c7e1b74fdea admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:09.163271 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-10902b45-92ab-411b-8042-0c7e1b74fdea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:09.169634 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-0ccbbe75-3450-4287-828c-1fb67899a876 admin admin] The token cache is being invalidate because project 4e2ad929ef9d451ab0e692769bfbde49 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:46:09.169926 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-0ccbbe75-3450-4287-828c-1fb67899a876 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:09.176433 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-0ccbbe75-3450-4287-828c-1fb67899a876 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:09.182661 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 876/1741] 10.222.0.26 () {58 vars in 1233 bytes} [Wed Aug 24 05:46:08 2022] DELETE /identity/v3/projects/4e2ad929ef9d451ab0e692769bfbde49 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:46:09.188576 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805e021c-2422-4892-8f64-a292bf4c12a8 None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:09.189108 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805e021c-2422-4892-8f64-a292bf4c12a8 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:09.189575 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805e021c-2422-4892-8f64-a292bf4c12a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:09.203259 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10902b45-92ab-411b-8042-0c7e1b74fdea admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:09.259946 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-805e021c-2422-4892-8f64-a292bf4c12a8 None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:46:09.261472 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-805e021c-2422-4892-8f64-a292bf4c12a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:09.362579 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:46:09.409592 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cea4a81-f97a-4ea7-9abc-fc6ba6d82f45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:09.411257 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cea4a81-f97a-4ea7-9abc-fc6ba6d82f45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:09.412207 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cea4a81-f97a-4ea7-9abc-fc6ba6d82f45 admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:09.412653 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cea4a81-f97a-4ea7-9abc-fc6ba6d82f45 admin admin] PATH_INFO: `/v3/projects/6190e2e887c149598d5e905d7ac4d658` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:09.414040 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cea4a81-f97a-4ea7-9abc-fc6ba6d82f45 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6190e2e887c149598d5e905d7ac4d658)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:09.421095 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cea4a81-f97a-4ea7-9abc-fc6ba6d82f45 admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:09.449129 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 877/1742] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:46:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 05:46:09.456949 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89b0fb0-03ea-4960-a4f6-37b9d5b2b3ea None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:09.461737 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89b0fb0-03ea-4960-a4f6-37b9d5b2b3ea None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:09.462267 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89b0fb0-03ea-4960-a4f6-37b9d5b2b3ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:09.521524 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-f89b0fb0-03ea-4960-a4f6-37b9d5b2b3ea None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:46:09.523120 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-f89b0fb0-03ea-4960-a4f6-37b9d5b2b3ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:09.543089 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 878/1743] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:46:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:46:09.544331 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89b0fb0-03ea-4960-a4f6-37b9d5b2b3ea None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:09.546908 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-f89b0fb0-03ea-4960-a4f6-37b9d5b2b3ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:09.591201 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-2cea4a81-f97a-4ea7-9abc-fc6ba6d82f45 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6190e2e887c149598d5e905d7ac4d658', 'request_id': 'req-2cea4a81-f97a-4ea7-9abc-fc6ba6d82f45'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:09.603207 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89b0fb0-03ea-4960-a4f6-37b9d5b2b3ea None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:09.619261 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-2cea4a81-f97a-4ea7-9abc-fc6ba6d82f45 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6190e2e887c149598d5e905d7ac4d658', 'request_id': 'req-2cea4a81-f97a-4ea7-9abc-fc6ba6d82f45'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:09.633981 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-2cea4a81-f97a-4ea7-9abc-fc6ba6d82f45 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6190e2e887c149598d5e905d7ac4d658', 'request_id': 'req-2cea4a81-f97a-4ea7-9abc-fc6ba6d82f45'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:09.678978 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-2cea4a81-f97a-4ea7-9abc-fc6ba6d82f45 admin admin] The token cache is being invalidate because project 6190e2e887c149598d5e905d7ac4d658 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88112) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:46:09.679332 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-2cea4a81-f97a-4ea7-9abc-fc6ba6d82f45 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:09.680272 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-2cea4a81-f97a-4ea7-9abc-fc6ba6d82f45 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:09.683031 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 866/1744] 10.222.0.26 () {58 vars in 1233 bytes} [Wed Aug 24 05:46:09 2022] DELETE /identity/v3/projects/6190e2e887c149598d5e905d7ac4d658 => generated 0 bytes in 522 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:46:09.683864 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cea4a81-f97a-4ea7-9abc-fc6ba6d82f45 admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:09.687181 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-2cea4a81-f97a-4ea7-9abc-fc6ba6d82f45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:09.831089 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1676ff0-8838-45d9-82e1-bcbe4b8cd5e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:09.832284 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1676ff0-8838-45d9-82e1-bcbe4b8cd5e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:09.832556 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1676ff0-8838-45d9-82e1-bcbe4b8cd5e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:09.832831 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1676ff0-8838-45d9-82e1-bcbe4b8cd5e2 admin admin] PATH_INFO: `/v3/projects/e6f502d8cf63494abf3218be014ed916` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:09.834567 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1676ff0-8838-45d9-82e1-bcbe4b8cd5e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e6f502d8cf63494abf3218be014ed916)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:09.836505 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1676ff0-8838-45d9-82e1-bcbe4b8cd5e2 admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:09.885972 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cea4a81-f97a-4ea7-9abc-fc6ba6d82f45 admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:09.898134 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf0eeed-0ed9-44c8-a9de-5dcc70d66c3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:09.900057 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf0eeed-0ed9-44c8-a9de-5dcc70d66c3f admin admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:09.900767 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf0eeed-0ed9-44c8-a9de-5dcc70d66c3f admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:09.901212 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf0eeed-0ed9-44c8-a9de-5dcc70d66c3f admin admin] PATH_INFO: `/v3/domains` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:09.902764 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf0eeed-0ed9-44c8-a9de-5dcc70d66c3f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:46:09.906315 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf0eeed-0ed9-44c8-a9de-5dcc70d66c3f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:09.911052 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf0eeed-0ed9-44c8-a9de-5dcc70d66c3f admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:09.941124 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-a1676ff0-8838-45d9-82e1-bcbe4b8cd5e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e6f502d8cf63494abf3218be014ed916', 'request_id': 'req-a1676ff0-8838-45d9-82e1-bcbe4b8cd5e2'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:09.947089 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 867/1745] 10.222.0.26 () {58 vars in 1153 bytes} [Wed Aug 24 05:46:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:46:09.948772 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd84ece-5514-4270-920c-250d4a2a16d6 None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:09.949196 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd84ece-5514-4270-920c-250d4a2a16d6 None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:09.949694 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd84ece-5514-4270-920c-250d4a2a16d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:09.960364 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-a1676ff0-8838-45d9-82e1-bcbe4b8cd5e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e6f502d8cf63494abf3218be014ed916', 'request_id': 'req-a1676ff0-8838-45d9-82e1-bcbe4b8cd5e2'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:09.962990 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:46:09.974860 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-a1676ff0-8838-45d9-82e1-bcbe4b8cd5e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e6f502d8cf63494abf3218be014ed916', 'request_id': 'req-a1676ff0-8838-45d9-82e1-bcbe4b8cd5e2'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:09.992469 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-9dd84ece-5514-4270-920c-250d4a2a16d6 None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:46:09.994138 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-9dd84ece-5514-4270-920c-250d4a2a16d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:10.008692 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-a1676ff0-8838-45d9-82e1-bcbe4b8cd5e2 admin admin] The token cache is being invalidate because project e6f502d8cf63494abf3218be014ed916 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:46:10.008974 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-a1676ff0-8838-45d9-82e1-bcbe4b8cd5e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:10.014340 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-a1676ff0-8838-45d9-82e1-bcbe4b8cd5e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:10.019662 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 879/1746] 10.222.0.26 () {58 vars in 1233 bytes} [Wed Aug 24 05:46:09 2022] DELETE /identity/v3/projects/e6f502d8cf63494abf3218be014ed916 => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:46:10.020562 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1676ff0-8838-45d9-82e1-bcbe4b8cd5e2 admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:10.026168 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-a1676ff0-8838-45d9-82e1-bcbe4b8cd5e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:10.151661 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 868/1747] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:46:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:46:10.152896 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd84ece-5514-4270-920c-250d4a2a16d6 None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:10.154522 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-9dd84ece-5514-4270-920c-250d4a2a16d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:10.165006 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1676ff0-8838-45d9-82e1-bcbe4b8cd5e2 admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:10.169656 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd84ece-5514-4270-920c-250d4a2a16d6 None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:10.176594 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4ad3e0-c3ee-4a67-ab95-199162056bd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:10.177407 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4ad3e0-c3ee-4a67-ab95-199162056bd7 admin admin] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:10.177834 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4ad3e0-c3ee-4a67-ab95-199162056bd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:10.178262 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4ad3e0-c3ee-4a67-ab95-199162056bd7 admin admin] PATH_INFO: `/v3/projects` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:10.179053 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4ad3e0-c3ee-4a67-ab95-199162056bd7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:10.181425 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4ad3e0-c3ee-4a67-ab95-199162056bd7 admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:10.186377 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a58e328-cfc7-4f9e-88f0-ca1f357cf650 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:10.187229 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a58e328-cfc7-4f9e-88f0-ca1f357cf650 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:10.188772 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a58e328-cfc7-4f9e-88f0-ca1f357cf650 admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:10.189206 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a58e328-cfc7-4f9e-88f0-ca1f357cf650 admin admin] PATH_INFO: `/v3/users/03ec8115674d43f1bc6c6b58461ed17e` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:10.191744 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a58e328-cfc7-4f9e-88f0-ca1f357cf650 admin admin] RBAC: Authorizing `identity:delete_user(user_id=03ec8115674d43f1bc6c6b58461ed17e)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:10.198176 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a58e328-cfc7-4f9e-88f0-ca1f357cf650 admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:10.198349 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:46:10.264274 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 880/1748] 10.222.0.26 () {60 vars in 1153 bytes} [Wed Aug 24 05:46:10 2022] POST /identity/v3/projects => generated 387 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:46:10.266396 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549821d1-c9e4-4a87-a7b8-263e4ac7bdb7 None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:10.266704 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549821d1-c9e4-4a87-a7b8-263e4ac7bdb7 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:10.266998 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549821d1-c9e4-4a87-a7b8-263e4ac7bdb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:10.309489 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-5a58e328-cfc7-4f9e-88f0-ca1f357cf650 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '03ec8115674d43f1bc6c6b58461ed17e'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:10.322312 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-549821d1-c9e4-4a87-a7b8-263e4ac7bdb7 None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:46:10.325964 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-549821d1-c9e4-4a87-a7b8-263e4ac7bdb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:10.344292 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-5a58e328-cfc7-4f9e-88f0-ca1f357cf650 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '03ec8115674d43f1bc6c6b58461ed17e'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:10.367762 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-5a58e328-cfc7-4f9e-88f0-ca1f357cf650 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '03ec8115674d43f1bc6c6b58461ed17e'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:10.383606 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-5a58e328-cfc7-4f9e-88f0-ca1f357cf650 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '03ec8115674d43f1bc6c6b58461ed17e'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:10.384299 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-5a58e328-cfc7-4f9e-88f0-ca1f357cf650 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '03ec8115674d43f1bc6c6b58461ed17e'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:10.397281 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 869/1749] 10.222.0.26 () {58 vars in 1224 bytes} [Wed Aug 24 05:46:10 2022] DELETE /identity/v3/users/03ec8115674d43f1bc6c6b58461ed17e => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:46:10.398309 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a58e328-cfc7-4f9e-88f0-ca1f357cf650 admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:10.400656 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-5a58e328-cfc7-4f9e-88f0-ca1f357cf650 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:10.497619 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 881/1750] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:46:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:46:10.510401 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b351514-cadd-4914-9704-09703a74cbb0 None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:10.510770 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b351514-cadd-4914-9704-09703a74cbb0 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:10.511105 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b351514-cadd-4914-9704-09703a74cbb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:10.541528 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-3b351514-cadd-4914-9704-09703a74cbb0 None None] MFA Rules not processed for user `7ea384c1544c424eb2b524760e1d6d22`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:46:10.545795 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-3b351514-cadd-4914-9704-09703a74cbb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:10.651864 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a58e328-cfc7-4f9e-88f0-ca1f357cf650 admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:10.666154 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4adf48-8fe1-4487-9933-292c2dae2e10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:10.667194 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4adf48-8fe1-4487-9933-292c2dae2e10 admin admin] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:10.667194 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4adf48-8fe1-4487-9933-292c2dae2e10 admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:10.669529 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4adf48-8fe1-4487-9933-292c2dae2e10 admin admin] PATH_INFO: `/v3/users` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:10.672900 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4adf48-8fe1-4487-9933-292c2dae2e10 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:10.677352 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4adf48-8fe1-4487-9933-292c2dae2e10 admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:10.751968 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 882/1751] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:46:10 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:46:10.753121 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b351514-cadd-4914-9704-09703a74cbb0 None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:10.772255 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b351514-cadd-4914-9704-09703a74cbb0 None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:10.783192 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8e4933-eb6d-4bce-a126-bb097157b11c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:10.785726 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8e4933-eb6d-4bce-a126-bb097157b11c admin admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:10.786257 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8e4933-eb6d-4bce-a126-bb097157b11c admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:10.786638 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8e4933-eb6d-4bce-a126-bb097157b11c admin admin] PATH_INFO: `/v3/domains` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:10.788907 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8e4933-eb6d-4bce-a126-bb097157b11c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:46:10.789361 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8e4933-eb6d-4bce-a126-bb097157b11c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:10.793857 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8e4933-eb6d-4bce-a126-bb097157b11c admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:10.814383 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 870/1752] 10.222.0.26 () {60 vars in 1144 bytes} [Wed Aug 24 05:46:10 2022] POST /identity/v3/users => generated 294 bytes in 416 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:46:10.815411 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4adf48-8fe1-4487-9933-292c2dae2e10 admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:10.829565 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 883/1753] 10.222.0.26 () {58 vars in 1153 bytes} [Wed Aug 24 05:46:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:46:10.830434 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8e4933-eb6d-4bce-a126-bb097157b11c admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:10.833690 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-cd4adf48-8fe1-4487-9933-292c2dae2e10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:10.858247 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8e4933-eb6d-4bce-a126-bb097157b11c admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:10.871813 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f48114-4cbb-4a37-bbb1-7037c5d4655f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:10.872568 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f48114-4cbb-4a37-bbb1-7037c5d4655f admin admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:10.873011 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f48114-4cbb-4a37-bbb1-7037c5d4655f admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:10.873562 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f48114-4cbb-4a37-bbb1-7037c5d4655f admin admin] PATH_INFO: `/v3/roles` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:10.874788 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f48114-4cbb-4a37-bbb1-7037c5d4655f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:10.877008 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f48114-4cbb-4a37-bbb1-7037c5d4655f admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:10.880696 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4adf48-8fe1-4487-9933-292c2dae2e10 admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:10.906107 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45bafb7-8de2-4e79-8c13-d36b59f0c3a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:10.906774 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45bafb7-8de2-4e79-8c13-d36b59f0c3a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:10.907049 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45bafb7-8de2-4e79-8c13-d36b59f0c3a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:10.907326 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45bafb7-8de2-4e79-8c13-d36b59f0c3a8 admin admin] PATH_INFO: `/v3/users/83509ee7cfbb458c9fc6ed8f6faa0784` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:10.909214 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 884/1754] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Aug 24 05:46:10 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:46:10.910462 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45bafb7-8de2-4e79-8c13-d36b59f0c3a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=83509ee7cfbb458c9fc6ed8f6faa0784)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:10.912685 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45bafb7-8de2-4e79-8c13-d36b59f0c3a8 admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:10.914731 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:46:10.915968 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f48114-4cbb-4a37-bbb1-7037c5d4655f admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:10.949655 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f48114-4cbb-4a37-bbb1-7037c5d4655f admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:10.963508 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c52ed75-6978-4b0c-aacf-cd9a26254ce5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:10.968058 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c52ed75-6978-4b0c-aacf-cd9a26254ce5 admin admin] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:10.968573 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c52ed75-6978-4b0c-aacf-cd9a26254ce5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:10.969068 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c52ed75-6978-4b0c-aacf-cd9a26254ce5 admin admin] PATH_INFO: `/v3/projects` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:10.970696 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c52ed75-6978-4b0c-aacf-cd9a26254ce5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:10.978541 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c52ed75-6978-4b0c-aacf-cd9a26254ce5 admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:11.082933 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-c45bafb7-8de2-4e79-8c13-d36b59f0c3a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '83509ee7cfbb458c9fc6ed8f6faa0784'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:11.088288 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 885/1755] 10.222.0.26 () {60 vars in 1153 bytes} [Wed Aug 24 05:46:10 2022] POST /identity/v3/projects => generated 369 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:46:11.096076 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-c45bafb7-8de2-4e79-8c13-d36b59f0c3a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '83509ee7cfbb458c9fc6ed8f6faa0784'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:11.096198 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c52ed75-6978-4b0c-aacf-cd9a26254ce5 admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:11.116358 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-c45bafb7-8de2-4e79-8c13-d36b59f0c3a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '83509ee7cfbb458c9fc6ed8f6faa0784'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:11.125365 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-c45bafb7-8de2-4e79-8c13-d36b59f0c3a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '83509ee7cfbb458c9fc6ed8f6faa0784'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:11.126110 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-c45bafb7-8de2-4e79-8c13-d36b59f0c3a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '83509ee7cfbb458c9fc6ed8f6faa0784'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:11.143715 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 871/1756] 10.222.0.26 () {58 vars in 1224 bytes} [Wed Aug 24 05:46:10 2022] DELETE /identity/v3/users/83509ee7cfbb458c9fc6ed8f6faa0784 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:46:11.144658 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45bafb7-8de2-4e79-8c13-d36b59f0c3a8 admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:11.150491 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-c45bafb7-8de2-4e79-8c13-d36b59f0c3a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:11.247686 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:46:11.289019 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c52ed75-6978-4b0c-aacf-cd9a26254ce5 admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:11.302141 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45bafb7-8de2-4e79-8c13-d36b59f0c3a8 admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:11.303985 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c605a56d-8521-4f04-af97-99102a443eb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:11.304706 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c605a56d-8521-4f04-af97-99102a443eb1 admin admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:11.305816 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c605a56d-8521-4f04-af97-99102a443eb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:11.306616 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c605a56d-8521-4f04-af97-99102a443eb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:11.307851 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c605a56d-8521-4f04-af97-99102a443eb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:11.310235 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c605a56d-8521-4f04-af97-99102a443eb1 admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:11.314708 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b93959f-4348-43a9-819c-ff5176276bcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:11.315336 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b93959f-4348-43a9-819c-ff5176276bcd admin admin] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:11.315616 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b93959f-4348-43a9-819c-ff5176276bcd admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:11.315973 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b93959f-4348-43a9-819c-ff5176276bcd admin admin] PATH_INFO: `/v3/users` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:11.316801 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b93959f-4348-43a9-819c-ff5176276bcd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:11.321379 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b93959f-4348-43a9-819c-ff5176276bcd admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:11.339779 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 886/1757] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Aug 24 05:46:11 2022] GET /identity/v3/roles => generated 1420 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:46:11.340802 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c605a56d-8521-4f04-af97-99102a443eb1 admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:11.344982 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-c605a56d-8521-4f04-af97-99102a443eb1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:11.370372 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 872/1758] 10.222.0.26 () {60 vars in 1144 bytes} [Wed Aug 24 05:46:11 2022] POST /identity/v3/users => generated 285 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:46:11.371667 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8129d3-e5b9-4258-b563-cf2079c43fd9 None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:11.372205 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8129d3-e5b9-4258-b563-cf2079c43fd9 None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:11.372478 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8129d3-e5b9-4258-b563-cf2079c43fd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:11.377381 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c605a56d-8521-4f04-af97-99102a443eb1 admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:11.391936 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba5304a-e45b-40e8-85a8-764fc04685d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:11.392594 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba5304a-e45b-40e8-85a8-764fc04685d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:11.392912 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba5304a-e45b-40e8-85a8-764fc04685d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:11.393762 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba5304a-e45b-40e8-85a8-764fc04685d9 admin admin] PATH_INFO: `/v3/projects/f46ee80adf294402b7ead7d1a50ce7d8` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:11.395840 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba5304a-e45b-40e8-85a8-764fc04685d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f46ee80adf294402b7ead7d1a50ce7d8)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:11.401736 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba5304a-e45b-40e8-85a8-764fc04685d9 admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:11.418319 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-2b8129d3-e5b9-4258-b563-cf2079c43fd9 None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:46:11.419589 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-2b8129d3-e5b9-4258-b563-cf2079c43fd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:11.439529 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 873/1759] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:46:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:46:11.440905 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27778daa-fd82-4de9-b9ed-21512622c4ab None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:11.441192 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27778daa-fd82-4de9-b9ed-21512622c4ab None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:11.441462 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27778daa-fd82-4de9-b9ed-21512622c4ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:11.510864 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-27778daa-fd82-4de9-b9ed-21512622c4ab None None] MFA Rules not processed for user `73d475856548486db6fa9277475c80fe`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:46:11.513095 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-27778daa-fd82-4de9-b9ed-21512622c4ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:11.514869 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-cba5304a-e45b-40e8-85a8-764fc04685d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f46ee80adf294402b7ead7d1a50ce7d8', 'request_id': 'req-cba5304a-e45b-40e8-85a8-764fc04685d9'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:11.528352 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-cba5304a-e45b-40e8-85a8-764fc04685d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f46ee80adf294402b7ead7d1a50ce7d8', 'request_id': 'req-cba5304a-e45b-40e8-85a8-764fc04685d9'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:11.547324 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-cba5304a-e45b-40e8-85a8-764fc04685d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f46ee80adf294402b7ead7d1a50ce7d8', 'request_id': 'req-cba5304a-e45b-40e8-85a8-764fc04685d9'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:11.577290 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-cba5304a-e45b-40e8-85a8-764fc04685d9 admin admin] The token cache is being invalidate because project f46ee80adf294402b7ead7d1a50ce7d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:46:11.577681 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-cba5304a-e45b-40e8-85a8-764fc04685d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:11.579789 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-cba5304a-e45b-40e8-85a8-764fc04685d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:11.585439 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 887/1760] 10.222.0.26 () {58 vars in 1233 bytes} [Wed Aug 24 05:46:11 2022] DELETE /identity/v3/projects/f46ee80adf294402b7ead7d1a50ce7d8 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:46:11.586439 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba5304a-e45b-40e8-85a8-764fc04685d9 admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:11.590128 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-cba5304a-e45b-40e8-85a8-764fc04685d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:11.633331 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:46:11.670942 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 874/1761] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:46:11 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:46:11.685228 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27778daa-fd82-4de9-b9ed-21512622c4ab None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:11.695480 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-27778daa-fd82-4de9-b9ed-21512622c4ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:11.769009 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba5304a-e45b-40e8-85a8-764fc04685d9 admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:11.780087 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f7e178-b126-42c4-9d80-23ca6b55f879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:11.782249 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f7e178-b126-42c4-9d80-23ca6b55f879 admin admin] REQUEST_METHOD: `PUT` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:11.782546 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f7e178-b126-42c4-9d80-23ca6b55f879 admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:11.785572 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f7e178-b126-42c4-9d80-23ca6b55f879 admin admin] PATH_INFO: `/v3/projects/1fb82c0d8ea941d9855b531da1d4dd2e/users/6c161bbe6484493da21afe800e8c3155/roles/f7aa4a2c74c94c1b9ca8ecdcccccda5c` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:11.825185 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f7e178-b126-42c4-9d80-23ca6b55f879 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1fb82c0d8ea941d9855b531da1d4dd2e, user_id=6c161bbe6484493da21afe800e8c3155, role_id=f7aa4a2c74c94c1b9ca8ecdcccccda5c)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:11.828947 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f7e178-b126-42c4-9d80-23ca6b55f879 admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:11.858137 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 888/1762] 10.222.0.26 () {60 vars in 1483 bytes} [Wed Aug 24 05:46:11 2022] PUT /identity/v3/projects/1fb82c0d8ea941d9855b531da1d4dd2e/users/6c161bbe6484493da21afe800e8c3155/roles/f7aa4a2c74c94c1b9ca8ecdcccccda5c => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:46:11.860769 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f7e178-b126-42c4-9d80-23ca6b55f879 admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:11.862484 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-64f7e178-b126-42c4-9d80-23ca6b55f879 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:11.868328 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27778daa-fd82-4de9-b9ed-21512622c4ab None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:11.995509 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:46:12.005390 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f7e178-b126-42c4-9d80-23ca6b55f879 admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:12.008620 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29a8c1e-7a4e-48ec-86c2-b61caeefec79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:12.009351 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29a8c1e-7a4e-48ec-86c2-b61caeefec79 admin admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:12.009620 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29a8c1e-7a4e-48ec-86c2-b61caeefec79 admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:12.010005 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29a8c1e-7a4e-48ec-86c2-b61caeefec79 admin admin] PATH_INFO: `/v3/roles` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:12.010775 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29a8c1e-7a4e-48ec-86c2-b61caeefec79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:12.013275 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29a8c1e-7a4e-48ec-86c2-b61caeefec79 admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:12.026152 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5db3857-b842-4d60-b6a5-b702eb60b9ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '874348b647194ac2b5ecbf12c33bf59e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:12.026932 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5db3857-b842-4d60-b6a5-b702eb60b9ed service neutron] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:12.027233 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5db3857-b842-4d60-b6a5-b702eb60b9ed service neutron] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:12.027491 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5db3857-b842-4d60-b6a5-b702eb60b9ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:12.031884 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-c5db3857-b842-4d60-b6a5-b702eb60b9ed service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:12.054047 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 875/1763] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Aug 24 05:46:11 2022] GET /identity/v3/roles => generated 1420 bytes in 373 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:46:12.055725 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb0746c-4c40-4aaf-ad7e-e87f52cb3cdb None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:12.055837 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5db3857-b842-4d60-b6a5-b702eb60b9ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:12.057640 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5db3857-b842-4d60-b6a5-b702eb60b9ed service neutron] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:12.057867 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb0746c-4c40-4aaf-ad7e-e87f52cb3cdb None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:12.058186 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb0746c-4c40-4aaf-ad7e-e87f52cb3cdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:12.070715 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 889/1764] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 24 05:46:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:46:12.072503 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321ca01f-b26b-4959-929c-dea8712610d9 None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:12.072798 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321ca01f-b26b-4959-929c-dea8712610d9 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:12.073073 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321ca01f-b26b-4959-929c-dea8712610d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:12.092964 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-4fb0746c-4c40-4aaf-ad7e-e87f52cb3cdb None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:46:12.094413 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-4fb0746c-4c40-4aaf-ad7e-e87f52cb3cdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:12.111108 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 876/1765] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:46:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:46:12.112634 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e4cd78-0cb3-4df8-9250-2cfb1cc26ade None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:12.112981 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e4cd78-0cb3-4df8-9250-2cfb1cc26ade None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:12.113259 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e4cd78-0cb3-4df8-9250-2cfb1cc26ade None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:12.126613 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-321ca01f-b26b-4959-929c-dea8712610d9 None None] MFA Rules not processed for user `73d475856548486db6fa9277475c80fe`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:46:12.127866 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-321ca01f-b26b-4959-929c-dea8712610d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:12.170657 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-19e4cd78-0cb3-4df8-9250-2cfb1cc26ade None None] MFA Rules not processed for user `6c161bbe6484493da21afe800e8c3155`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:46:12.171958 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-19e4cd78-0cb3-4df8-9250-2cfb1cc26ade None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:12.278434 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 877/1766] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:46:12 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:46:12.280783 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 890/1767] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:46:12 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:46:12.282815 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92021f7-4363-416a-9a1d-de52ffcd7dc5 None None] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:12.282815 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92021f7-4363-416a-9a1d-de52ffcd7dc5 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:12.283083 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92021f7-4363-416a-9a1d-de52ffcd7dc5 None None] PATH_INFO: `/` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:12.284406 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 891/1768] 10.222.0.26 () {54 vars in 912 bytes} [Wed Aug 24 05:46:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:46:12.290308 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e4cd78-0cb3-4df8-9250-2cfb1cc26ade None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:12.294678 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22983a16-bb78-4cea-8c66-5d9080118c8f None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:12.295438 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22983a16-bb78-4cea-8c66-5d9080118c8f None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:12.296066 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22983a16-bb78-4cea-8c66-5d9080118c8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:12.313110 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e4cd78-0cb3-4df8-9250-2cfb1cc26ade None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:12.325883 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22a406e-66ae-449b-b999-9b930e5512b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:12.326823 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22a406e-66ae-449b-b999-9b930e5512b7 admin admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:12.327101 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22a406e-66ae-449b-b999-9b930e5512b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:12.327376 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22a406e-66ae-449b-b999-9b930e5512b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:12.328194 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22a406e-66ae-449b-b999-9b930e5512b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:12.329630 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22a406e-66ae-449b-b999-9b930e5512b7 admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:12.353684 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 878/1769] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Aug 24 05:46:12 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:46:12.356927 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22a406e-66ae-449b-b999-9b930e5512b7 admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:12.358907 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-22983a16-bb78-4cea-8c66-5d9080118c8f None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:46:12.360238 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-22983a16-bb78-4cea-8c66-5d9080118c8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:12.371020 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 892/1770] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:46:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:46:12.372794 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37af11c-cbbd-466e-a5e0-08d7ee86fd9b None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:12.373217 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37af11c-cbbd-466e-a5e0-08d7ee86fd9b None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:12.373579 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37af11c-cbbd-466e-a5e0-08d7ee86fd9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:12.394575 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22a406e-66ae-449b-b999-9b930e5512b7 admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:12.410198 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dec5ec-488c-46ed-ba2a-62da665bae07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:12.411038 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dec5ec-488c-46ed-ba2a-62da665bae07 admin admin] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:12.411348 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dec5ec-488c-46ed-ba2a-62da665bae07 admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:12.416251 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dec5ec-488c-46ed-ba2a-62da665bae07 admin admin] PATH_INFO: `/v3/projects` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:12.416251 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70dec5ec-488c-46ed-ba2a-62da665bae07 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:12.416251 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70dec5ec-488c-46ed-ba2a-62da665bae07 admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:12.436867 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:46:12.444031 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-f37af11c-cbbd-466e-a5e0-08d7ee86fd9b None None] MFA Rules not processed for user `874348b647194ac2b5ecbf12c33bf59e`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:46:12.445508 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-f37af11c-cbbd-466e-a5e0-08d7ee86fd9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:12.458163 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 893/1771] 10.222.0.26 () {58 vars in 1009 bytes} [Wed Aug 24 05:46:12 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:46:12.459225 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37af11c-cbbd-466e-a5e0-08d7ee86fd9b None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:12.461681 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-f37af11c-cbbd-466e-a5e0-08d7ee86fd9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:12.510030 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 879/1772] 10.222.0.26 () {60 vars in 1153 bytes} [Wed Aug 24 05:46:12 2022] POST /identity/v3/projects => generated 385 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:46:12.510030 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dec5ec-488c-46ed-ba2a-62da665bae07 admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:12.614991 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37af11c-cbbd-466e-a5e0-08d7ee86fd9b None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:12.674406 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dec5ec-488c-46ed-ba2a-62da665bae07 admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:12.687261 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb5d83f-7c55-43f6-aac5-8c16aef1b0db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:12.687956 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb5d83f-7c55-43f6-aac5-8c16aef1b0db admin admin] REQUEST_METHOD: `PUT` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:12.688291 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb5d83f-7c55-43f6-aac5-8c16aef1b0db admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:12.688617 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb5d83f-7c55-43f6-aac5-8c16aef1b0db admin admin] PATH_INFO: `/v3/projects/32ba5582d05a41949c1c910ebdf9b5e5/users/07b6e94ae3094727a226c8887cfc041e/roles/f7aa4a2c74c94c1b9ca8ecdcccccda5c` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:12.724398 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb5d83f-7c55-43f6-aac5-8c16aef1b0db admin admin] RBAC: Authorizing `identity:create_grant(project_id=32ba5582d05a41949c1c910ebdf9b5e5, user_id=07b6e94ae3094727a226c8887cfc041e, role_id=f7aa4a2c74c94c1b9ca8ecdcccccda5c)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:12.727106 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb5d83f-7c55-43f6-aac5-8c16aef1b0db admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:12.741818 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b853ca6a-53e0-44fe-9ea5-560203989b08 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b633e1aec6c4269bce13aa9c89e911a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:12.742466 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b853ca6a-53e0-44fe-9ea5-560203989b08 service nova] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:12.742748 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b853ca6a-53e0-44fe-9ea5-560203989b08 service nova] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:12.745253 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b853ca6a-53e0-44fe-9ea5-560203989b08 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:12.760599 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:46:12.769679 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 880/1773] 10.222.0.26 () {60 vars in 1483 bytes} [Wed Aug 24 05:46:12 2022] PUT /identity/v3/projects/32ba5582d05a41949c1c910ebdf9b5e5/users/07b6e94ae3094727a226c8887cfc041e/roles/f7aa4a2c74c94c1b9ca8ecdcccccda5c => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:46:12.770861 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb5d83f-7c55-43f6-aac5-8c16aef1b0db admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:12.859146 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b853ca6a-53e0-44fe-9ea5-560203989b08 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:12.863518 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b853ca6a-53e0-44fe-9ea5-560203989b08 service nova] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:12.885408 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 894/1774] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 24 05:46:12 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:46:12.887628 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b853ca6a-53e0-44fe-9ea5-560203989b08 service nova] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:12.904382 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b853ca6a-53e0-44fe-9ea5-560203989b08 service nova] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:12.931228 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb5d83f-7c55-43f6-aac5-8c16aef1b0db admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:12.942674 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75ee6a7-cd2f-4192-aeb3-8819f607c6dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:12.943312 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75ee6a7-cd2f-4192-aeb3-8819f607c6dc admin admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:12.943596 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75ee6a7-cd2f-4192-aeb3-8819f607c6dc admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:12.943884 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75ee6a7-cd2f-4192-aeb3-8819f607c6dc admin admin] PATH_INFO: `/v3/domains` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:12.944530 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75ee6a7-cd2f-4192-aeb3-8819f607c6dc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:46:12.944833 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75ee6a7-cd2f-4192-aeb3-8819f607c6dc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:12.946467 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75ee6a7-cd2f-4192-aeb3-8819f607c6dc admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:12.969173 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 881/1775] 10.222.0.26 () {58 vars in 1153 bytes} [Wed Aug 24 05:46:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:46:12.970078 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75ee6a7-cd2f-4192-aeb3-8819f607c6dc admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:13.038431 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de0de4b-f281-4323-9065-6430775e8236 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:13.040212 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de0de4b-f281-4323-9065-6430775e8236 admin admin] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:13.040769 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de0de4b-f281-4323-9065-6430775e8236 admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:13.041234 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de0de4b-f281-4323-9065-6430775e8236 admin admin] PATH_INFO: `/v3/users` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:13.042136 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de0de4b-f281-4323-9065-6430775e8236 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:13.046057 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de0de4b-f281-4323-9065-6430775e8236 admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:13.049265 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75ee6a7-cd2f-4192-aeb3-8819f607c6dc admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:13.053120 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b24c053-2d21-423f-a39b-e2ee179eeec9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '874348b647194ac2b5ecbf12c33bf59e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:13.053731 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b24c053-2d21-423f-a39b-e2ee179eeec9 service neutron] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:13.054040 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b24c053-2d21-423f-a39b-e2ee179eeec9 service neutron] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:13.054318 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b24c053-2d21-423f-a39b-e2ee179eeec9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:13.064670 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b24c053-2d21-423f-a39b-e2ee179eeec9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:13.066265 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b24c053-2d21-423f-a39b-e2ee179eeec9 service neutron] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:13.092543 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 895/1776] 10.222.0.26 () {60 vars in 1144 bytes} [Wed Aug 24 05:46:12 2022] POST /identity/v3/users => generated 299 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:46:13.094105 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1007725-92b5-423b-92a2-5155e75a5d66 None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:13.094484 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1007725-92b5-423b-92a2-5155e75a5d66 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:13.094876 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1007725-92b5-423b-92a2-5155e75a5d66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:13.098415 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 882/1777] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 24 05:46:12 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:46:13.101900 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b96d80-e319-4c3b-a3ff-a9f12cb9bf40 None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:13.102371 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b96d80-e319-4c3b-a3ff-a9f12cb9bf40 None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:13.105360 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b96d80-e319-4c3b-a3ff-a9f12cb9bf40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:13.125217 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:46:13.158681 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-f1007725-92b5-423b-92a2-5155e75a5d66 None None] MFA Rules not processed for user `568d477011b84cc89b9285b5172d091f`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:46:13.159946 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-f1007725-92b5-423b-92a2-5155e75a5d66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:13.168506 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-83b96d80-e319-4c3b-a3ff-a9f12cb9bf40 None None] MFA Rules not processed for user `07b6e94ae3094727a226c8887cfc041e`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:46:13.174379 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-83b96d80-e319-4c3b-a3ff-a9f12cb9bf40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:13.310019 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 896/1778] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:46:13 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:46:13.311589 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1007725-92b5-423b-92a2-5155e75a5d66 None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:13.313705 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-f1007725-92b5-423b-92a2-5155e75a5d66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:13.334670 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 883/1779] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:46:13 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:46:13.335675 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b96d80-e319-4c3b-a3ff-a9f12cb9bf40 None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:13.345328 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1007725-92b5-423b-92a2-5155e75a5d66 None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:13.357604 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e719522-5eef-4264-90cf-9ee9952a97ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:13.358294 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e719522-5eef-4264-90cf-9ee9952a97ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:13.358579 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e719522-5eef-4264-90cf-9ee9952a97ca admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:13.358855 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e719522-5eef-4264-90cf-9ee9952a97ca admin admin] PATH_INFO: `/v3/projects/e86176aee1dc46d896986c161b93aa86` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:13.360632 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b96d80-e319-4c3b-a3ff-a9f12cb9bf40 None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:13.362599 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e719522-5eef-4264-90cf-9ee9952a97ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=e86176aee1dc46d896986c161b93aa86)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:13.364568 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e719522-5eef-4264-90cf-9ee9952a97ca admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:13.372515 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9a4cce-19f8-4577-b0d6-a1f40d4db578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:13.373464 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9a4cce-19f8-4577-b0d6-a1f40d4db578 admin admin] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:13.375021 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9a4cce-19f8-4577-b0d6-a1f40d4db578 admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:13.375318 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9a4cce-19f8-4577-b0d6-a1f40d4db578 admin admin] PATH_INFO: `/v3/projects` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:13.375964 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9a4cce-19f8-4577-b0d6-a1f40d4db578 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:13.382612 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9a4cce-19f8-4577-b0d6-a1f40d4db578 admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:13.414922 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:46:13.445716 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 884/1780] 10.222.0.26 () {60 vars in 1153 bytes} [Wed Aug 24 05:46:13 2022] POST /identity/v3/projects => generated 373 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:46:13.446952 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9a4cce-19f8-4577-b0d6-a1f40d4db578 admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:13.479303 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-6e719522-5eef-4264-90cf-9ee9952a97ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e86176aee1dc46d896986c161b93aa86', 'request_id': 'req-6e719522-5eef-4264-90cf-9ee9952a97ca'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:13.494182 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-6e719522-5eef-4264-90cf-9ee9952a97ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e86176aee1dc46d896986c161b93aa86', 'request_id': 'req-6e719522-5eef-4264-90cf-9ee9952a97ca'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:13.503480 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-6e719522-5eef-4264-90cf-9ee9952a97ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e86176aee1dc46d896986c161b93aa86', 'request_id': 'req-6e719522-5eef-4264-90cf-9ee9952a97ca'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:13.531176 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-6e719522-5eef-4264-90cf-9ee9952a97ca admin admin] The token cache is being invalidate because project e86176aee1dc46d896986c161b93aa86 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:46:13.531509 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-6e719522-5eef-4264-90cf-9ee9952a97ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:13.532568 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-6e719522-5eef-4264-90cf-9ee9952a97ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:13.534456 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 897/1781] 10.222.0.26 () {58 vars in 1233 bytes} [Wed Aug 24 05:46:13 2022] DELETE /identity/v3/projects/e86176aee1dc46d896986c161b93aa86 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:46:13.535314 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e719522-5eef-4264-90cf-9ee9952a97ca admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:13.542999 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-6e719522-5eef-4264-90cf-9ee9952a97ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:13.585213 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9a4cce-19f8-4577-b0d6-a1f40d4db578 admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:13.681390 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e719522-5eef-4264-90cf-9ee9952a97ca admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:13.697538 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd654a9-2032-4529-ab31-c3ff7050628a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:13.698281 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd654a9-2032-4529-ab31-c3ff7050628a admin admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:13.698565 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd654a9-2032-4529-ab31-c3ff7050628a admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:13.698741 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bf495b-5334-4a84-a392-8ea726a451d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:13.698860 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd654a9-2032-4529-ab31-c3ff7050628a admin admin] PATH_INFO: `/v3/roles` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:13.699364 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bf495b-5334-4a84-a392-8ea726a451d7 admin admin] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:13.699483 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd654a9-2032-4529-ab31-c3ff7050628a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:13.699645 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bf495b-5334-4a84-a392-8ea726a451d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:13.699923 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bf495b-5334-4a84-a392-8ea726a451d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:13.700568 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bf495b-5334-4a84-a392-8ea726a451d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:13.703141 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bf495b-5334-4a84-a392-8ea726a451d7 admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:13.718737 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd654a9-2032-4529-ab31-c3ff7050628a admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:13.737533 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 885/1782] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Aug 24 05:46:13 2022] GET /identity/v3/roles => generated 1420 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:46:13.739345 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd654a9-2032-4529-ab31-c3ff7050628a admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:13.741242 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-dfd654a9-2032-4529-ab31-c3ff7050628a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:13.759284 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 898/1783] 10.222.0.26 () {60 vars in 1153 bytes} [Wed Aug 24 05:46:13 2022] POST /identity/v3/projects => generated 369 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:46:13.759488 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd654a9-2032-4529-ab31-c3ff7050628a admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:13.760159 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd509516-16c4-4b43-8b5e-d1fe7929caf5 None None] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:13.760455 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd509516-16c4-4b43-8b5e-d1fe7929caf5 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:13.760734 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd509516-16c4-4b43-8b5e-d1fe7929caf5 None None] PATH_INFO: `/` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:13.763107 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 899/1784] 10.222.0.26 () {54 vars in 912 bytes} [Wed Aug 24 05:46:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:46:13.766941 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd509516-16c4-4b43-8b5e-d1fe7929caf5 None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:13.770766 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-dd509516-16c4-4b43-8b5e-d1fe7929caf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:13.794174 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:46:13.914132 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ea9a46-b540-4b5a-9ab1-99b92f18adf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:13.914132 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ea9a46-b540-4b5a-9ab1-99b92f18adf1 admin admin] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:13.914132 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ea9a46-b540-4b5a-9ab1-99b92f18adf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:13.914132 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ea9a46-b540-4b5a-9ab1-99b92f18adf1 admin admin] PATH_INFO: `/v3/users` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:13.914547 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ea9a46-b540-4b5a-9ab1-99b92f18adf1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:13.916455 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ea9a46-b540-4b5a-9ab1-99b92f18adf1 admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:13.954534 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd509516-16c4-4b43-8b5e-d1fe7929caf5 None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:13.971765 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 886/1785] 10.222.0.26 () {60 vars in 1144 bytes} [Wed Aug 24 05:46:13 2022] POST /identity/v3/users => generated 287 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:46:13.972682 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ea9a46-b540-4b5a-9ab1-99b92f18adf1 admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:13.974925 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3be5c5-a53e-41d4-b85f-f8a5fffe8243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:13.975661 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3be5c5-a53e-41d4-b85f-f8a5fffe8243 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:13.975948 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3be5c5-a53e-41d4-b85f-f8a5fffe8243 admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:13.976233 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3be5c5-a53e-41d4-b85f-f8a5fffe8243 admin admin] PATH_INFO: `/v3/users/0ab6179e57c94794884b5fe3b40d66d4` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:13.978889 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3be5c5-a53e-41d4-b85f-f8a5fffe8243 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ab6179e57c94794884b5fe3b40d66d4)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:13.980844 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3be5c5-a53e-41d4-b85f-f8a5fffe8243 admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:13.989919 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-57ea9a46-b540-4b5a-9ab1-99b92f18adf1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:14.010606 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ea9a46-b540-4b5a-9ab1-99b92f18adf1 admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:14.018726 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5e6941-f972-4c7f-b670-2bc3f1f7c078 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:14.019324 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5e6941-f972-4c7f-b670-2bc3f1f7c078 admin admin] REQUEST_METHOD: `PUT` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:14.019684 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5e6941-f972-4c7f-b670-2bc3f1f7c078 admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:14.020165 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5e6941-f972-4c7f-b670-2bc3f1f7c078 admin admin] PATH_INFO: `/v3/projects/f04220a3f6bf4758b81f7724a73bddc4/users/d0c08085532b4302b5775cba89b1f598/roles/640bda0879494e60b72680ee505285f0` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:14.055016 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5e6941-f972-4c7f-b670-2bc3f1f7c078 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f04220a3f6bf4758b81f7724a73bddc4, user_id=d0c08085532b4302b5775cba89b1f598, role_id=640bda0879494e60b72680ee505285f0)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:14.060186 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5e6941-f972-4c7f-b670-2bc3f1f7c078 admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:14.061397 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:46:14.081130 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-9a3be5c5-a53e-41d4-b85f-f8a5fffe8243 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ab6179e57c94794884b5fe3b40d66d4'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:14.084394 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 887/1786] 10.222.0.26 () {60 vars in 1483 bytes} [Wed Aug 24 05:46:13 2022] PUT /identity/v3/projects/f04220a3f6bf4758b81f7724a73bddc4/users/d0c08085532b4302b5775cba89b1f598/roles/640bda0879494e60b72680ee505285f0 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:46:14.085320 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5e6941-f972-4c7f-b670-2bc3f1f7c078 admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:14.096206 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-9a3be5c5-a53e-41d4-b85f-f8a5fffe8243 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ab6179e57c94794884b5fe3b40d66d4'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:14.097380 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-9a3be5c5-a53e-41d4-b85f-f8a5fffe8243 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ab6179e57c94794884b5fe3b40d66d4'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:14.115254 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-9a3be5c5-a53e-41d4-b85f-f8a5fffe8243 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ab6179e57c94794884b5fe3b40d66d4'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:14.126667 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-9a3be5c5-a53e-41d4-b85f-f8a5fffe8243 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ab6179e57c94794884b5fe3b40d66d4'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:14.136371 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 900/1787] 10.222.0.26 () {58 vars in 1224 bytes} [Wed Aug 24 05:46:13 2022] DELETE /identity/v3/users/0ab6179e57c94794884b5fe3b40d66d4 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:46:14.138475 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964be93e-4be6-4819-90bd-e7ab938ccc8f None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:14.138941 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964be93e-4be6-4819-90bd-e7ab938ccc8f None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:14.154779 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964be93e-4be6-4819-90bd-e7ab938ccc8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:14.201568 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-964be93e-4be6-4819-90bd-e7ab938ccc8f None None] MFA Rules not processed for user `874348b647194ac2b5ecbf12c33bf59e`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:46:14.204041 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-964be93e-4be6-4819-90bd-e7ab938ccc8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:14.219391 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5e6941-f972-4c7f-b670-2bc3f1f7c078 admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:14.276668 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 901/1788] 10.222.0.26 () {58 vars in 1009 bytes} [Wed Aug 24 05:46:14 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:46:14.277893 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964be93e-4be6-4819-90bd-e7ab938ccc8f None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:14.280097 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-964be93e-4be6-4819-90bd-e7ab938ccc8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:14.364303 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a4fb5e-0587-4fd4-baa1-bba4e69daa17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:14.364948 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a4fb5e-0587-4fd4-baa1-bba4e69daa17 admin admin] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:14.365234 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a4fb5e-0587-4fd4-baa1-bba4e69daa17 admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:14.365526 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a4fb5e-0587-4fd4-baa1-bba4e69daa17 admin admin] PATH_INFO: `/v3/users` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:14.366216 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a4fb5e-0587-4fd4-baa1-bba4e69daa17 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:14.368211 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a4fb5e-0587-4fd4-baa1-bba4e69daa17 admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:14.403449 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 888/1789] 10.222.0.26 () {60 vars in 1144 bytes} [Wed Aug 24 05:46:14 2022] POST /identity/v3/users => generated 291 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:46:14.404449 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a4fb5e-0587-4fd4-baa1-bba4e69daa17 admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:14.406824 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-84a4fb5e-0587-4fd4-baa1-bba4e69daa17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:14.434560 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964be93e-4be6-4819-90bd-e7ab938ccc8f None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:14.443537 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a4fb5e-0587-4fd4-baa1-bba4e69daa17 admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:14.443830 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c396316f-20ab-4ae0-bde5-fcd592be5eeb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b633e1aec6c4269bce13aa9c89e911a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:14.445210 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c396316f-20ab-4ae0-bde5-fcd592be5eeb service nova] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:14.445727 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c396316f-20ab-4ae0-bde5-fcd592be5eeb service nova] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:14.446294 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c396316f-20ab-4ae0-bde5-fcd592be5eeb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:14.448640 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-c396316f-20ab-4ae0-bde5-fcd592be5eeb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:14.458657 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac301870-fa82-4e3b-a4f6-519b365afa48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:14.459344 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac301870-fa82-4e3b-a4f6-519b365afa48 admin admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:14.459681 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac301870-fa82-4e3b-a4f6-519b365afa48 admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:14.459963 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac301870-fa82-4e3b-a4f6-519b365afa48 admin admin] PATH_INFO: `/v3/roles` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:14.460629 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac301870-fa82-4e3b-a4f6-519b365afa48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:14.462477 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac301870-fa82-4e3b-a4f6-519b365afa48 admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:14.492059 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 889/1790] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Aug 24 05:46:14 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:46:14.500086 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac301870-fa82-4e3b-a4f6-519b365afa48 admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:14.504423 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-ac301870-fa82-4e3b-a4f6-519b365afa48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:14.519917 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:46:14.572079 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c396316f-20ab-4ae0-bde5-fcd592be5eeb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:14.574654 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c396316f-20ab-4ae0-bde5-fcd592be5eeb service nova] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:14.580541 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:46:14.590744 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 902/1791] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 24 05:46:14 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:46:14.593005 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c396316f-20ab-4ae0-bde5-fcd592be5eeb service nova] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:14.595403 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-c396316f-20ab-4ae0-bde5-fcd592be5eeb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:14.614740 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c396316f-20ab-4ae0-bde5-fcd592be5eeb service nova] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:14.620922 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b2a388-c56c-4e31-ba52-822ffb7b1f5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:14.622488 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b2a388-c56c-4e31-ba52-822ffb7b1f5a admin admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:14.623375 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b2a388-c56c-4e31-ba52-822ffb7b1f5a admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:14.623818 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b2a388-c56c-4e31-ba52-822ffb7b1f5a admin admin] PATH_INFO: `/v3/roles` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:14.624837 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b2a388-c56c-4e31-ba52-822ffb7b1f5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:14.626717 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b2a388-c56c-4e31-ba52-822ffb7b1f5a admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:14.640839 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 903/1792] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Aug 24 05:46:14 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:46:14.642024 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b2a388-c56c-4e31-ba52-822ffb7b1f5a admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:14.645699 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-58b2a388-c56c-4e31-ba52-822ffb7b1f5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:14.661409 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b2a388-c56c-4e31-ba52-822ffb7b1f5a admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:14.667750 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a82fc6-3206-44e8-8ab6-1812661e586d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '874348b647194ac2b5ecbf12c33bf59e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:14.668638 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a82fc6-3206-44e8-8ab6-1812661e586d service neutron] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:14.669119 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a82fc6-3206-44e8-8ab6-1812661e586d service neutron] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:14.670343 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a82fc6-3206-44e8-8ab6-1812661e586d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:14.691763 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a82fc6-3206-44e8-8ab6-1812661e586d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:14.693316 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a82fc6-3206-44e8-8ab6-1812661e586d service neutron] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:14.701306 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac301870-fa82-4e3b-a4f6-519b365afa48 admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:14.724048 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b9cb0d-72c8-44b3-8b93-1af154142c83 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '995ebe690b7748c9842bc0696415fc52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:14.724704 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 904/1793] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 24 05:46:14 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:46:14.724819 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b9cb0d-72c8-44b3-8b93-1af154142c83 service placement] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:14.725010 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b9cb0d-72c8-44b3-8b93-1af154142c83 service placement] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:14.725293 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b9cb0d-72c8-44b3-8b93-1af154142c83 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:14.726266 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a82fc6-3206-44e8-8ab6-1812661e586d service neutron] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:14.729619 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-66b9cb0d-72c8-44b3-8b93-1af154142c83 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:14.730732 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-60a82fc6-3206-44e8-8ab6-1812661e586d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:14.756694 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b9cb0d-72c8-44b3-8b93-1af154142c83 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:14.761880 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b9cb0d-72c8-44b3-8b93-1af154142c83 service placement] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:14.769587 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a82fc6-3206-44e8-8ab6-1812661e586d service neutron] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:14.783776 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 890/1794] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 24 05:46:14 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:46:14.784667 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b9cb0d-72c8-44b3-8b93-1af154142c83 service placement] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:14.793191 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9a5408-4f21-4b22-ac2d-331e7b95ddd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:14.793817 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9a5408-4f21-4b22-ac2d-331e7b95ddd0 admin admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:14.796806 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b9cb0d-72c8-44b3-8b93-1af154142c83 service placement] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:14.798949 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9a5408-4f21-4b22-ac2d-331e7b95ddd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:14.799263 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9a5408-4f21-4b22-ac2d-331e7b95ddd0 admin admin] PATH_INFO: `/v3/roles` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:14.801088 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9a5408-4f21-4b22-ac2d-331e7b95ddd0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:14.802286 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c4320b-b773-40c9-b83b-17acb2c27f39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:14.803002 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c4320b-b773-40c9-b83b-17acb2c27f39 admin admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:14.803286 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c4320b-b773-40c9-b83b-17acb2c27f39 admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:14.803564 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c4320b-b773-40c9-b83b-17acb2c27f39 admin admin] PATH_INFO: `/v3/roles` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:14.804275 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c4320b-b773-40c9-b83b-17acb2c27f39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:14.806017 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c4320b-b773-40c9-b83b-17acb2c27f39 admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:14.808090 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9a5408-4f21-4b22-ac2d-331e7b95ddd0 admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:14.823146 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 891/1795] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Aug 24 05:46:14 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:46:14.823997 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c4320b-b773-40c9-b83b-17acb2c27f39 admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:14.833938 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 905/1796] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Aug 24 05:46:14 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:46:14.837347 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9a5408-4f21-4b22-ac2d-331e7b95ddd0 admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:14.839271 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c4320b-b773-40c9-b83b-17acb2c27f39 admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:14.844695 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b7c90a-69d6-4a99-9a78-b8a561f32ea1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:14.845424 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b7c90a-69d6-4a99-9a78-b8a561f32ea1 admin admin] REQUEST_METHOD: `PUT` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:14.845712 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b7c90a-69d6-4a99-9a78-b8a561f32ea1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:14.846023 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b7c90a-69d6-4a99-9a78-b8a561f32ea1 admin admin] PATH_INFO: `/v3/projects/f04220a3f6bf4758b81f7724a73bddc4/users/d0c08085532b4302b5775cba89b1f598/roles/640bda0879494e60b72680ee505285f0` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:14.848504 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b7c90a-69d6-4a99-9a78-b8a561f32ea1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f04220a3f6bf4758b81f7724a73bddc4, user_id=d0c08085532b4302b5775cba89b1f598, role_id=640bda0879494e60b72680ee505285f0)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:14.851677 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b7c90a-69d6-4a99-9a78-b8a561f32ea1 admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:14.859315 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9a5408-4f21-4b22-ac2d-331e7b95ddd0 admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:14.865175 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 892/1797] 10.222.0.26 () {60 vars in 1483 bytes} [Wed Aug 24 05:46:14 2022] PUT /identity/v3/projects/f04220a3f6bf4758b81f7724a73bddc4/users/d0c08085532b4302b5775cba89b1f598/roles/640bda0879494e60b72680ee505285f0 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:46:14.875970 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b7c90a-69d6-4a99-9a78-b8a561f32ea1 admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:15.000634 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b7c90a-69d6-4a99-9a78-b8a561f32ea1 admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:15.006835 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0f84c0-e60d-44da-bf47-8d1660a154d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:15.007752 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0f84c0-e60d-44da-bf47-8d1660a154d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:15.008560 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0f84c0-e60d-44da-bf47-8d1660a154d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:15.008984 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0f84c0-e60d-44da-bf47-8d1660a154d9 admin admin] PATH_INFO: `/v3/projects/99b436cde4af4931a451af357080ea09/users/edb9a254c41b43428c5d7da0a5e7f786/roles/640bda0879494e60b72680ee505285f0` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:15.011335 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0b4324-2967-4208-a522-e42b4d529dce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:15.014973 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0b4324-2967-4208-a522-e42b4d529dce admin admin] REQUEST_METHOD: `PUT` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:15.015257 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0b4324-2967-4208-a522-e42b4d529dce admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:15.015528 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0b4324-2967-4208-a522-e42b4d529dce admin admin] PATH_INFO: `/v3/projects/599d6455b2744bbd8066103e7e697c5b/users/97b9ee0d085a4b4ca20cdce1ba81e663/roles/f7aa4a2c74c94c1b9ca8ecdcccccda5c` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:15.055528 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0f84c0-e60d-44da-bf47-8d1660a154d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=99b436cde4af4931a451af357080ea09, user_id=edb9a254c41b43428c5d7da0a5e7f786, role_id=640bda0879494e60b72680ee505285f0)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:15.063117 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0f84c0-e60d-44da-bf47-8d1660a154d9 admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:15.064249 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0b4324-2967-4208-a522-e42b4d529dce admin admin] RBAC: Authorizing `identity:create_grant(project_id=599d6455b2744bbd8066103e7e697c5b, user_id=97b9ee0d085a4b4ca20cdce1ba81e663, role_id=f7aa4a2c74c94c1b9ca8ecdcccccda5c)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:15.070246 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0b4324-2967-4208-a522-e42b4d529dce admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:15.098837 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 906/1798] 10.222.0.26 () {60 vars in 1483 bytes} [Wed Aug 24 05:46:14 2022] PUT /identity/v3/projects/599d6455b2744bbd8066103e7e697c5b/users/97b9ee0d085a4b4ca20cdce1ba81e663/roles/f7aa4a2c74c94c1b9ca8ecdcccccda5c => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:46:15.100571 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddb70f2-05fc-456f-bd89-fc0f3e451f79 None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:15.100944 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddb70f2-05fc-456f-bd89-fc0f3e451f79 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:15.101344 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddb70f2-05fc-456f-bd89-fc0f3e451f79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:15.119750 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 893/1799] 10.222.0.26 () {60 vars in 1483 bytes} [Wed Aug 24 05:46:14 2022] PUT /identity/v3/projects/99b436cde4af4931a451af357080ea09/users/edb9a254c41b43428c5d7da0a5e7f786/roles/640bda0879494e60b72680ee505285f0 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:46:15.121094 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a6c78b-7f40-47dd-ad6f-c2c0a196c1f3 None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:15.121384 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a6c78b-7f40-47dd-ad6f-c2c0a196c1f3 None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:15.121660 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a6c78b-7f40-47dd-ad6f-c2c0a196c1f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:15.160757 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-23a6c78b-7f40-47dd-ad6f-c2c0a196c1f3 None None] MFA Rules not processed for user `97b9ee0d085a4b4ca20cdce1ba81e663`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:46:15.161608 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-23a6c78b-7f40-47dd-ad6f-c2c0a196c1f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:15.190552 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-dddb70f2-05fc-456f-bd89-fc0f3e451f79 None None] MFA Rules not processed for user `d0c08085532b4302b5775cba89b1f598`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:46:15.192012 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-dddb70f2-05fc-456f-bd89-fc0f3e451f79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:15.292074 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:46:15.379044 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 894/1800] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:46:15 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:46:15.382781 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a6c78b-7f40-47dd-ad6f-c2c0a196c1f3 None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:15.443429 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 907/1801] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:46:15 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 344 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:46:15.444565 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddb70f2-05fc-456f-bd89-fc0f3e451f79 None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:15.448705 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-dddb70f2-05fc-456f-bd89-fc0f3e451f79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:15.540447 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a6c78b-7f40-47dd-ad6f-c2c0a196c1f3 None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:15.557338 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5911a8a4-0107-4c14-8483-29c35c7fcb5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:15.558434 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5911a8a4-0107-4c14-8483-29c35c7fcb5c admin admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:15.558558 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5911a8a4-0107-4c14-8483-29c35c7fcb5c admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:15.558794 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5911a8a4-0107-4c14-8483-29c35c7fcb5c admin admin] PATH_INFO: `/v3/roles` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:15.559514 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5911a8a4-0107-4c14-8483-29c35c7fcb5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:15.569556 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5911a8a4-0107-4c14-8483-29c35c7fcb5c admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:15.580183 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:46:15.598778 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 895/1802] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Aug 24 05:46:15 2022] GET /identity/v3/roles => generated 1420 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:46:15.600076 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5911a8a4-0107-4c14-8483-29c35c7fcb5c admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:15.614707 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5911a8a4-0107-4c14-8483-29c35c7fcb5c admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:15.652568 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175e224f-4995-49ac-b0bb-64030e6035af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:15.656990 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175e224f-4995-49ac-b0bb-64030e6035af admin admin] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:15.657307 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175e224f-4995-49ac-b0bb-64030e6035af admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:15.657590 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175e224f-4995-49ac-b0bb-64030e6035af admin admin] PATH_INFO: `/v3/projects` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:15.658579 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175e224f-4995-49ac-b0bb-64030e6035af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:15.661275 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175e224f-4995-49ac-b0bb-64030e6035af admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:15.720010 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddb70f2-05fc-456f-bd89-fc0f3e451f79 None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:15.743528 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18aad739-4d86-46cc-938d-665c871b448d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:15.744186 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18aad739-4d86-46cc-938d-665c871b448d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:15.744828 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18aad739-4d86-46cc-938d-665c871b448d admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:15.744828 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18aad739-4d86-46cc-938d-665c871b448d admin admin] PATH_INFO: `/v3/projects/b5e39618b77346dab91c43de4708f4f7` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:15.749451 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18aad739-4d86-46cc-938d-665c871b448d admin admin] RBAC: Authorizing `identity:delete_project(project_id=b5e39618b77346dab91c43de4708f4f7)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:15.758679 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18aad739-4d86-46cc-938d-665c871b448d admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:15.763072 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 896/1803] 10.222.0.26 () {60 vars in 1153 bytes} [Wed Aug 24 05:46:15 2022] POST /identity/v3/projects => generated 373 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:46:15.764082 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175e224f-4995-49ac-b0bb-64030e6035af admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:15.768313 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-175e224f-4995-49ac-b0bb-64030e6035af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:15.907982 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-18aad739-4d86-46cc-938d-665c871b448d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b5e39618b77346dab91c43de4708f4f7', 'request_id': 'req-18aad739-4d86-46cc-938d-665c871b448d'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:15.924317 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-18aad739-4d86-46cc-938d-665c871b448d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b5e39618b77346dab91c43de4708f4f7', 'request_id': 'req-18aad739-4d86-46cc-938d-665c871b448d'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:15.944759 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-18aad739-4d86-46cc-938d-665c871b448d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b5e39618b77346dab91c43de4708f4f7', 'request_id': 'req-18aad739-4d86-46cc-938d-665c871b448d'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:15.956054 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175e224f-4995-49ac-b0bb-64030e6035af admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:15.974000 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-18aad739-4d86-46cc-938d-665c871b448d admin admin] The token cache is being invalidate because project b5e39618b77346dab91c43de4708f4f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:46:15.974306 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-18aad739-4d86-46cc-938d-665c871b448d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:15.976767 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-18aad739-4d86-46cc-938d-665c871b448d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:15.978649 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 908/1804] 10.222.0.26 () {58 vars in 1233 bytes} [Wed Aug 24 05:46:15 2022] DELETE /identity/v3/projects/b5e39618b77346dab91c43de4708f4f7 => generated 0 bytes in 535 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:46:15.994487 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18aad739-4d86-46cc-938d-665c871b448d admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:15.994487 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-18aad739-4d86-46cc-938d-665c871b448d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:16.097182 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2ccbf6-eef3-4d03-a73d-e159dfc06d25 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17b450afe795495680fc70f522c83750', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:16.098694 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2ccbf6-eef3-4d03-a73d-e159dfc06d25 service cinder] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:16.098982 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2ccbf6-eef3-4d03-a73d-e159dfc06d25 service cinder] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:16.099627 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2ccbf6-eef3-4d03-a73d-e159dfc06d25 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:16.102441 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-9c2ccbf6-eef3-4d03-a73d-e159dfc06d25 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:16.156030 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18aad739-4d86-46cc-938d-665c871b448d admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:16.171795 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1f8b15-26ed-41b5-9788-60e636aa4900 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:16.172749 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1f8b15-26ed-41b5-9788-60e636aa4900 admin admin] REQUEST_METHOD: `PUT` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:16.173282 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1f8b15-26ed-41b5-9788-60e636aa4900 admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:16.175698 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1f8b15-26ed-41b5-9788-60e636aa4900 admin admin] PATH_INFO: `/v3/projects/99b436cde4af4931a451af357080ea09/users/edb9a254c41b43428c5d7da0a5e7f786/roles/640bda0879494e60b72680ee505285f0` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:16.180198 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1f8b15-26ed-41b5-9788-60e636aa4900 admin admin] RBAC: Authorizing `identity:create_grant(project_id=99b436cde4af4931a451af357080ea09, user_id=edb9a254c41b43428c5d7da0a5e7f786, role_id=640bda0879494e60b72680ee505285f0)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:16.183201 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1f8b15-26ed-41b5-9788-60e636aa4900 admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:16.201370 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:46:16.218200 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 909/1805] 10.222.0.26 () {60 vars in 1483 bytes} [Wed Aug 24 05:46:15 2022] PUT /identity/v3/projects/99b436cde4af4931a451af357080ea09/users/edb9a254c41b43428c5d7da0a5e7f786/roles/640bda0879494e60b72680ee505285f0 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:46:16.218886 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1f8b15-26ed-41b5-9788-60e636aa4900 admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:16.222714 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-ff1f8b15-26ed-41b5-9788-60e636aa4900 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:16.269555 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2ccbf6-eef3-4d03-a73d-e159dfc06d25 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:16.271241 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2ccbf6-eef3-4d03-a73d-e159dfc06d25 service cinder] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:16.289086 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 897/1806] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 24 05:46:15 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 525 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:46:16.290488 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18c7415-aae1-49cc-961e-b226eb980f35 None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:16.290916 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18c7415-aae1-49cc-961e-b226eb980f35 None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:16.291216 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18c7415-aae1-49cc-961e-b226eb980f35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:16.316898 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-f18c7415-aae1-49cc-961e-b226eb980f35 None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:46:16.318259 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-f18c7415-aae1-49cc-961e-b226eb980f35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:16.386674 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:46:16.403618 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1f8b15-26ed-41b5-9788-60e636aa4900 admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:16.428856 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6f78aa-de9c-4a15-bdb0-643f1c68ffd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:16.434093 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6f78aa-de9c-4a15-bdb0-643f1c68ffd5 admin admin] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:16.434387 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6f78aa-de9c-4a15-bdb0-643f1c68ffd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:16.434670 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6f78aa-de9c-4a15-bdb0-643f1c68ffd5 admin admin] PATH_INFO: `/v3/users` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:16.435357 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6f78aa-de9c-4a15-bdb0-643f1c68ffd5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:16.437085 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 898/1807] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:46:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:46:16.438616 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b06d960-6c9b-4a52-ba25-118f2697ef22 None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:16.438906 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b06d960-6c9b-4a52-ba25-118f2697ef22 None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:16.439186 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b06d960-6c9b-4a52-ba25-118f2697ef22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:16.451974 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6f78aa-de9c-4a15-bdb0-643f1c68ffd5 admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:16.485534 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-0b06d960-6c9b-4a52-ba25-118f2697ef22 None None] MFA Rules not processed for user `edb9a254c41b43428c5d7da0a5e7f786`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:46:16.487034 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-0b06d960-6c9b-4a52-ba25-118f2697ef22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:16.507485 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 910/1808] 10.222.0.26 () {60 vars in 1144 bytes} [Wed Aug 24 05:46:16 2022] POST /identity/v3/users => generated 293 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:46:16.510029 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbddee1-c545-4f68-a8d5-2c30827fd940 None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:16.510358 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbddee1-c545-4f68-a8d5-2c30827fd940 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:16.511242 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbddee1-c545-4f68-a8d5-2c30827fd940 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:16.546679 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-2cbddee1-c545-4f68-a8d5-2c30827fd940 None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:46:16.548206 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-2cbddee1-c545-4f68-a8d5-2c30827fd940 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:16.603255 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 911/1809] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:46:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:46:16.607966 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbddee1-c545-4f68-a8d5-2c30827fd940 None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:16.609696 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-2cbddee1-c545-4f68-a8d5-2c30827fd940 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:16.650229 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbddee1-c545-4f68-a8d5-2c30827fd940 None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:16.665865 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4945a97c-538b-443e-954f-25a87c5511b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:16.668010 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4945a97c-538b-443e-954f-25a87c5511b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:16.668528 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4945a97c-538b-443e-954f-25a87c5511b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:16.668960 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4945a97c-538b-443e-954f-25a87c5511b0 admin admin] PATH_INFO: `/v3/users/6c161bbe6484493da21afe800e8c3155` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:16.671698 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4945a97c-538b-443e-954f-25a87c5511b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c161bbe6484493da21afe800e8c3155)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:16.672440 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 899/1810] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:46:16 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:46:16.677688 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4945a97c-538b-443e-954f-25a87c5511b0 admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:16.688651 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b06d960-6c9b-4a52-ba25-118f2697ef22 None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:16.729106 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b06d960-6c9b-4a52-ba25-118f2697ef22 None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:16.749062 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-4945a97c-538b-443e-954f-25a87c5511b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c161bbe6484493da21afe800e8c3155'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:16.749634 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d95ae2a-8721-4f84-a31c-b83d201babe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:16.750537 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d95ae2a-8721-4f84-a31c-b83d201babe5 admin admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:16.754028 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d95ae2a-8721-4f84-a31c-b83d201babe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:16.754548 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d95ae2a-8721-4f84-a31c-b83d201babe5 admin admin] PATH_INFO: `/v3/roles` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:16.755481 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d95ae2a-8721-4f84-a31c-b83d201babe5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:16.757437 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d95ae2a-8721-4f84-a31c-b83d201babe5 admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:16.758282 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-4945a97c-538b-443e-954f-25a87c5511b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c161bbe6484493da21afe800e8c3155'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:16.759047 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-4945a97c-538b-443e-954f-25a87c5511b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c161bbe6484493da21afe800e8c3155'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:16.782776 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 900/1811] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Aug 24 05:46:16 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:46:16.787227 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d95ae2a-8721-4f84-a31c-b83d201babe5 admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:16.790006 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-4945a97c-538b-443e-954f-25a87c5511b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c161bbe6484493da21afe800e8c3155'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:16.792794 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-5d95ae2a-8721-4f84-a31c-b83d201babe5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:16.807941 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-4945a97c-538b-443e-954f-25a87c5511b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c161bbe6484493da21afe800e8c3155'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:16.816513 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 912/1812] 10.222.0.26 () {58 vars in 1224 bytes} [Wed Aug 24 05:46:16 2022] DELETE /identity/v3/users/6c161bbe6484493da21afe800e8c3155 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:46:16.817816 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4945a97c-538b-443e-954f-25a87c5511b0 admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:16.818405 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d95ae2a-8721-4f84-a31c-b83d201babe5 admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:16.820501 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-4945a97c-538b-443e-954f-25a87c5511b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:16.914236 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:46:16.966949 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4945a97c-538b-443e-954f-25a87c5511b0 admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:16.971875 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23727ea9-48ae-4565-8629-7e39930ed805 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17b450afe795495680fc70f522c83750', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:16.972557 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23727ea9-48ae-4565-8629-7e39930ed805 service cinder] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:16.972847 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23727ea9-48ae-4565-8629-7e39930ed805 service cinder] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:16.973276 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23727ea9-48ae-4565-8629-7e39930ed805 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:16.976325 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-23727ea9-48ae-4565-8629-7e39930ed805 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:16.986647 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24aa4b44-2283-4979-9621-bbd31a9a5593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:16.988489 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24aa4b44-2283-4979-9621-bbd31a9a5593 admin admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:16.988778 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24aa4b44-2283-4979-9621-bbd31a9a5593 admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:16.990171 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24aa4b44-2283-4979-9621-bbd31a9a5593 admin admin] PATH_INFO: `/v3/domains` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:16.991985 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24aa4b44-2283-4979-9621-bbd31a9a5593 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:46:16.993451 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24aa4b44-2283-4979-9621-bbd31a9a5593 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:16.996476 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24aa4b44-2283-4979-9621-bbd31a9a5593 admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:17.031967 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 901/1813] 10.222.0.26 () {58 vars in 1153 bytes} [Wed Aug 24 05:46:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:46:17.031967 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24aa4b44-2283-4979-9621-bbd31a9a5593 admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:17.038602 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-24aa4b44-2283-4979-9621-bbd31a9a5593 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:17.066167 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24aa4b44-2283-4979-9621-bbd31a9a5593 admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:17.076584 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db478ac9-49f9-43a6-b46d-32c7b78a7424 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:17.077282 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db478ac9-49f9-43a6-b46d-32c7b78a7424 admin admin] REQUEST_METHOD: `PUT` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:17.077613 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db478ac9-49f9-43a6-b46d-32c7b78a7424 admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:17.077893 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db478ac9-49f9-43a6-b46d-32c7b78a7424 admin admin] PATH_INFO: `/v3/projects/c9cc47ae87e24412bbd30b1b27994d29/users/1346a6e3134c4198adef5c12eb625806/roles/640bda0879494e60b72680ee505285f0` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:17.115962 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db478ac9-49f9-43a6-b46d-32c7b78a7424 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9cc47ae87e24412bbd30b1b27994d29, user_id=1346a6e3134c4198adef5c12eb625806, role_id=640bda0879494e60b72680ee505285f0)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:17.119199 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db478ac9-49f9-43a6-b46d-32c7b78a7424 admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:17.144856 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 902/1814] 10.222.0.26 () {60 vars in 1483 bytes} [Wed Aug 24 05:46:17 2022] PUT /identity/v3/projects/c9cc47ae87e24412bbd30b1b27994d29/users/1346a6e3134c4198adef5c12eb625806/roles/640bda0879494e60b72680ee505285f0 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:46:17.146301 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd7ffca-4481-4bc9-acad-273f1ebaee92 None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:17.146592 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd7ffca-4481-4bc9-acad-273f1ebaee92 None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:17.146866 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd7ffca-4481-4bc9-acad-273f1ebaee92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:17.154613 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23727ea9-48ae-4565-8629-7e39930ed805 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:17.156035 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23727ea9-48ae-4565-8629-7e39930ed805 service cinder] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:17.168581 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:46:17.186453 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 913/1815] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 24 05:46:16 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:46:17.192652 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23727ea9-48ae-4565-8629-7e39930ed805 service cinder] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:17.199435 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-fcd7ffca-4481-4bc9-acad-273f1ebaee92 None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:46:17.200210 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-fcd7ffca-4481-4bc9-acad-273f1ebaee92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:17.213866 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23727ea9-48ae-4565-8629-7e39930ed805 service cinder] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:17.301743 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d108ce94-13dc-4ff8-b3b4-fbfc02e447fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:17.302311 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d108ce94-13dc-4ff8-b3b4-fbfc02e447fd admin admin] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:17.304486 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d108ce94-13dc-4ff8-b3b4-fbfc02e447fd admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:17.304780 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d108ce94-13dc-4ff8-b3b4-fbfc02e447fd admin admin] PATH_INFO: `/v3/projects` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:17.318183 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d108ce94-13dc-4ff8-b3b4-fbfc02e447fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:17.318183 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d108ce94-13dc-4ff8-b3b4-fbfc02e447fd admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:17.357532 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 903/1816] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:46:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:46:17.358511 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd7ffca-4481-4bc9-acad-273f1ebaee92 None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:17.370561 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 914/1817] 10.222.0.26 () {60 vars in 1153 bytes} [Wed Aug 24 05:46:17 2022] POST /identity/v3/projects => generated 387 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:46:17.375113 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d108ce94-13dc-4ff8-b3b4-fbfc02e447fd admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:17.376433 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd7ffca-4481-4bc9-acad-273f1ebaee92 None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:17.484694 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9871ce-9496-43ac-86cd-cd075f612b82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:17.488283 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9871ce-9496-43ac-86cd-cd075f612b82 admin admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:17.488700 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9871ce-9496-43ac-86cd-cd075f612b82 admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:17.489203 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9871ce-9496-43ac-86cd-cd075f612b82 admin admin] PATH_INFO: `/v3/roles` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:17.490410 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9871ce-9496-43ac-86cd-cd075f612b82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:17.492234 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9871ce-9496-43ac-86cd-cd075f612b82 admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:17.513403 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 904/1818] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Aug 24 05:46:17 2022] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:46:17.517034 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9871ce-9496-43ac-86cd-cd075f612b82 admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:17.524148 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-0e9871ce-9496-43ac-86cd-cd075f612b82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:17.612892 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:46:17.621285 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9871ce-9496-43ac-86cd-cd075f612b82 admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:17.628069 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3901a48a-17e5-44ee-9fae-af21f72d54b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '874348b647194ac2b5ecbf12c33bf59e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:17.628844 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3901a48a-17e5-44ee-9fae-af21f72d54b2 service neutron] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:17.629991 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3901a48a-17e5-44ee-9fae-af21f72d54b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:17.629991 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3901a48a-17e5-44ee-9fae-af21f72d54b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:17.633734 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d108ce94-13dc-4ff8-b3b4-fbfc02e447fd admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:17.641728 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c759dcb7-cda9-42ba-969b-74914ea44fc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:17.642433 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c759dcb7-cda9-42ba-969b-74914ea44fc3 admin admin] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:17.642711 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c759dcb7-cda9-42ba-969b-74914ea44fc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:17.642975 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c759dcb7-cda9-42ba-969b-74914ea44fc3 admin admin] PATH_INFO: `/v3/users` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:17.643612 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c759dcb7-cda9-42ba-969b-74914ea44fc3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:17.643828 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3901a48a-17e5-44ee-9fae-af21f72d54b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:17.645864 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c759dcb7-cda9-42ba-969b-74914ea44fc3 admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:17.647643 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3901a48a-17e5-44ee-9fae-af21f72d54b2 service neutron] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:17.660358 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 905/1819] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 24 05:46:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:46:17.661648 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3901a48a-17e5-44ee-9fae-af21f72d54b2 service neutron] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:17.676276 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3901a48a-17e5-44ee-9fae-af21f72d54b2 service neutron] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:17.694557 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f8e1c5-ff1f-4ab1-9c3b-ef26f8d9da6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:17.697569 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f8e1c5-ff1f-4ab1-9c3b-ef26f8d9da6f admin admin] REQUEST_METHOD: `PUT` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:17.698332 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f8e1c5-ff1f-4ab1-9c3b-ef26f8d9da6f admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:17.699834 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f8e1c5-ff1f-4ab1-9c3b-ef26f8d9da6f admin admin] PATH_INFO: `/v3/projects/c9cc47ae87e24412bbd30b1b27994d29/users/1346a6e3134c4198adef5c12eb625806/roles/640bda0879494e60b72680ee505285f0` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:17.707803 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f8e1c5-ff1f-4ab1-9c3b-ef26f8d9da6f admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9cc47ae87e24412bbd30b1b27994d29, user_id=1346a6e3134c4198adef5c12eb625806, role_id=640bda0879494e60b72680ee505285f0)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:17.710933 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f8e1c5-ff1f-4ab1-9c3b-ef26f8d9da6f admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:17.737318 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 906/1820] 10.222.0.26 () {60 vars in 1483 bytes} [Wed Aug 24 05:46:17 2022] PUT /identity/v3/projects/c9cc47ae87e24412bbd30b1b27994d29/users/1346a6e3134c4198adef5c12eb625806/roles/640bda0879494e60b72680ee505285f0 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:46:17.748677 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f886704-6d36-425e-961f-dcb78adb8123 None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:17.750068 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f886704-6d36-425e-961f-dcb78adb8123 None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:17.750478 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f886704-6d36-425e-961f-dcb78adb8123 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:17.753591 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 915/1821] 10.222.0.26 () {60 vars in 1144 bytes} [Wed Aug 24 05:46:17 2022] POST /identity/v3/users => generated 294 bytes in 381 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:46:17.757743 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c759dcb7-cda9-42ba-969b-74914ea44fc3 admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:17.792147 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c759dcb7-cda9-42ba-969b-74914ea44fc3 admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:17.830243 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-8f886704-6d36-425e-961f-dcb78adb8123 None None] MFA Rules not processed for user `1346a6e3134c4198adef5c12eb625806`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:46:17.836085 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-8f886704-6d36-425e-961f-dcb78adb8123 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:17.927916 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32213425-4a2a-4959-8338-483f16b4f26d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:17.928675 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32213425-4a2a-4959-8338-483f16b4f26d admin admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:17.928962 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32213425-4a2a-4959-8338-483f16b4f26d admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:17.929294 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32213425-4a2a-4959-8338-483f16b4f26d admin admin] PATH_INFO: `/v3/roles` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:17.930034 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32213425-4a2a-4959-8338-483f16b4f26d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:17.941979 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32213425-4a2a-4959-8338-483f16b4f26d admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:18.007088 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 916/1822] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Aug 24 05:46:17 2022] GET /identity/v3/roles => generated 1420 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:46:18.008235 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32213425-4a2a-4959-8338-483f16b4f26d admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:18.038820 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32213425-4a2a-4959-8338-483f16b4f26d admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:18.064153 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7a4103-16a4-4f10-b240-8e2c6cded0c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:18.064780 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7a4103-16a4-4f10-b240-8e2c6cded0c5 admin admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:18.065062 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7a4103-16a4-4f10-b240-8e2c6cded0c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:18.065339 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7a4103-16a4-4f10-b240-8e2c6cded0c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:18.067866 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7a4103-16a4-4f10-b240-8e2c6cded0c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:18.069010 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7a4103-16a4-4f10-b240-8e2c6cded0c5 admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:18.089253 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:46:18.110900 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 907/1823] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:46:17 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 364 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 05:46:18.112101 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 917/1824] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Aug 24 05:46:18 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:46:18.116105 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f886704-6d36-425e-961f-dcb78adb8123 None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:18.138475 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7a4103-16a4-4f10-b240-8e2c6cded0c5 admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:18.138662 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f886704-6d36-425e-961f-dcb78adb8123 None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:18.140666 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-8f7a4103-16a4-4f10-b240-8e2c6cded0c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:18.144407 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3eb57e1-73f5-4281-8e53-29575bae757b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:18.145150 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3eb57e1-73f5-4281-8e53-29575bae757b admin admin] REQUEST_METHOD: `PUT` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:18.145436 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3eb57e1-73f5-4281-8e53-29575bae757b admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:18.145765 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3eb57e1-73f5-4281-8e53-29575bae757b admin admin] PATH_INFO: `/v3/projects/a24339b26b074dd2995a9cefc33dbe6e/users/fdd42423de5e4ae1a50dc2a1b8a6c2f2/roles/f7aa4a2c74c94c1b9ca8ecdcccccda5c` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:18.199067 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3eb57e1-73f5-4281-8e53-29575bae757b admin admin] RBAC: Authorizing `identity:create_grant(project_id=a24339b26b074dd2995a9cefc33dbe6e, user_id=fdd42423de5e4ae1a50dc2a1b8a6c2f2, role_id=f7aa4a2c74c94c1b9ca8ecdcccccda5c)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:18.202724 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3eb57e1-73f5-4281-8e53-29575bae757b admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:18.250703 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 908/1825] 10.222.0.26 () {60 vars in 1483 bytes} [Wed Aug 24 05:46:18 2022] PUT /identity/v3/projects/a24339b26b074dd2995a9cefc33dbe6e/users/fdd42423de5e4ae1a50dc2a1b8a6c2f2/roles/f7aa4a2c74c94c1b9ca8ecdcccccda5c => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:46:18.260928 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e665cbac-6623-4292-94e4-3c582777b727 None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:18.261506 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e665cbac-6623-4292-94e4-3c582777b727 None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:18.262010 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e665cbac-6623-4292-94e4-3c582777b727 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:18.324701 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7a4103-16a4-4f10-b240-8e2c6cded0c5 admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:18.333527 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-e665cbac-6623-4292-94e4-3c582777b727 None None] MFA Rules not processed for user `fdd42423de5e4ae1a50dc2a1b8a6c2f2`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:46:18.334917 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-e665cbac-6623-4292-94e4-3c582777b727 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:18.467579 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdaf75c6-d7fe-41cd-9a33-1123996c0002 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17b450afe795495680fc70f522c83750', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:18.471290 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaf75c6-d7fe-41cd-9a33-1123996c0002 service cinder] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:18.473917 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaf75c6-d7fe-41cd-9a33-1123996c0002 service cinder] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:18.474236 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaf75c6-d7fe-41cd-9a33-1123996c0002 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:18.493637 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 909/1826] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:46:18 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:46:18.499875 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e665cbac-6623-4292-94e4-3c582777b727 None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:18.565803 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:46:18.641718 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdaf75c6-d7fe-41cd-9a33-1123996c0002 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:18.643199 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdaf75c6-d7fe-41cd-9a33-1123996c0002 service cinder] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:18.668601 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e665cbac-6623-4292-94e4-3c582777b727 None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:18.674807 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d770f44-a019-48ef-90c1-288efeaa5b25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:18.675652 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d770f44-a019-48ef-90c1-288efeaa5b25 admin admin] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:18.675870 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d770f44-a019-48ef-90c1-288efeaa5b25 admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:18.676156 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d770f44-a019-48ef-90c1-288efeaa5b25 admin admin] PATH_INFO: `/v3/projects` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:18.677610 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d770f44-a019-48ef-90c1-288efeaa5b25 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:18.680839 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d770f44-a019-48ef-90c1-288efeaa5b25 admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:18.682010 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 918/1827] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 24 05:46:18 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 544 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 05:46:18.683213 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aa58b6-63bd-4b3c-bf92-1e196d8eb738 None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:18.688370 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aa58b6-63bd-4b3c-bf92-1e196d8eb738 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:18.688749 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aa58b6-63bd-4b3c-bf92-1e196d8eb738 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:18.737840 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 910/1828] 10.222.0.26 () {60 vars in 1153 bytes} [Wed Aug 24 05:46:18 2022] POST /identity/v3/projects => generated 387 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:46:18.740310 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d770f44-a019-48ef-90c1-288efeaa5b25 admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:18.874477 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-f3aa58b6-63bd-4b3c-bf92-1e196d8eb738 None None] MFA Rules not processed for user `6c2c08b27a0f4943b5da908eb7b1cd96`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:46:18.895179 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-f3aa58b6-63bd-4b3c-bf92-1e196d8eb738 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:19.082071 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d770f44-a019-48ef-90c1-288efeaa5b25 admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:19.092094 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:46:19.094145 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0016e885-23cb-44ce-841b-26e65362db63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:19.094894 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0016e885-23cb-44ce-841b-26e65362db63 admin admin] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:19.095488 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0016e885-23cb-44ce-841b-26e65362db63 admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:19.095676 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0016e885-23cb-44ce-841b-26e65362db63 admin admin] PATH_INFO: `/v3/users` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:19.098026 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0016e885-23cb-44ce-841b-26e65362db63 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:19.101351 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0016e885-23cb-44ce-841b-26e65362db63 admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:19.162125 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 919/1829] 10.222.0.26 () {58 vars in 1009 bytes} [Wed Aug 24 05:46:18 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 480 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:46:19.182519 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 911/1830] 10.222.0.26 () {60 vars in 1144 bytes} [Wed Aug 24 05:46:18 2022] POST /identity/v3/users => generated 300 bytes in 440 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:46:19.183709 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3aa58b6-63bd-4b3c-bf92-1e196d8eb738 None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:19.206724 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3aa58b6-63bd-4b3c-bf92-1e196d8eb738 None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:19.223792 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a3544b-ba20-4d57-b58b-5a3bf79c8536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:19.224598 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a3544b-ba20-4d57-b58b-5a3bf79c8536 admin admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:19.224884 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a3544b-ba20-4d57-b58b-5a3bf79c8536 admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:19.225158 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a3544b-ba20-4d57-b58b-5a3bf79c8536 admin admin] PATH_INFO: `/v3/roles` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:19.226953 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a3544b-ba20-4d57-b58b-5a3bf79c8536 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:19.228764 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a3544b-ba20-4d57-b58b-5a3bf79c8536 admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:19.257662 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 920/1831] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Aug 24 05:46:19 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:46:19.259865 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0016e885-23cb-44ce-841b-26e65362db63 admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:19.274959 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63030de-4b0f-46a0-8e09-7fa5dd4fdc81 None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:19.278248 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63030de-4b0f-46a0-8e09-7fa5dd4fdc81 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:19.278535 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63030de-4b0f-46a0-8e09-7fa5dd4fdc81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:19.282200 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0016e885-23cb-44ce-841b-26e65362db63 admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:19.292983 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdf1e2d-8157-43b1-b31d-acc7dbea8874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:19.293652 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdf1e2d-8157-43b1-b31d-acc7dbea8874 admin admin] REQUEST_METHOD: `PUT` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:19.293932 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdf1e2d-8157-43b1-b31d-acc7dbea8874 admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:19.294232 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdf1e2d-8157-43b1-b31d-acc7dbea8874 admin admin] PATH_INFO: `/v3/projects/7559e9a56f3b4e48a5b2c964f6bd093c/users/412d90fec0a24d738bdd66d2e67568ec/roles/640bda0879494e60b72680ee505285f0` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:19.322220 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-c63030de-4b0f-46a0-8e09-7fa5dd4fdc81 None None] MFA Rules not processed for user `568d477011b84cc89b9285b5172d091f`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:46:19.324433 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-c63030de-4b0f-46a0-8e09-7fa5dd4fdc81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:19.331958 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdf1e2d-8157-43b1-b31d-acc7dbea8874 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7559e9a56f3b4e48a5b2c964f6bd093c, user_id=412d90fec0a24d738bdd66d2e67568ec, role_id=640bda0879494e60b72680ee505285f0)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:19.335942 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdf1e2d-8157-43b1-b31d-acc7dbea8874 admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:19.366786 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 912/1832] 10.222.0.26 () {60 vars in 1483 bytes} [Wed Aug 24 05:46:19 2022] PUT /identity/v3/projects/7559e9a56f3b4e48a5b2c964f6bd093c/users/412d90fec0a24d738bdd66d2e67568ec/roles/640bda0879494e60b72680ee505285f0 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:46:19.371723 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdf1e2d-8157-43b1-b31d-acc7dbea8874 admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:19.377098 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-3cdf1e2d-8157-43b1-b31d-acc7dbea8874 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:19.506719 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 921/1833] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:46:19 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:46:19.510385 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63030de-4b0f-46a0-8e09-7fa5dd4fdc81 None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:19.568187 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63030de-4b0f-46a0-8e09-7fa5dd4fdc81 None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:19.611306 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdf1e2d-8157-43b1-b31d-acc7dbea8874 admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:19.622798 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ab4bdb-8d90-4f54-9e73-53c5c2c493a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:19.623448 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ab4bdb-8d90-4f54-9e73-53c5c2c493a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:19.624251 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ab4bdb-8d90-4f54-9e73-53c5c2c493a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:19.624668 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ab4bdb-8d90-4f54-9e73-53c5c2c493a6 admin admin] PATH_INFO: `/v3/projects/1fb82c0d8ea941d9855b531da1d4dd2e` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:19.626925 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ab4bdb-8d90-4f54-9e73-53c5c2c493a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1fb82c0d8ea941d9855b531da1d4dd2e)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:19.633569 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ab4bdb-8d90-4f54-9e73-53c5c2c493a6 admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:19.678149 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:46:19.717908 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e408305-a687-48e4-925d-091b771a794b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:19.718563 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e408305-a687-48e4-925d-091b771a794b admin admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:19.718839 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e408305-a687-48e4-925d-091b771a794b admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:19.719111 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e408305-a687-48e4-925d-091b771a794b admin admin] PATH_INFO: `/v3/roles` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:19.719834 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e408305-a687-48e4-925d-091b771a794b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:19.727682 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e408305-a687-48e4-925d-091b771a794b admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:19.739143 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-67ab4bdb-8d90-4f54-9e73-53c5c2c493a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1fb82c0d8ea941d9855b531da1d4dd2e', 'request_id': 'req-67ab4bdb-8d90-4f54-9e73-53c5c2c493a6'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:19.753435 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-67ab4bdb-8d90-4f54-9e73-53c5c2c493a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1fb82c0d8ea941d9855b531da1d4dd2e', 'request_id': 'req-67ab4bdb-8d90-4f54-9e73-53c5c2c493a6'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:19.758133 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 922/1834] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Aug 24 05:46:19 2022] GET /identity/v3/roles => generated 1420 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:46:19.759314 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e408305-a687-48e4-925d-091b771a794b admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:19.771783 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-67ab4bdb-8d90-4f54-9e73-53c5c2c493a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1fb82c0d8ea941d9855b531da1d4dd2e', 'request_id': 'req-67ab4bdb-8d90-4f54-9e73-53c5c2c493a6'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:19.776375 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-1e408305-a687-48e4-925d-091b771a794b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:19.799779 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-67ab4bdb-8d90-4f54-9e73-53c5c2c493a6 admin admin] The token cache is being invalidate because project 1fb82c0d8ea941d9855b531da1d4dd2e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88112) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:46:19.800076 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-67ab4bdb-8d90-4f54-9e73-53c5c2c493a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:19.801484 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-67ab4bdb-8d90-4f54-9e73-53c5c2c493a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:19.804825 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 913/1835] 10.222.0.26 () {58 vars in 1233 bytes} [Wed Aug 24 05:46:19 2022] DELETE /identity/v3/projects/1fb82c0d8ea941d9855b531da1d4dd2e => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:46:19.806502 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ab4bdb-8d90-4f54-9e73-53c5c2c493a6 admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:19.811722 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-67ab4bdb-8d90-4f54-9e73-53c5c2c493a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:19.943310 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:46:19.990200 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ab4bdb-8d90-4f54-9e73-53c5c2c493a6 admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:19.996371 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e408305-a687-48e4-925d-091b771a794b admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:19.998792 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a378a05f-69c5-445c-b07b-32f75e364537 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:19.999464 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a378a05f-69c5-445c-b07b-32f75e364537 admin admin] REQUEST_METHOD: `PUT` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:19.999753 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a378a05f-69c5-445c-b07b-32f75e364537 admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:20.000131 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a378a05f-69c5-445c-b07b-32f75e364537 admin admin] PATH_INFO: `/v3/projects/7559e9a56f3b4e48a5b2c964f6bd093c/users/412d90fec0a24d738bdd66d2e67568ec/roles/640bda0879494e60b72680ee505285f0` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:20.002789 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a378a05f-69c5-445c-b07b-32f75e364537 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7559e9a56f3b4e48a5b2c964f6bd093c, user_id=412d90fec0a24d738bdd66d2e67568ec, role_id=640bda0879494e60b72680ee505285f0)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:20.005456 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a378a05f-69c5-445c-b07b-32f75e364537 admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:20.040460 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 914/1836] 10.222.0.26 () {60 vars in 1483 bytes} [Wed Aug 24 05:46:19 2022] PUT /identity/v3/projects/7559e9a56f3b4e48a5b2c964f6bd093c/users/412d90fec0a24d738bdd66d2e67568ec/roles/640bda0879494e60b72680ee505285f0 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:46:20.040460 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a378a05f-69c5-445c-b07b-32f75e364537 admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:20.043256 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-a378a05f-69c5-445c-b07b-32f75e364537 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:20.104205 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acc60bc-fdcc-4860-8054-e1291d8751a1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87ff96222a7c4baea31fc1bebf4d89a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:20.105058 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acc60bc-fdcc-4860-8054-e1291d8751a1 service swift] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:20.105467 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acc60bc-fdcc-4860-8054-e1291d8751a1 service swift] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:20.105877 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acc60bc-fdcc-4860-8054-e1291d8751a1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:20.108224 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-6acc60bc-fdcc-4860-8054-e1291d8751a1 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:20.172651 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a378a05f-69c5-445c-b07b-32f75e364537 admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:20.177472 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acc60bc-fdcc-4860-8054-e1291d8751a1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:20.180374 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acc60bc-fdcc-4860-8054-e1291d8751a1 service swift] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:20.182135 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231fa11c-ee73-400f-baba-667f148c1e2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:20.183319 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231fa11c-ee73-400f-baba-667f148c1e2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:20.184825 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231fa11c-ee73-400f-baba-667f148c1e2d admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:20.185552 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231fa11c-ee73-400f-baba-667f148c1e2d admin admin] PATH_INFO: `/v3/users/d0c08085532b4302b5775cba89b1f598` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:20.189827 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231fa11c-ee73-400f-baba-667f148c1e2d admin admin] RBAC: Authorizing `identity:delete_user(user_id=d0c08085532b4302b5775cba89b1f598)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:20.193517 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231fa11c-ee73-400f-baba-667f148c1e2d admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:20.217159 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 923/1837] 10.222.0.26 () {60 vars in 1384 bytes} [Wed Aug 24 05:46:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 457 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 05:46:20.218968 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acc60bc-fdcc-4860-8054-e1291d8751a1 service swift] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:20.220166 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-6acc60bc-fdcc-4860-8054-e1291d8751a1 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:20.272389 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acc60bc-fdcc-4860-8054-e1291d8751a1 service swift] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:20.284126 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068314f5-4f09-4c03-8fb4-544878b371d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:20.284781 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068314f5-4f09-4c03-8fb4-544878b371d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:20.285057 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068314f5-4f09-4c03-8fb4-544878b371d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:20.285325 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068314f5-4f09-4c03-8fb4-544878b371d0 admin admin] PATH_INFO: `/v3/users/97b9ee0d085a4b4ca20cdce1ba81e663` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:20.292217 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068314f5-4f09-4c03-8fb4-544878b371d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=97b9ee0d085a4b4ca20cdce1ba81e663)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:20.293291 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068314f5-4f09-4c03-8fb4-544878b371d0 admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:20.392437 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:46:20.399606 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-231fa11c-ee73-400f-baba-667f148c1e2d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd0c08085532b4302b5775cba89b1f598'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:20.418583 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-231fa11c-ee73-400f-baba-667f148c1e2d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd0c08085532b4302b5775cba89b1f598'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:20.438914 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-068314f5-4f09-4c03-8fb4-544878b371d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '97b9ee0d085a4b4ca20cdce1ba81e663'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:20.444720 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-231fa11c-ee73-400f-baba-667f148c1e2d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd0c08085532b4302b5775cba89b1f598'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:20.468611 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-231fa11c-ee73-400f-baba-667f148c1e2d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd0c08085532b4302b5775cba89b1f598'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:20.469913 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-231fa11c-ee73-400f-baba-667f148c1e2d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd0c08085532b4302b5775cba89b1f598'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:20.471442 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-068314f5-4f09-4c03-8fb4-544878b371d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '97b9ee0d085a4b4ca20cdce1ba81e663'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:20.476307 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-068314f5-4f09-4c03-8fb4-544878b371d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '97b9ee0d085a4b4ca20cdce1ba81e663'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:20.492872 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 915/1838] 10.222.0.26 () {58 vars in 1224 bytes} [Wed Aug 24 05:46:20 2022] DELETE /identity/v3/users/d0c08085532b4302b5775cba89b1f598 => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:46:20.494628 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87179dc-4cfc-4b66-bfe6-084c069adf74 None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:20.495061 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87179dc-4cfc-4b66-bfe6-084c069adf74 None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:20.501579 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87179dc-4cfc-4b66-bfe6-084c069adf74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:20.571489 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-b87179dc-4cfc-4b66-bfe6-084c069adf74 None None] MFA Rules not processed for user `412d90fec0a24d738bdd66d2e67568ec`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:46:20.573469 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-b87179dc-4cfc-4b66-bfe6-084c069adf74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:20.583340 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-068314f5-4f09-4c03-8fb4-544878b371d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '97b9ee0d085a4b4ca20cdce1ba81e663'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:20.617127 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-068314f5-4f09-4c03-8fb4-544878b371d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '97b9ee0d085a4b4ca20cdce1ba81e663'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:20.654497 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 924/1839] 10.222.0.26 () {58 vars in 1224 bytes} [Wed Aug 24 05:46:20 2022] DELETE /identity/v3/users/97b9ee0d085a4b4ca20cdce1ba81e663 => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:46:20.659776 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49083423-54c7-4450-af3b-01d86020defd None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:20.659776 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49083423-54c7-4450-af3b-01d86020defd None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:20.660013 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49083423-54c7-4450-af3b-01d86020defd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:20.699508 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:46:20.750713 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-49083423-54c7-4450-af3b-01d86020defd None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:46:20.752733 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-49083423-54c7-4450-af3b-01d86020defd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:20.815492 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 916/1840] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:46:20 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 322 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:46:20.825357 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87179dc-4cfc-4b66-bfe6-084c069adf74 None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:20.844373 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-b87179dc-4cfc-4b66-bfe6-084c069adf74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:20.970563 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 925/1841] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:46:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:46:20.980159 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49083423-54c7-4450-af3b-01d86020defd None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:20.983575 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-49083423-54c7-4450-af3b-01d86020defd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:21.030469 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87179dc-4cfc-4b66-bfe6-084c069adf74 None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:21.038667 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c02270-719e-45a1-bee2-b3d69caf59d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:21.039215 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c02270-719e-45a1-bee2-b3d69caf59d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:21.039658 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c02270-719e-45a1-bee2-b3d69caf59d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:21.039943 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c02270-719e-45a1-bee2-b3d69caf59d2 admin admin] PATH_INFO: `/v3/users/07b6e94ae3094727a226c8887cfc041e` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:21.046233 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c02270-719e-45a1-bee2-b3d69caf59d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=07b6e94ae3094727a226c8887cfc041e)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:21.048152 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c02270-719e-45a1-bee2-b3d69caf59d2 admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:21.141854 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-32c02270-719e-45a1-bee2-b3d69caf59d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '07b6e94ae3094727a226c8887cfc041e'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:21.143457 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:46:21.168275 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-32c02270-719e-45a1-bee2-b3d69caf59d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '07b6e94ae3094727a226c8887cfc041e'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:21.193054 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-32c02270-719e-45a1-bee2-b3d69caf59d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '07b6e94ae3094727a226c8887cfc041e'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:21.208179 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-32c02270-719e-45a1-bee2-b3d69caf59d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '07b6e94ae3094727a226c8887cfc041e'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:21.208914 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-32c02270-719e-45a1-bee2-b3d69caf59d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '07b6e94ae3094727a226c8887cfc041e'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:21.219461 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 917/1842] 10.222.0.26 () {58 vars in 1224 bytes} [Wed Aug 24 05:46:20 2022] DELETE /identity/v3/users/07b6e94ae3094727a226c8887cfc041e => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:46:21.220375 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c02270-719e-45a1-bee2-b3d69caf59d2 admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:21.225174 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-32c02270-719e-45a1-bee2-b3d69caf59d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:21.320229 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49083423-54c7-4450-af3b-01d86020defd None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:21.406155 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c02270-719e-45a1-bee2-b3d69caf59d2 admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:21.419284 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da3782d-ad52-4b27-9bd3-224a85c098bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '874348b647194ac2b5ecbf12c33bf59e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:21.430919 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da3782d-ad52-4b27-9bd3-224a85c098bb service neutron] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:21.431388 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da3782d-ad52-4b27-9bd3-224a85c098bb service neutron] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:21.431508 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da3782d-ad52-4b27-9bd3-224a85c098bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:21.433506 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-3da3782d-ad52-4b27-9bd3-224a85c098bb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:21.556688 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25cfc4d-01ac-4267-9400-51d3da696335 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17b450afe795495680fc70f522c83750', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:21.558729 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25cfc4d-01ac-4267-9400-51d3da696335 service cinder] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:21.559207 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25cfc4d-01ac-4267-9400-51d3da696335 service cinder] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:21.559686 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25cfc4d-01ac-4267-9400-51d3da696335 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:21.568523 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-d25cfc4d-01ac-4267-9400-51d3da696335 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:21.609440 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da3782d-ad52-4b27-9bd3-224a85c098bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:21.615756 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da3782d-ad52-4b27-9bd3-224a85c098bb service neutron] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:21.656364 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 918/1843] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 24 05:46:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:46:21.662799 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fb428c-37d0-4c85-82a8-bc66ce9cefb1 None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:21.663204 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fb428c-37d0-4c85-82a8-bc66ce9cefb1 None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:21.665175 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fb428c-37d0-4c85-82a8-bc66ce9cefb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:21.717058 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-b2fb428c-37d0-4c85-82a8-bc66ce9cefb1 None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:46:21.734639 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25cfc4d-01ac-4267-9400-51d3da696335 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:21.735590 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-b2fb428c-37d0-4c85-82a8-bc66ce9cefb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:21.738304 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25cfc4d-01ac-4267-9400-51d3da696335 service cinder] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:21.755239 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 919/1844] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:46:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:46:21.770770 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 926/1845] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 24 05:46:20 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 800 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:46:21.777917 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fb428c-37d0-4c85-82a8-bc66ce9cefb1 None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:21.823188 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fb428c-37d0-4c85-82a8-bc66ce9cefb1 None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:21.840361 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f349d3b1-9aaa-42d9-b7f5-84db02360a69 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '874348b647194ac2b5ecbf12c33bf59e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:21.841218 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f349d3b1-9aaa-42d9-b7f5-84db02360a69 service neutron] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:21.842300 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f349d3b1-9aaa-42d9-b7f5-84db02360a69 service neutron] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:21.842575 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f349d3b1-9aaa-42d9-b7f5-84db02360a69 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:21.845663 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25cfc4d-01ac-4267-9400-51d3da696335 service cinder] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:21.848609 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-d25cfc4d-01ac-4267-9400-51d3da696335 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:21.868272 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25cfc4d-01ac-4267-9400-51d3da696335 service cinder] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:21.879914 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f349d3b1-9aaa-42d9-b7f5-84db02360a69 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:21.882901 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f349d3b1-9aaa-42d9-b7f5-84db02360a69 service neutron] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:21.885180 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c583a2-bbab-43ed-b9f2-bb8a99accde0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:21.885878 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c583a2-bbab-43ed-b9f2-bb8a99accde0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:21.886237 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c583a2-bbab-43ed-b9f2-bb8a99accde0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:21.886588 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c583a2-bbab-43ed-b9f2-bb8a99accde0 admin admin] PATH_INFO: `/v3/users/fdd42423de5e4ae1a50dc2a1b8a6c2f2` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:21.889685 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c583a2-bbab-43ed-b9f2-bb8a99accde0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fdd42423de5e4ae1a50dc2a1b8a6c2f2)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:21.895341 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c583a2-bbab-43ed-b9f2-bb8a99accde0 admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:21.930837 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:46:21.934458 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 920/1846] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 24 05:46:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:46:22.059081 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-59c583a2-bbab-43ed-b9f2-bb8a99accde0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fdd42423de5e4ae1a50dc2a1b8a6c2f2'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:22.082737 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-59c583a2-bbab-43ed-b9f2-bb8a99accde0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fdd42423de5e4ae1a50dc2a1b8a6c2f2'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:22.084374 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-59c583a2-bbab-43ed-b9f2-bb8a99accde0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fdd42423de5e4ae1a50dc2a1b8a6c2f2'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:22.139027 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-59c583a2-bbab-43ed-b9f2-bb8a99accde0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fdd42423de5e4ae1a50dc2a1b8a6c2f2'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:22.158185 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-59c583a2-bbab-43ed-b9f2-bb8a99accde0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fdd42423de5e4ae1a50dc2a1b8a6c2f2'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:22.171655 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 927/1847] 10.222.0.26 () {58 vars in 1224 bytes} [Wed Aug 24 05:46:21 2022] DELETE /identity/v3/users/fdd42423de5e4ae1a50dc2a1b8a6c2f2 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:46:22.177283 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4808168a-6f45-4496-9199-a354373d9b7c None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:22.177669 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4808168a-6f45-4496-9199-a354373d9b7c None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:22.178067 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4808168a-6f45-4496-9199-a354373d9b7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:22.220985 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-4808168a-6f45-4496-9199-a354373d9b7c None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:46:22.222443 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-4808168a-6f45-4496-9199-a354373d9b7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:22.353368 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:46:22.421306 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 921/1848] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:46:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:46:22.491654 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c583a2-bbab-43ed-b9f2-bb8a99accde0 admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:22.493325 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-59c583a2-bbab-43ed-b9f2-bb8a99accde0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:22.722119 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c583a2-bbab-43ed-b9f2-bb8a99accde0 admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:22.729465 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab6a32e-308b-480b-8d3a-acb54b752068 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '874348b647194ac2b5ecbf12c33bf59e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:22.730499 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab6a32e-308b-480b-8d3a-acb54b752068 service neutron] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:22.730868 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab6a32e-308b-480b-8d3a-acb54b752068 service neutron] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:22.731151 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab6a32e-308b-480b-8d3a-acb54b752068 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:22.748875 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab6a32e-308b-480b-8d3a-acb54b752068 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:22.751611 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab6a32e-308b-480b-8d3a-acb54b752068 service neutron] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:22.767629 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 928/1849] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 24 05:46:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:46:22.811794 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4808168a-6f45-4496-9199-a354373d9b7c None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:22.813246 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-4808168a-6f45-4496-9199-a354373d9b7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:22.846214 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab6a32e-308b-480b-8d3a-acb54b752068 service neutron] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:22.847448 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4808168a-6f45-4496-9199-a354373d9b7c None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:22.847934 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-8ab6a32e-308b-480b-8d3a-acb54b752068 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:22.875518 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9ac0c4-7523-4e26-b434-c700444aee00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:22.876191 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9ac0c4-7523-4e26-b434-c700444aee00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:22.876475 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9ac0c4-7523-4e26-b434-c700444aee00 admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:22.876742 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9ac0c4-7523-4e26-b434-c700444aee00 admin admin] PATH_INFO: `/v3/projects/f04220a3f6bf4758b81f7724a73bddc4` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:22.888125 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab6a32e-308b-480b-8d3a-acb54b752068 service neutron] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:22.894360 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9ac0c4-7523-4e26-b434-c700444aee00 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f04220a3f6bf4758b81f7724a73bddc4)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:22.896327 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9ac0c4-7523-4e26-b434-c700444aee00 admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:22.920769 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c60da1-f7e0-4773-ac48-dcdd8ccb6bf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:22.921425 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c60da1-f7e0-4773-ac48-dcdd8ccb6bf9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:22.922148 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c60da1-f7e0-4773-ac48-dcdd8ccb6bf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:22.922432 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c60da1-f7e0-4773-ac48-dcdd8ccb6bf9 admin admin] PATH_INFO: `/v3/projects/599d6455b2744bbd8066103e7e697c5b` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:22.924354 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c60da1-f7e0-4773-ac48-dcdd8ccb6bf9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=599d6455b2744bbd8066103e7e697c5b)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:22.928216 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c60da1-f7e0-4773-ac48-dcdd8ccb6bf9 admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:23.043326 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-0b9ac0c4-7523-4e26-b434-c700444aee00 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f04220a3f6bf4758b81f7724a73bddc4', 'request_id': 'req-0b9ac0c4-7523-4e26-b434-c700444aee00'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:23.058018 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-0b9ac0c4-7523-4e26-b434-c700444aee00 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f04220a3f6bf4758b81f7724a73bddc4', 'request_id': 'req-0b9ac0c4-7523-4e26-b434-c700444aee00'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:23.068818 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-0b9ac0c4-7523-4e26-b434-c700444aee00 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f04220a3f6bf4758b81f7724a73bddc4', 'request_id': 'req-0b9ac0c4-7523-4e26-b434-c700444aee00'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:23.096332 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-0b9ac0c4-7523-4e26-b434-c700444aee00 admin admin] The token cache is being invalidate because project f04220a3f6bf4758b81f7724a73bddc4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88112) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:46:23.096634 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-0b9ac0c4-7523-4e26-b434-c700444aee00 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:23.097333 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-0b9ac0c4-7523-4e26-b434-c700444aee00 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:23.102658 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 922/1850] 10.222.0.26 () {58 vars in 1233 bytes} [Wed Aug 24 05:46:22 2022] DELETE /identity/v3/projects/f04220a3f6bf4758b81f7724a73bddc4 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:46:23.112761 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddf5563-f41c-4471-b430-d9576f4247ea None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:23.112980 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddf5563-f41c-4471-b430-d9576f4247ea None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:23.113314 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddf5563-f41c-4471-b430-d9576f4247ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:23.155264 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-26c60da1-f7e0-4773-ac48-dcdd8ccb6bf9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '599d6455b2744bbd8066103e7e697c5b', 'request_id': 'req-26c60da1-f7e0-4773-ac48-dcdd8ccb6bf9'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:23.159379 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-0ddf5563-f41c-4471-b430-d9576f4247ea None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:46:23.164691 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-0ddf5563-f41c-4471-b430-d9576f4247ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:23.180451 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-26c60da1-f7e0-4773-ac48-dcdd8ccb6bf9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '599d6455b2744bbd8066103e7e697c5b', 'request_id': 'req-26c60da1-f7e0-4773-ac48-dcdd8ccb6bf9'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:23.195417 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-26c60da1-f7e0-4773-ac48-dcdd8ccb6bf9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '599d6455b2744bbd8066103e7e697c5b', 'request_id': 'req-26c60da1-f7e0-4773-ac48-dcdd8ccb6bf9'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:23.233041 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-26c60da1-f7e0-4773-ac48-dcdd8ccb6bf9 admin admin] The token cache is being invalidate because project 599d6455b2744bbd8066103e7e697c5b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:46:23.233751 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-26c60da1-f7e0-4773-ac48-dcdd8ccb6bf9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:23.235531 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-26c60da1-f7e0-4773-ac48-dcdd8ccb6bf9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:23.240725 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 929/1851] 10.222.0.26 () {58 vars in 1233 bytes} [Wed Aug 24 05:46:22 2022] DELETE /identity/v3/projects/599d6455b2744bbd8066103e7e697c5b => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 05:46:23.242832 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55b17bb-1b0d-49e4-b76e-6d31ac75c756 None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:23.243233 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55b17bb-1b0d-49e4-b76e-6d31ac75c756 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:23.243748 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55b17bb-1b0d-49e4-b76e-6d31ac75c756 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:23.329801 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-e55b17bb-1b0d-49e4-b76e-6d31ac75c756 None None] MFA Rules not processed for user `874348b647194ac2b5ecbf12c33bf59e`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:46:23.331506 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-e55b17bb-1b0d-49e4-b76e-6d31ac75c756 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:23.344281 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:46:23.399608 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 923/1852] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:46:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:46:23.401098 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddf5563-f41c-4471-b430-d9576f4247ea None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:23.414346 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-0ddf5563-f41c-4471-b430-d9576f4247ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:23.450487 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddf5563-f41c-4471-b430-d9576f4247ea None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:23.467453 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a204cdaa-75e8-4e4c-bddd-b8e7895373da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:23.468250 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a204cdaa-75e8-4e4c-bddd-b8e7895373da admin admin] REQUEST_METHOD: `DELETE` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:23.468624 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a204cdaa-75e8-4e4c-bddd-b8e7895373da admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:23.468980 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a204cdaa-75e8-4e4c-bddd-b8e7895373da admin admin] PATH_INFO: `/v3/users/1346a6e3134c4198adef5c12eb625806` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:23.470409 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a204cdaa-75e8-4e4c-bddd-b8e7895373da admin admin] RBAC: Authorizing `identity:delete_user(user_id=1346a6e3134c4198adef5c12eb625806)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:23.472561 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a204cdaa-75e8-4e4c-bddd-b8e7895373da admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:23.509015 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 930/1853] 10.222.0.17 () {58 vars in 1015 bytes} [Wed Aug 24 05:46:23 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:46:23.512953 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c42b1c-2cbe-4cbe-9a3d-5ed6e2b0dc12 None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:23.514168 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c42b1c-2cbe-4cbe-9a3d-5ed6e2b0dc12 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:23.514655 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c42b1c-2cbe-4cbe-9a3d-5ed6e2b0dc12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:23.584541 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-02c42b1c-2cbe-4cbe-9a3d-5ed6e2b0dc12 None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:46:23.584541 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-02c42b1c-2cbe-4cbe-9a3d-5ed6e2b0dc12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:23.640173 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-a204cdaa-75e8-4e4c-bddd-b8e7895373da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1346a6e3134c4198adef5c12eb625806'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:23.641577 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 931/1854] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:46:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:46:23.643412 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c42b1c-2cbe-4cbe-9a3d-5ed6e2b0dc12 None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:23.653238 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-02c42b1c-2cbe-4cbe-9a3d-5ed6e2b0dc12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:23.677377 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-a204cdaa-75e8-4e4c-bddd-b8e7895373da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1346a6e3134c4198adef5c12eb625806'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:23.688984 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c42b1c-2cbe-4cbe-9a3d-5ed6e2b0dc12 None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:23.700711 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb88b21-d1b9-4692-a19a-8c91f5d31c45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:23.702660 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-a204cdaa-75e8-4e4c-bddd-b8e7895373da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1346a6e3134c4198adef5c12eb625806'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:23.703231 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb88b21-d1b9-4692-a19a-8c91f5d31c45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:23.703629 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb88b21-d1b9-4692-a19a-8c91f5d31c45 admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:23.705327 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb88b21-d1b9-4692-a19a-8c91f5d31c45 admin admin] PATH_INFO: `/v3/projects/32ba5582d05a41949c1c910ebdf9b5e5` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:23.705558 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:46:23.708536 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb88b21-d1b9-4692-a19a-8c91f5d31c45 admin admin] RBAC: Authorizing `identity:delete_project(project_id=32ba5582d05a41949c1c910ebdf9b5e5)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:23.712462 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb88b21-d1b9-4692-a19a-8c91f5d31c45 admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:23.719777 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-a204cdaa-75e8-4e4c-bddd-b8e7895373da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1346a6e3134c4198adef5c12eb625806'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:23.721185 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-a204cdaa-75e8-4e4c-bddd-b8e7895373da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1346a6e3134c4198adef5c12eb625806'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:23.735579 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 924/1855] 10.222.0.26 () {58 vars in 1224 bytes} [Wed Aug 24 05:46:23 2022] DELETE /identity/v3/users/1346a6e3134c4198adef5c12eb625806 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:46:23.738096 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a204cdaa-75e8-4e4c-bddd-b8e7895373da admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:23.744928 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-a204cdaa-75e8-4e4c-bddd-b8e7895373da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:23.902348 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-beb88b21-d1b9-4692-a19a-8c91f5d31c45 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32ba5582d05a41949c1c910ebdf9b5e5', 'request_id': 'req-beb88b21-d1b9-4692-a19a-8c91f5d31c45'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:23.930473 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-beb88b21-d1b9-4692-a19a-8c91f5d31c45 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32ba5582d05a41949c1c910ebdf9b5e5', 'request_id': 'req-beb88b21-d1b9-4692-a19a-8c91f5d31c45'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:23.946899 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a204cdaa-75e8-4e4c-bddd-b8e7895373da admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:23.949539 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-beb88b21-d1b9-4692-a19a-8c91f5d31c45 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32ba5582d05a41949c1c910ebdf9b5e5', 'request_id': 'req-beb88b21-d1b9-4692-a19a-8c91f5d31c45'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:23.984645 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-beb88b21-d1b9-4692-a19a-8c91f5d31c45 admin admin] The token cache is being invalidate because project 32ba5582d05a41949c1c910ebdf9b5e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:46:23.985443 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-beb88b21-d1b9-4692-a19a-8c91f5d31c45 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:23.986752 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-beb88b21-d1b9-4692-a19a-8c91f5d31c45 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:23.993538 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 932/1856] 10.222.0.26 () {58 vars in 1233 bytes} [Wed Aug 24 05:46:23 2022] DELETE /identity/v3/projects/32ba5582d05a41949c1c910ebdf9b5e5 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:46:23.997244 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb88b21-d1b9-4692-a19a-8c91f5d31c45 admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:24.005747 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-beb88b21-d1b9-4692-a19a-8c91f5d31c45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:24.096668 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79dded8-329e-4427-b156-eddedb45ab73 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '874348b647194ac2b5ecbf12c33bf59e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:24.097592 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79dded8-329e-4427-b156-eddedb45ab73 service neutron] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:24.097839 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79dded8-329e-4427-b156-eddedb45ab73 service neutron] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:24.098201 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79dded8-329e-4427-b156-eddedb45ab73 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:24.100869 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-d79dded8-329e-4427-b156-eddedb45ab73 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:24.115779 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79dded8-329e-4427-b156-eddedb45ab73 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:24.120299 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79dded8-329e-4427-b156-eddedb45ab73 service neutron] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:24.144412 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 925/1857] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 24 05:46:23 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:46:24.146303 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79dded8-329e-4427-b156-eddedb45ab73 service neutron] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:24.149325 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-d79dded8-329e-4427-b156-eddedb45ab73 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:24.165094 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb88b21-d1b9-4692-a19a-8c91f5d31c45 admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:24.170698 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c549d2-6efd-40b2-8458-ba0b75cdd8e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:24.171342 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c549d2-6efd-40b2-8458-ba0b75cdd8e1 admin admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:24.171617 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c549d2-6efd-40b2-8458-ba0b75cdd8e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:24.171893 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c549d2-6efd-40b2-8458-ba0b75cdd8e1 admin admin] PATH_INFO: `/v3/domains` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:24.172701 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c549d2-6efd-40b2-8458-ba0b75cdd8e1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:46:24.173016 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c549d2-6efd-40b2-8458-ba0b75cdd8e1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:24.174783 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c549d2-6efd-40b2-8458-ba0b75cdd8e1 admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:24.189527 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 933/1858] 10.222.0.26 () {58 vars in 1153 bytes} [Wed Aug 24 05:46:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:46:24.190490 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c549d2-6efd-40b2-8458-ba0b75cdd8e1 admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:24.197766 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-60c549d2-6efd-40b2-8458-ba0b75cdd8e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:24.200010 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79dded8-329e-4427-b156-eddedb45ab73 service neutron] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:24.210234 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d00313-a7ea-4266-88a1-9a132d63b139 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:24.211577 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d00313-a7ea-4266-88a1-9a132d63b139 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:24.212245 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d00313-a7ea-4266-88a1-9a132d63b139 admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:24.212760 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d00313-a7ea-4266-88a1-9a132d63b139 admin admin] PATH_INFO: `/v3/users/edb9a254c41b43428c5d7da0a5e7f786` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:24.214592 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d00313-a7ea-4266-88a1-9a132d63b139 admin admin] RBAC: Authorizing `identity:delete_user(user_id=edb9a254c41b43428c5d7da0a5e7f786)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:24.218267 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c549d2-6efd-40b2-8458-ba0b75cdd8e1 admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:24.220068 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d00313-a7ea-4266-88a1-9a132d63b139 admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:24.222797 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f3b41a-916f-4365-96b6-f28e84977547 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '874348b647194ac2b5ecbf12c33bf59e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:24.223413 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f3b41a-916f-4365-96b6-f28e84977547 service neutron] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:24.223694 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f3b41a-916f-4365-96b6-f28e84977547 service neutron] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:24.224109 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f3b41a-916f-4365-96b6-f28e84977547 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:24.232760 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f3b41a-916f-4365-96b6-f28e84977547 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:24.234467 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f3b41a-916f-4365-96b6-f28e84977547 service neutron] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:24.243369 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 934/1859] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 24 05:46:24 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:46:24.244497 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f3b41a-916f-4365-96b6-f28e84977547 service neutron] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:24.256323 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f3b41a-916f-4365-96b6-f28e84977547 service neutron] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:24.261378 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d6499e-c307-4267-9b14-4520d86bcab3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:24.261995 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d6499e-c307-4267-9b14-4520d86bcab3 admin admin] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:24.262294 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d6499e-c307-4267-9b14-4520d86bcab3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:24.262562 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d6499e-c307-4267-9b14-4520d86bcab3 admin admin] PATH_INFO: `/v3/projects` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:24.263601 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d6499e-c307-4267-9b14-4520d86bcab3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:24.265528 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d6499e-c307-4267-9b14-4520d86bcab3 admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:24.283409 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:46:24.305436 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 935/1860] 10.222.0.26 () {60 vars in 1153 bytes} [Wed Aug 24 05:46:24 2022] POST /identity/v3/projects => generated 401 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:46:24.310262 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d6499e-c307-4267-9b14-4520d86bcab3 admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:24.325385 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-a1d00313-a7ea-4266-88a1-9a132d63b139 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'edb9a254c41b43428c5d7da0a5e7f786'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:24.347223 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-a1d00313-a7ea-4266-88a1-9a132d63b139 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'edb9a254c41b43428c5d7da0a5e7f786'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:24.377594 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-a1d00313-a7ea-4266-88a1-9a132d63b139 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'edb9a254c41b43428c5d7da0a5e7f786'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:24.392476 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-a1d00313-a7ea-4266-88a1-9a132d63b139 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'edb9a254c41b43428c5d7da0a5e7f786'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:24.393470 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-a1d00313-a7ea-4266-88a1-9a132d63b139 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'edb9a254c41b43428c5d7da0a5e7f786'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:24.402851 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 926/1861] 10.222.0.26 () {58 vars in 1224 bytes} [Wed Aug 24 05:46:24 2022] DELETE /identity/v3/users/edb9a254c41b43428c5d7da0a5e7f786 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:46:24.454883 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d6499e-c307-4267-9b14-4520d86bcab3 admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:24.598759 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efd2c81-8580-4da9-973e-a8a687758b65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:24.602543 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efd2c81-8580-4da9-973e-a8a687758b65 admin admin] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:24.602958 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efd2c81-8580-4da9-973e-a8a687758b65 admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:24.603242 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efd2c81-8580-4da9-973e-a8a687758b65 admin admin] PATH_INFO: `/v3/users` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:24.604232 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efd2c81-8580-4da9-973e-a8a687758b65 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:24.608443 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efd2c81-8580-4da9-973e-a8a687758b65 admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:24.681974 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d00313-a7ea-4266-88a1-9a132d63b139 admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:24.683599 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 936/1862] 10.222.0.26 () {60 vars in 1144 bytes} [Wed Aug 24 05:46:24 2022] POST /identity/v3/users => generated 301 bytes in 374 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:46:24.684377 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-a1d00313-a7ea-4266-88a1-9a132d63b139 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:24.714088 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d00313-a7ea-4266-88a1-9a132d63b139 admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:24.727588 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d29ded-5ff1-49b3-971b-f257b5a250fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:24.728456 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d29ded-5ff1-49b3-971b-f257b5a250fd admin admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:24.728960 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d29ded-5ff1-49b3-971b-f257b5a250fd admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:24.729313 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d29ded-5ff1-49b3-971b-f257b5a250fd admin admin] PATH_INFO: `/v3/roles` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:24.730253 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d29ded-5ff1-49b3-971b-f257b5a250fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:24.732447 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d29ded-5ff1-49b3-971b-f257b5a250fd admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:24.753933 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 927/1863] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Aug 24 05:46:24 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 05:46:24.759194 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efd2c81-8580-4da9-973e-a8a687758b65 admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:24.772149 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efd2c81-8580-4da9-973e-a8a687758b65 admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:24.781503 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a84c456-4861-47ad-a456-214189c9a2bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:24.785358 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a84c456-4861-47ad-a456-214189c9a2bc admin admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:24.785753 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a84c456-4861-47ad-a456-214189c9a2bc admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:24.786147 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a84c456-4861-47ad-a456-214189c9a2bc admin admin] PATH_INFO: `/v3/roles` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:24.787079 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a84c456-4861-47ad-a456-214189c9a2bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:24.795744 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a84c456-4861-47ad-a456-214189c9a2bc admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:24.824662 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 937/1864] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Aug 24 05:46:24 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:46:24.828770 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d29ded-5ff1-49b3-971b-f257b5a250fd admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:24.840858 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d29ded-5ff1-49b3-971b-f257b5a250fd admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:24.849448 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a84c456-4861-47ad-a456-214189c9a2bc admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:24.851328 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-5a84c456-4861-47ad-a456-214189c9a2bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:24.860840 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f38cd4-b4ed-4490-b280-eac4aa464282 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:24.861613 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f38cd4-b4ed-4490-b280-eac4aa464282 admin admin] REQUEST_METHOD: `PUT` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:24.862617 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f38cd4-b4ed-4490-b280-eac4aa464282 admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:24.862617 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f38cd4-b4ed-4490-b280-eac4aa464282 admin admin] PATH_INFO: `/v3/projects/d306a792d1c7437ca3019198bb59dce2/users/b4c778efce634b6e83e08074cee24bea/roles/f7aa4a2c74c94c1b9ca8ecdcccccda5c` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:24.879549 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a84c456-4861-47ad-a456-214189c9a2bc admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:24.884432 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:INSERT=2,keystone:DELETE=11,keystone:SELECT=87 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:46:24.889724 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd76fff8-5a9f-4258-bda3-185a3ca45604 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:24.890626 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd76fff8-5a9f-4258-bda3-185a3ca45604 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:24.890890 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd76fff8-5a9f-4258-bda3-185a3ca45604 admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:24.892226 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd76fff8-5a9f-4258-bda3-185a3ca45604 admin admin] PATH_INFO: `/v3/projects/c9cc47ae87e24412bbd30b1b27994d29` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:24.894683 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd76fff8-5a9f-4258-bda3-185a3ca45604 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c9cc47ae87e24412bbd30b1b27994d29)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:24.897087 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f38cd4-b4ed-4490-b280-eac4aa464282 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d306a792d1c7437ca3019198bb59dce2, user_id=b4c778efce634b6e83e08074cee24bea, role_id=f7aa4a2c74c94c1b9ca8ecdcccccda5c)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:24.902636 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd76fff8-5a9f-4258-bda3-185a3ca45604 admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:24.905200 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f38cd4-b4ed-4490-b280-eac4aa464282 admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:24.932140 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 928/1865] 10.222.0.26 () {60 vars in 1483 bytes} [Wed Aug 24 05:46:24 2022] PUT /identity/v3/projects/d306a792d1c7437ca3019198bb59dce2/users/b4c778efce634b6e83e08074cee24bea/roles/f7aa4a2c74c94c1b9ca8ecdcccccda5c => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:46:24.943144 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817f5860-c06d-4a43-a6c3-04d6b907f265 None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:24.943515 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817f5860-c06d-4a43-a6c3-04d6b907f265 None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:24.943957 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817f5860-c06d-4a43-a6c3-04d6b907f265 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:25.020284 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-817f5860-c06d-4a43-a6c3-04d6b907f265 None None] MFA Rules not processed for user `b4c778efce634b6e83e08074cee24bea`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:46:25.021887 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-817f5860-c06d-4a43-a6c3-04d6b907f265 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:25.057629 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-bd76fff8-5a9f-4258-bda3-185a3ca45604 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c9cc47ae87e24412bbd30b1b27994d29', 'request_id': 'req-bd76fff8-5a9f-4258-bda3-185a3ca45604'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:25.069692 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-bd76fff8-5a9f-4258-bda3-185a3ca45604 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c9cc47ae87e24412bbd30b1b27994d29', 'request_id': 'req-bd76fff8-5a9f-4258-bda3-185a3ca45604'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:25.084879 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-bd76fff8-5a9f-4258-bda3-185a3ca45604 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c9cc47ae87e24412bbd30b1b27994d29', 'request_id': 'req-bd76fff8-5a9f-4258-bda3-185a3ca45604'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:25.101422 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-bd76fff8-5a9f-4258-bda3-185a3ca45604 admin admin] The token cache is being invalidate because project c9cc47ae87e24412bbd30b1b27994d29 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:46:25.103296 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-bd76fff8-5a9f-4258-bda3-185a3ca45604 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:25.104186 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-bd76fff8-5a9f-4258-bda3-185a3ca45604 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:25.108238 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 938/1866] 10.222.0.26 () {58 vars in 1233 bytes} [Wed Aug 24 05:46:24 2022] DELETE /identity/v3/projects/c9cc47ae87e24412bbd30b1b27994d29 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:46:25.115228 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e3503e-5c25-49e3-aadd-adb2a5769145 None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:25.115750 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e3503e-5c25-49e3-aadd-adb2a5769145 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:25.116130 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e3503e-5c25-49e3-aadd-adb2a5769145 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:25.166540 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:INSERT=5,keystone:SELECT=88,keystone:DELETE=7 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:46:25.185190 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-87e3503e-5c25-49e3-aadd-adb2a5769145 None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:46:25.187495 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-87e3503e-5c25-49e3-aadd-adb2a5769145 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:25.224486 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 929/1867] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:46:24 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:46:25.229217 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817f5860-c06d-4a43-a6c3-04d6b907f265 None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:25.232946 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-817f5860-c06d-4a43-a6c3-04d6b907f265 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:25.384896 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 939/1868] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:46:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:46:25.396967 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b49dd6-49b2-4593-853d-405e49c79bd7 None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:25.397239 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b49dd6-49b2-4593-853d-405e49c79bd7 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:25.397591 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b49dd6-49b2-4593-853d-405e49c79bd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:25.418582 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817f5860-c06d-4a43-a6c3-04d6b907f265 None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:25.425157 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced178d0-dd91-4efb-9ee3-00c4308e1af4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:25.426466 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced178d0-dd91-4efb-9ee3-00c4308e1af4 admin admin] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:25.427104 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced178d0-dd91-4efb-9ee3-00c4308e1af4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:25.428353 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced178d0-dd91-4efb-9ee3-00c4308e1af4 admin admin] PATH_INFO: `/v3/projects` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:25.429529 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced178d0-dd91-4efb-9ee3-00c4308e1af4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:25.432975 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced178d0-dd91-4efb-9ee3-00c4308e1af4 admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:25.443054 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-b2b49dd6-49b2-4593-853d-405e49c79bd7 None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:46:25.446961 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-b2b49dd6-49b2-4593-853d-405e49c79bd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:25.521977 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 930/1870] 10.222.0.26 () {60 vars in 1153 bytes} [Wed Aug 24 05:46:25 2022] POST /identity/v3/projects => generated 399 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:46:25.522202 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 940/1870] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:46:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 05:46:25.525294 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced178d0-dd91-4efb-9ee3-00c4308e1af4 admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:25.525650 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b49dd6-49b2-4593-853d-405e49c79bd7 None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:25.581332 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b49dd6-49b2-4593-853d-405e49c79bd7 None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:25.681766 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced178d0-dd91-4efb-9ee3-00c4308e1af4 admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:25.695294 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d125059d-c446-4d8b-897b-7a43af548995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:25.696415 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d125059d-c446-4d8b-897b-7a43af548995 admin admin] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:25.697514 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d125059d-c446-4d8b-897b-7a43af548995 admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:25.698349 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d125059d-c446-4d8b-897b-7a43af548995 admin admin] PATH_INFO: `/v3/users` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:25.699004 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d125059d-c446-4d8b-897b-7a43af548995 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:25.702283 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d125059d-c446-4d8b-897b-7a43af548995 admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:25.717292 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:46:25.752616 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fa4d3b-6ac6-4ed8-b597-f1a06b88ec8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:25.753626 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fa4d3b-6ac6-4ed8-b597-f1a06b88ec8f admin admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:25.754123 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fa4d3b-6ac6-4ed8-b597-f1a06b88ec8f admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:25.754643 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fa4d3b-6ac6-4ed8-b597-f1a06b88ec8f admin admin] PATH_INFO: `/v3/domains` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:25.755797 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fa4d3b-6ac6-4ed8-b597-f1a06b88ec8f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:46:25.761257 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fa4d3b-6ac6-4ed8-b597-f1a06b88ec8f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:25.764622 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fa4d3b-6ac6-4ed8-b597-f1a06b88ec8f admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:25.783098 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 931/1871] 10.222.0.26 () {60 vars in 1144 bytes} [Wed Aug 24 05:46:25 2022] POST /identity/v3/users => generated 306 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:46:25.786261 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d125059d-c446-4d8b-897b-7a43af548995 admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:25.804045 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 941/1872] 10.222.0.26 () {58 vars in 1153 bytes} [Wed Aug 24 05:46:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:46:25.804253 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-d125059d-c446-4d8b-897b-7a43af548995 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:25.814897 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fa4d3b-6ac6-4ed8-b597-f1a06b88ec8f admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:25.828996 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fa4d3b-6ac6-4ed8-b597-f1a06b88ec8f admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:25.835336 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f90664c-ef55-47ad-86f9-bbd8343792a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:25.836637 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f90664c-ef55-47ad-86f9-bbd8343792a1 admin admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:25.837218 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f90664c-ef55-47ad-86f9-bbd8343792a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:25.837642 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d125059d-c446-4d8b-897b-7a43af548995 admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:25.837925 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f90664c-ef55-47ad-86f9-bbd8343792a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:25.838866 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f90664c-ef55-47ad-86f9-bbd8343792a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:25.841928 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f90664c-ef55-47ad-86f9-bbd8343792a1 admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:25.852627 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e474bf53-fe80-43e8-96ca-c396458cda6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:25.853321 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e474bf53-fe80-43e8-96ca-c396458cda6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:25.853614 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e474bf53-fe80-43e8-96ca-c396458cda6b admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:25.863372 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e474bf53-fe80-43e8-96ca-c396458cda6b admin admin] PATH_INFO: `/v3/projects/a24339b26b074dd2995a9cefc33dbe6e` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:25.864197 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 942/1873] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Aug 24 05:46:25 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:46:25.864986 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e474bf53-fe80-43e8-96ca-c396458cda6b admin admin] RBAC: Authorizing `identity:delete_project(project_id=a24339b26b074dd2995a9cefc33dbe6e)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:25.865869 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f90664c-ef55-47ad-86f9-bbd8343792a1 admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:25.867045 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e474bf53-fe80-43e8-96ca-c396458cda6b admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:25.879560 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f90664c-ef55-47ad-86f9-bbd8343792a1 admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:25.902397 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef26eb3-e793-4977-b729-6e372c2f3611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:25.903514 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef26eb3-e793-4977-b729-6e372c2f3611 admin admin] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:25.904897 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef26eb3-e793-4977-b729-6e372c2f3611 admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:25.905359 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef26eb3-e793-4977-b729-6e372c2f3611 admin admin] PATH_INFO: `/v3/projects` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:25.906461 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef26eb3-e793-4977-b729-6e372c2f3611 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:25.908639 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef26eb3-e793-4977-b729-6e372c2f3611 admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:25.981660 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-e474bf53-fe80-43e8-96ca-c396458cda6b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a24339b26b074dd2995a9cefc33dbe6e', 'request_id': 'req-e474bf53-fe80-43e8-96ca-c396458cda6b'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:25.998121 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-e474bf53-fe80-43e8-96ca-c396458cda6b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a24339b26b074dd2995a9cefc33dbe6e', 'request_id': 'req-e474bf53-fe80-43e8-96ca-c396458cda6b'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:26.007800 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-e474bf53-fe80-43e8-96ca-c396458cda6b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a24339b26b074dd2995a9cefc33dbe6e', 'request_id': 'req-e474bf53-fe80-43e8-96ca-c396458cda6b'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:26.022578 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 943/1874] 10.222.0.26 () {60 vars in 1153 bytes} [Wed Aug 24 05:46:25 2022] POST /identity/v3/projects => generated 387 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:46:26.027714 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef26eb3-e793-4977-b729-6e372c2f3611 admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:26.032781 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-e474bf53-fe80-43e8-96ca-c396458cda6b admin admin] The token cache is being invalidate because project a24339b26b074dd2995a9cefc33dbe6e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88112) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:46:26.033408 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-e474bf53-fe80-43e8-96ca-c396458cda6b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:26.033787 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-e474bf53-fe80-43e8-96ca-c396458cda6b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:26.036520 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 932/1875] 10.222.0.26 () {58 vars in 1233 bytes} [Wed Aug 24 05:46:25 2022] DELETE /identity/v3/projects/a24339b26b074dd2995a9cefc33dbe6e => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:46:26.037379 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e474bf53-fe80-43e8-96ca-c396458cda6b admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:26.043139 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-e474bf53-fe80-43e8-96ca-c396458cda6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:26.176574 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e474bf53-fe80-43e8-96ca-c396458cda6b admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:26.309541 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceaac987-0608-456a-806d-e4abde6f4f37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:26.310756 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaac987-0608-456a-806d-e4abde6f4f37 admin admin] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:26.311039 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaac987-0608-456a-806d-e4abde6f4f37 admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:26.311314 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaac987-0608-456a-806d-e4abde6f4f37 admin admin] PATH_INFO: `/v3/users` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:26.312025 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceaac987-0608-456a-806d-e4abde6f4f37 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:26.313896 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceaac987-0608-456a-806d-e4abde6f4f37 admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:26.329569 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:46:26.347230 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef26eb3-e793-4977-b729-6e372c2f3611 admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:26.358806 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d09a1d-5f49-47c7-b86f-435fe2c61641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:26.360350 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d09a1d-5f49-47c7-b86f-435fe2c61641 admin admin] REQUEST_METHOD: `PUT` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:26.362535 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d09a1d-5f49-47c7-b86f-435fe2c61641 admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:26.363096 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d09a1d-5f49-47c7-b86f-435fe2c61641 admin admin] PATH_INFO: `/v3/projects/39dae25a5dce4ae9bb7625a674b678fd/users/9aae15e9d2f443018165e7297caa0424/roles/640bda0879494e60b72680ee505285f0` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:26.394657 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d09a1d-5f49-47c7-b86f-435fe2c61641 admin admin] RBAC: Authorizing `identity:create_grant(project_id=39dae25a5dce4ae9bb7625a674b678fd, user_id=9aae15e9d2f443018165e7297caa0424, role_id=640bda0879494e60b72680ee505285f0)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:26.399273 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d09a1d-5f49-47c7-b86f-435fe2c61641 admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:26.406071 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 933/1876] 10.222.0.26 () {60 vars in 1144 bytes} [Wed Aug 24 05:46:26 2022] POST /identity/v3/users => generated 294 bytes in 366 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:46:26.406071 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceaac987-0608-456a-806d-e4abde6f4f37 admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:26.416037 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-ceaac987-0608-456a-806d-e4abde6f4f37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:26.446398 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 944/1877] 10.222.0.26 () {60 vars in 1483 bytes} [Wed Aug 24 05:46:26 2022] PUT /identity/v3/projects/39dae25a5dce4ae9bb7625a674b678fd/users/9aae15e9d2f443018165e7297caa0424/roles/640bda0879494e60b72680ee505285f0 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:46:26.453698 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219cb38f-04ea-4bf7-97bd-a12ea1c3f962 None None] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:26.454864 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219cb38f-04ea-4bf7-97bd-a12ea1c3f962 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:26.456244 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219cb38f-04ea-4bf7-97bd-a12ea1c3f962 None None] PATH_INFO: `/` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:26.460172 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceaac987-0608-456a-806d-e4abde6f4f37 admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:26.464050 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 945/1878] 10.222.0.26 () {54 vars in 921 bytes} [Wed Aug 24 05:46:26 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:46:26.465346 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219cb38f-04ea-4bf7-97bd-a12ea1c3f962 None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:26.487148 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:INSERT=6,keystone:SELECT=87,keystone:DELETE=7 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:46:26.591363 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53608693-6832-4609-972e-e75521c64ad9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:26.592033 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53608693-6832-4609-972e-e75521c64ad9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:26.592318 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53608693-6832-4609-972e-e75521c64ad9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:26.592595 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53608693-6832-4609-972e-e75521c64ad9 admin admin] PATH_INFO: `/v3/users/412d90fec0a24d738bdd66d2e67568ec` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:26.596113 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53608693-6832-4609-972e-e75521c64ad9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=412d90fec0a24d738bdd66d2e67568ec)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:26.605976 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53608693-6832-4609-972e-e75521c64ad9 admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:26.720092 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-53608693-6832-4609-972e-e75521c64ad9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '412d90fec0a24d738bdd66d2e67568ec'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:26.750672 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-53608693-6832-4609-972e-e75521c64ad9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '412d90fec0a24d738bdd66d2e67568ec'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:26.786020 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-53608693-6832-4609-972e-e75521c64ad9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '412d90fec0a24d738bdd66d2e67568ec'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:26.793573 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219cb38f-04ea-4bf7-97bd-a12ea1c3f962 None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:26.803751 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-53608693-6832-4609-972e-e75521c64ad9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '412d90fec0a24d738bdd66d2e67568ec'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:26.804726 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-53608693-6832-4609-972e-e75521c64ad9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '412d90fec0a24d738bdd66d2e67568ec'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:26.816168 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 934/1879] 10.222.0.26 () {58 vars in 1224 bytes} [Wed Aug 24 05:46:26 2022] DELETE /identity/v3/users/412d90fec0a24d738bdd66d2e67568ec => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:46:26.817074 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67b9078-2f16-4c9c-a49d-19f7e7bece07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:26.817527 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53608693-6832-4609-972e-e75521c64ad9 admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:26.819560 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67b9078-2f16-4c9c-a49d-19f7e7bece07 admin admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:26.820822 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67b9078-2f16-4c9c-a49d-19f7e7bece07 admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:26.820822 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67b9078-2f16-4c9c-a49d-19f7e7bece07 admin admin] PATH_INFO: `/v3/roles` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:26.821032 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-53608693-6832-4609-972e-e75521c64ad9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:26.821122 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67b9078-2f16-4c9c-a49d-19f7e7bece07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:26.831735 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67b9078-2f16-4c9c-a49d-19f7e7bece07 admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:26.865510 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 946/1880] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Aug 24 05:46:26 2022] GET /identity/v3/roles => generated 1420 bytes in 401 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:46:26.870601 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299d455b-5f93-4abf-8082-62cabfd5e040 None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:26.871052 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299d455b-5f93-4abf-8082-62cabfd5e040 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:26.878231 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299d455b-5f93-4abf-8082-62cabfd5e040 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:26.947149 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-299d455b-5f93-4abf-8082-62cabfd5e040 None None] MFA Rules not processed for user `7b633e1aec6c4269bce13aa9c89e911a`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:46:26.949240 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-299d455b-5f93-4abf-8082-62cabfd5e040 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:26.997305 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53608693-6832-4609-972e-e75521c64ad9 admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:27.012192 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16948f31-cf1b-4373-a9de-964cd36e6e79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:27.013139 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16948f31-cf1b-4373-a9de-964cd36e6e79 admin admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:27.013585 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16948f31-cf1b-4373-a9de-964cd36e6e79 admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:27.014083 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16948f31-cf1b-4373-a9de-964cd36e6e79 admin admin] PATH_INFO: `/v3/roles` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:27.014913 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16948f31-cf1b-4373-a9de-964cd36e6e79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:27.016844 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16948f31-cf1b-4373-a9de-964cd36e6e79 admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:27.045646 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 935/1881] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Aug 24 05:46:26 2022] GET /identity/v3/roles => generated 1420 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:46:27.047530 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16948f31-cf1b-4373-a9de-964cd36e6e79 admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:27.051062 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-16948f31-cf1b-4373-a9de-964cd36e6e79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:27.078047 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16948f31-cf1b-4373-a9de-964cd36e6e79 admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:27.093228 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9a6daa-9162-4e2c-a4af-17fec099a4ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:27.104638 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9a6daa-9162-4e2c-a4af-17fec099a4ec admin admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:27.104638 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9a6daa-9162-4e2c-a4af-17fec099a4ec admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:27.104638 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9a6daa-9162-4e2c-a4af-17fec099a4ec admin admin] PATH_INFO: `/v3/roles` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:27.104638 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9a6daa-9162-4e2c-a4af-17fec099a4ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:27.104638 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9a6daa-9162-4e2c-a4af-17fec099a4ec admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:27.114420 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 947/1882] 10.222.0.26 () {58 vars in 1018 bytes} [Wed Aug 24 05:46:26 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:46:27.118275 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15d2996-76bd-4a9c-8190-e333202d40b9 None None] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:27.124874 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15d2996-76bd-4a9c-8190-e333202d40b9 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:27.125892 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15d2996-76bd-4a9c-8190-e333202d40b9 None None] PATH_INFO: `/` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:27.129198 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 948/1883] 10.222.0.26 () {54 vars in 921 bytes} [Wed Aug 24 05:46:27 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:46:27.130176 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15d2996-76bd-4a9c-8190-e333202d40b9 None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:27.135810 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 936/1884] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Aug 24 05:46:27 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:46:27.141818 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9a6daa-9162-4e2c-a4af-17fec099a4ec admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:27.178270 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9a6daa-9162-4e2c-a4af-17fec099a4ec admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:27.180377 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15d2996-76bd-4a9c-8190-e333202d40b9 None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:27.191585 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce2056e-98c6-4fd1-9165-b2b6de698564 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:27.192546 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce2056e-98c6-4fd1-9165-b2b6de698564 admin admin] REQUEST_METHOD: `PUT` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:27.192998 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce2056e-98c6-4fd1-9165-b2b6de698564 admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:27.193484 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce2056e-98c6-4fd1-9165-b2b6de698564 admin admin] PATH_INFO: `/v3/projects/39dae25a5dce4ae9bb7625a674b678fd/users/9aae15e9d2f443018165e7297caa0424/roles/640bda0879494e60b72680ee505285f0` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:27.200653 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce2056e-98c6-4fd1-9165-b2b6de698564 admin admin] RBAC: Authorizing `identity:create_grant(project_id=39dae25a5dce4ae9bb7625a674b678fd, user_id=9aae15e9d2f443018165e7297caa0424, role_id=640bda0879494e60b72680ee505285f0)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:27.203190 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06e3ea9-c1db-4bdf-b3d9-c5195e5d4475 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:27.203190 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06e3ea9-c1db-4bdf-b3d9-c5195e5d4475 admin admin] REQUEST_METHOD: `PUT` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:27.203190 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06e3ea9-c1db-4bdf-b3d9-c5195e5d4475 admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:27.203190 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06e3ea9-c1db-4bdf-b3d9-c5195e5d4475 admin admin] PATH_INFO: `/v3/projects/9420146df5524e0bb86138d04b38be28/users/f0e428207ee049fd90f3e69a8318b139/roles/f7aa4a2c74c94c1b9ca8ecdcccccda5c` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:27.204081 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce2056e-98c6-4fd1-9165-b2b6de698564 admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:27.231115 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 949/1885] 10.222.0.26 () {60 vars in 1483 bytes} [Wed Aug 24 05:46:27 2022] PUT /identity/v3/projects/39dae25a5dce4ae9bb7625a674b678fd/users/9aae15e9d2f443018165e7297caa0424/roles/640bda0879494e60b72680ee505285f0 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:46:27.233230 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8de6cef-7cab-4171-9022-5b6c662d0d95 None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:27.235474 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8de6cef-7cab-4171-9022-5b6c662d0d95 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:27.235891 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8de6cef-7cab-4171-9022-5b6c662d0d95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:27.263918 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:46:27.276824 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-f8de6cef-7cab-4171-9022-5b6c662d0d95 None None] MFA Rules not processed for user `7b633e1aec6c4269bce13aa9c89e911a`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:46:27.276824 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-f8de6cef-7cab-4171-9022-5b6c662d0d95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:27.284508 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06e3ea9-c1db-4bdf-b3d9-c5195e5d4475 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9420146df5524e0bb86138d04b38be28, user_id=f0e428207ee049fd90f3e69a8318b139, role_id=f7aa4a2c74c94c1b9ca8ecdcccccda5c)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:27.294343 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06e3ea9-c1db-4bdf-b3d9-c5195e5d4475 admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:27.366052 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 937/1886] 10.222.0.26 () {60 vars in 1483 bytes} [Wed Aug 24 05:46:27 2022] PUT /identity/v3/projects/9420146df5524e0bb86138d04b38be28/users/f0e428207ee049fd90f3e69a8318b139/roles/f7aa4a2c74c94c1b9ca8ecdcccccda5c => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:46:27.373416 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6763a08f-a00a-4479-a2bd-5c571c77610c None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:27.376429 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6763a08f-a00a-4479-a2bd-5c571c77610c None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:27.378100 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6763a08f-a00a-4479-a2bd-5c571c77610c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:27.378732 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:46:27.426709 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 950/1887] 10.222.0.26 () {58 vars in 1018 bytes} [Wed Aug 24 05:46:27 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:46:27.428274 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1826f23-d8d5-4dda-8bf0-8d4310f39bfa None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:27.428709 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1826f23-d8d5-4dda-8bf0-8d4310f39bfa None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:27.429105 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1826f23-d8d5-4dda-8bf0-8d4310f39bfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:27.438650 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-6763a08f-a00a-4479-a2bd-5c571c77610c None None] MFA Rules not processed for user `9aae15e9d2f443018165e7297caa0424`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:46:27.440005 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-6763a08f-a00a-4479-a2bd-5c571c77610c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:27.496783 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-e1826f23-d8d5-4dda-8bf0-8d4310f39bfa None None] MFA Rules not processed for user `f0e428207ee049fd90f3e69a8318b139`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:46:27.498600 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-e1826f23-d8d5-4dda-8bf0-8d4310f39bfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:27.640140 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 938/1888] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:46:27 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:46:27.643125 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6763a08f-a00a-4479-a2bd-5c571c77610c None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:27.648861 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-6763a08f-a00a-4479-a2bd-5c571c77610c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:27.764800 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 951/1889] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:46:27 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 338 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:46:27.769102 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1826f23-d8d5-4dda-8bf0-8d4310f39bfa None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:27.769984 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-e1826f23-d8d5-4dda-8bf0-8d4310f39bfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:27.883436 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6763a08f-a00a-4479-a2bd-5c571c77610c None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:27.907754 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54af3d0-4f79-440a-bb26-9184058228b6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b633e1aec6c4269bce13aa9c89e911a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:27.909771 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54af3d0-4f79-440a-bb26-9184058228b6 service nova] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:27.909771 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54af3d0-4f79-440a-bb26-9184058228b6 service nova] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:27.910017 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54af3d0-4f79-440a-bb26-9184058228b6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:27.951232 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54af3d0-4f79-440a-bb26-9184058228b6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:27.962437 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54af3d0-4f79-440a-bb26-9184058228b6 service nova] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:27.996802 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 939/1890] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 24 05:46:27 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:46:27.997921 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54af3d0-4f79-440a-bb26-9184058228b6 service nova] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:28.029644 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1826f23-d8d5-4dda-8bf0-8d4310f39bfa None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:28.047946 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8059159e-9353-448e-abaf-4ea02a82eb13 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17b450afe795495680fc70f522c83750', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:28.049926 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8059159e-9353-448e-abaf-4ea02a82eb13 service cinder] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:28.051698 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8059159e-9353-448e-abaf-4ea02a82eb13 service cinder] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:28.053600 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8059159e-9353-448e-abaf-4ea02a82eb13 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:28.086596 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8059159e-9353-448e-abaf-4ea02a82eb13 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:28.093022 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8059159e-9353-448e-abaf-4ea02a82eb13 service cinder] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:28.141898 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 952/1891] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 24 05:46:27 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:46:28.144199 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8059159e-9353-448e-abaf-4ea02a82eb13 service cinder] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:28.151568 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-8059159e-9353-448e-abaf-4ea02a82eb13 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:28.379128 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54af3d0-4f79-440a-bb26-9184058228b6 service nova] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:28.393491 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86f48ad-ace9-4904-9038-b892b7a84c50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:28.395038 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86f48ad-ace9-4904-9038-b892b7a84c50 admin admin] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:28.397443 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86f48ad-ace9-4904-9038-b892b7a84c50 admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:28.397789 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86f48ad-ace9-4904-9038-b892b7a84c50 admin admin] PATH_INFO: `/v3/projects` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:28.398771 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86f48ad-ace9-4904-9038-b892b7a84c50 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:28.407012 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86f48ad-ace9-4904-9038-b892b7a84c50 admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:28.424383 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:46:28.533169 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 940/1892] 10.222.0.26 () {60 vars in 1153 bytes} [Wed Aug 24 05:46:27 2022] POST /identity/v3/projects => generated 387 bytes in 536 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:46:28.541127 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86f48ad-ace9-4904-9038-b892b7a84c50 admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:28.550802 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8059159e-9353-448e-abaf-4ea02a82eb13 service cinder] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:28.631850 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:46:28.708127 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86f48ad-ace9-4904-9038-b892b7a84c50 admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:28.727983 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18545bb8-332b-4568-b820-4e082884cbcb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b633e1aec6c4269bce13aa9c89e911a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:28.729601 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18545bb8-332b-4568-b820-4e082884cbcb service nova] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:28.730161 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18545bb8-332b-4568-b820-4e082884cbcb service nova] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:28.730502 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18545bb8-332b-4568-b820-4e082884cbcb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:28.745932 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18545bb8-332b-4568-b820-4e082884cbcb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:28.751403 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18545bb8-332b-4568-b820-4e082884cbcb service nova] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:28.792425 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 941/1893] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 24 05:46:28 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:46:28.800926 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdef2ed-73ea-4270-8e7b-bb1598e69f6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:28.805739 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdef2ed-73ea-4270-8e7b-bb1598e69f6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:28.805739 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdef2ed-73ea-4270-8e7b-bb1598e69f6b admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:28.806029 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdef2ed-73ea-4270-8e7b-bb1598e69f6b admin admin] PATH_INFO: `/v3/projects/99b436cde4af4931a451af357080ea09` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:28.809531 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdef2ed-73ea-4270-8e7b-bb1598e69f6b admin admin] RBAC: Authorizing `identity:delete_project(project_id=99b436cde4af4931a451af357080ea09)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:28.814566 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18545bb8-332b-4568-b820-4e082884cbcb service nova] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:28.852090 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdef2ed-73ea-4270-8e7b-bb1598e69f6b admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:28.962338 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18545bb8-332b-4568-b820-4e082884cbcb service nova] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:28.970497 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad97eba7-af55-487f-81ad-316d8456c196 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17b450afe795495680fc70f522c83750', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:28.972077 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad97eba7-af55-487f-81ad-316d8456c196 service cinder] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:28.972476 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad97eba7-af55-487f-81ad-316d8456c196 service cinder] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:28.973928 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad97eba7-af55-487f-81ad-316d8456c196 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:28.978928 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-ad97eba7-af55-487f-81ad-316d8456c196 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:29.042281 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-bcdef2ed-73ea-4270-8e7b-bb1598e69f6b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '99b436cde4af4931a451af357080ea09', 'request_id': 'req-bcdef2ed-73ea-4270-8e7b-bb1598e69f6b'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:29.066222 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-bcdef2ed-73ea-4270-8e7b-bb1598e69f6b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '99b436cde4af4931a451af357080ea09', 'request_id': 'req-bcdef2ed-73ea-4270-8e7b-bb1598e69f6b'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:29.080896 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-bcdef2ed-73ea-4270-8e7b-bb1598e69f6b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '99b436cde4af4931a451af357080ea09', 'request_id': 'req-bcdef2ed-73ea-4270-8e7b-bb1598e69f6b'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:29.121917 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-bcdef2ed-73ea-4270-8e7b-bb1598e69f6b admin admin] The token cache is being invalidate because project 99b436cde4af4931a451af357080ea09 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:46:29.122494 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-bcdef2ed-73ea-4270-8e7b-bb1598e69f6b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:29.123842 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-bcdef2ed-73ea-4270-8e7b-bb1598e69f6b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:29.125978 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 953/1894] 10.222.0.26 () {58 vars in 1233 bytes} [Wed Aug 24 05:46:28 2022] DELETE /identity/v3/projects/99b436cde4af4931a451af357080ea09 => generated 0 bytes in 983 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:46:29.130541 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdef2ed-73ea-4270-8e7b-bb1598e69f6b admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:29.132660 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-bcdef2ed-73ea-4270-8e7b-bb1598e69f6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:29.181731 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad97eba7-af55-487f-81ad-316d8456c196 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:29.187437 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad97eba7-af55-487f-81ad-316d8456c196 service cinder] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:29.221889 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdef2ed-73ea-4270-8e7b-bb1598e69f6b admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:29.226814 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 942/1895] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 24 05:46:28 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:46:29.227086 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad97eba7-af55-487f-81ad-316d8456c196 service cinder] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:29.235634 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-ad97eba7-af55-487f-81ad-316d8456c196 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:29.242880 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb17af23-c3f7-48d6-985f-2a783155e861 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:29.246716 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb17af23-c3f7-48d6-985f-2a783155e861 admin admin] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:29.247299 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb17af23-c3f7-48d6-985f-2a783155e861 admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:29.250189 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb17af23-c3f7-48d6-985f-2a783155e861 admin admin] PATH_INFO: `/v3/users` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:29.251421 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb17af23-c3f7-48d6-985f-2a783155e861 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:29.256316 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb17af23-c3f7-48d6-985f-2a783155e861 admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:29.311019 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 954/1896] 10.222.0.26 () {60 vars in 1144 bytes} [Wed Aug 24 05:46:29 2022] POST /identity/v3/users => generated 294 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:46:29.316340 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1b22ce-b1f3-424c-bc9f-0d8721bd4b7a None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:29.317776 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1b22ce-b1f3-424c-bc9f-0d8721bd4b7a None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:29.318156 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1b22ce-b1f3-424c-bc9f-0d8721bd4b7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:29.323366 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad97eba7-af55-487f-81ad-316d8456c196 service cinder] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:29.352454 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-cd1b22ce-b1f3-424c-bc9f-0d8721bd4b7a None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:46:29.354163 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-cd1b22ce-b1f3-424c-bc9f-0d8721bd4b7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:29.362477 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccd9529-d008-46a1-aaca-332d048c72e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:29.363137 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccd9529-d008-46a1-aaca-332d048c72e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:29.363419 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccd9529-d008-46a1-aaca-332d048c72e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:29.363691 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccd9529-d008-46a1-aaca-332d048c72e1 admin admin] PATH_INFO: `/v3/projects/7559e9a56f3b4e48a5b2c964f6bd093c` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:29.377779 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 955/1897] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:46:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:46:29.380004 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1b22ce-b1f3-424c-bc9f-0d8721bd4b7a None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:29.382549 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccd9529-d008-46a1-aaca-332d048c72e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7559e9a56f3b4e48a5b2c964f6bd093c)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:29.384520 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccd9529-d008-46a1-aaca-332d048c72e1 admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:29.392747 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1b22ce-b1f3-424c-bc9f-0d8721bd4b7a None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:29.401082 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e1f2f3-5fb3-4ffa-a647-32853767a5c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:29.402268 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e1f2f3-5fb3-4ffa-a647-32853767a5c5 admin admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:29.403012 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e1f2f3-5fb3-4ffa-a647-32853767a5c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:29.403584 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e1f2f3-5fb3-4ffa-a647-32853767a5c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:29.404905 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e1f2f3-5fb3-4ffa-a647-32853767a5c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:29.409169 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e1f2f3-5fb3-4ffa-a647-32853767a5c5 admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:29.430091 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 956/1898] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Aug 24 05:46:29 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:46:29.430091 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f560ca-dbc7-488e-bd73-0309bc457623 None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:29.430091 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f560ca-dbc7-488e-bd73-0309bc457623 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:29.430091 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f560ca-dbc7-488e-bd73-0309bc457623 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:29.461321 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-43f560ca-dbc7-488e-bd73-0309bc457623 None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:46:29.462898 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-43f560ca-dbc7-488e-bd73-0309bc457623 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:29.483891 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 957/1899] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:46:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:46:29.488401 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f560ca-dbc7-488e-bd73-0309bc457623 None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:29.514039 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f560ca-dbc7-488e-bd73-0309bc457623 None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:29.519323 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ce4f9d-52eb-4c4c-b54f-89783f5e0a55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:29.520717 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ce4f9d-52eb-4c4c-b54f-89783f5e0a55 admin admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:29.521305 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ce4f9d-52eb-4c4c-b54f-89783f5e0a55 admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:29.521709 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ce4f9d-52eb-4c4c-b54f-89783f5e0a55 admin admin] PATH_INFO: `/v3/roles` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:29.522568 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ce4f9d-52eb-4c4c-b54f-89783f5e0a55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:29.525514 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ce4f9d-52eb-4c4c-b54f-89783f5e0a55 admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:29.534688 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:46:29.547837 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 958/1900] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Aug 24 05:46:29 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:46:29.549376 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ce4f9d-52eb-4c4c-b54f-89783f5e0a55 admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:29.562824 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ce4f9d-52eb-4c4c-b54f-89783f5e0a55 admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:29.568502 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1314c4ca-1a3e-4d14-8d68-0301e7d01fc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:29.569114 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1314c4ca-1a3e-4d14-8d68-0301e7d01fc8 admin admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:29.569395 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1314c4ca-1a3e-4d14-8d68-0301e7d01fc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:29.569730 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1314c4ca-1a3e-4d14-8d68-0301e7d01fc8 admin admin] PATH_INFO: `/v3/domains` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:29.570684 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1314c4ca-1a3e-4d14-8d68-0301e7d01fc8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:46:29.571139 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1314c4ca-1a3e-4d14-8d68-0301e7d01fc8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:29.573434 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1314c4ca-1a3e-4d14-8d68-0301e7d01fc8 admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:29.583790 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:46:29.595277 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 959/1901] 10.222.0.26 () {58 vars in 1153 bytes} [Wed Aug 24 05:46:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:46:29.600337 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1314c4ca-1a3e-4d14-8d68-0301e7d01fc8 admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:29.615819 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1314c4ca-1a3e-4d14-8d68-0301e7d01fc8 admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:29.648435 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-5ccd9529-d008-46a1-aaca-332d048c72e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7559e9a56f3b4e48a5b2c964f6bd093c', 'request_id': 'req-5ccd9529-d008-46a1-aaca-332d048c72e1'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:29.667321 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-5ccd9529-d008-46a1-aaca-332d048c72e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7559e9a56f3b4e48a5b2c964f6bd093c', 'request_id': 'req-5ccd9529-d008-46a1-aaca-332d048c72e1'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:29.685458 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-5ccd9529-d008-46a1-aaca-332d048c72e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7559e9a56f3b4e48a5b2c964f6bd093c', 'request_id': 'req-5ccd9529-d008-46a1-aaca-332d048c72e1'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:29.725772 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-5ccd9529-d008-46a1-aaca-332d048c72e1 admin admin] The token cache is being invalidate because project 7559e9a56f3b4e48a5b2c964f6bd093c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88112) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:46:29.726170 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-5ccd9529-d008-46a1-aaca-332d048c72e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:29.727242 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-5ccd9529-d008-46a1-aaca-332d048c72e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:29.732648 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 943/1902] 10.222.0.26 () {58 vars in 1233 bytes} [Wed Aug 24 05:46:29 2022] DELETE /identity/v3/projects/7559e9a56f3b4e48a5b2c964f6bd093c => generated 0 bytes in 506 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:46:29.733974 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccd9529-d008-46a1-aaca-332d048c72e1 admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:29.742017 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-5ccd9529-d008-46a1-aaca-332d048c72e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:29.752483 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3033cea8-ade7-4013-980a-dcfa2972311a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:29.753219 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3033cea8-ade7-4013-980a-dcfa2972311a admin admin] REQUEST_METHOD: `PUT` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:29.753548 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3033cea8-ade7-4013-980a-dcfa2972311a admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:29.753832 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3033cea8-ade7-4013-980a-dcfa2972311a admin admin] PATH_INFO: `/v3/projects/29ae82aaf8104fec9f92393c470c2009/users/d79f734e79184efbb2f1f52c2a597dfe/roles/f7aa4a2c74c94c1b9ca8ecdcccccda5c` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:29.780630 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccd9529-d008-46a1-aaca-332d048c72e1 admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:29.789744 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3033cea8-ade7-4013-980a-dcfa2972311a admin admin] RBAC: Authorizing `identity:create_grant(project_id=29ae82aaf8104fec9f92393c470c2009, user_id=d79f734e79184efbb2f1f52c2a597dfe, role_id=f7aa4a2c74c94c1b9ca8ecdcccccda5c)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:29.793836 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98cbd5f-ff97-4dfc-b57b-b1984eb91921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:29.795470 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98cbd5f-ff97-4dfc-b57b-b1984eb91921 admin admin] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:29.797022 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98cbd5f-ff97-4dfc-b57b-b1984eb91921 admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:29.797315 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98cbd5f-ff97-4dfc-b57b-b1984eb91921 admin admin] PATH_INFO: `/v3/projects` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:29.799516 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98cbd5f-ff97-4dfc-b57b-b1984eb91921 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:29.801448 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3033cea8-ade7-4013-980a-dcfa2972311a admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:29.805469 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98cbd5f-ff97-4dfc-b57b-b1984eb91921 admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:29.832721 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 960/1903] 10.222.0.26 () {60 vars in 1483 bytes} [Wed Aug 24 05:46:29 2022] PUT /identity/v3/projects/29ae82aaf8104fec9f92393c470c2009/users/d79f734e79184efbb2f1f52c2a597dfe/roles/f7aa4a2c74c94c1b9ca8ecdcccccda5c => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:46:29.834515 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8209fd-d0dc-4d93-8c25-752c6bbc994c None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:29.835003 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8209fd-d0dc-4d93-8c25-752c6bbc994c None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:29.835433 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8209fd-d0dc-4d93-8c25-752c6bbc994c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:29.871699 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 944/1904] 10.222.0.26 () {60 vars in 1153 bytes} [Wed Aug 24 05:46:29 2022] POST /identity/v3/projects => generated 379 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:46:29.877032 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83abbb20-16f9-47ea-b095-46db39b375a3 None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:29.877551 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83abbb20-16f9-47ea-b095-46db39b375a3 None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:29.878088 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83abbb20-16f9-47ea-b095-46db39b375a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:29.922938 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-83abbb20-16f9-47ea-b095-46db39b375a3 None None] MFA Rules not processed for user `d79f734e79184efbb2f1f52c2a597dfe`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:46:29.924166 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-83abbb20-16f9-47ea-b095-46db39b375a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:29.938172 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-7d8209fd-d0dc-4d93-8c25-752c6bbc994c None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:46:29.941534 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-7d8209fd-d0dc-4d93-8c25-752c6bbc994c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:30.062406 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 945/1905] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:46:29 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:46:30.063359 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83abbb20-16f9-47ea-b095-46db39b375a3 None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:30.106518 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 961/1906] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:46:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:46:30.109002 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8209fd-d0dc-4d93-8c25-752c6bbc994c None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:30.111987 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-7d8209fd-d0dc-4d93-8c25-752c6bbc994c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:30.134701 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8209fd-d0dc-4d93-8c25-752c6bbc994c None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:30.144644 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dff4df-3954-4ec8-a9d0-e340812644c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:30.145403 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dff4df-3954-4ec8-a9d0-e340812644c7 admin admin] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:30.145837 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dff4df-3954-4ec8-a9d0-e340812644c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:30.146406 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dff4df-3954-4ec8-a9d0-e340812644c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:30.147199 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29dff4df-3954-4ec8-a9d0-e340812644c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:30.157569 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29dff4df-3954-4ec8-a9d0-e340812644c7 admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:30.275519 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 962/1907] 10.222.0.26 () {60 vars in 1153 bytes} [Wed Aug 24 05:46:30 2022] POST /identity/v3/projects => generated 387 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:46:30.275519 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1688644e-4a0a-426b-9392-ccd72a000a16 None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:30.282897 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1688644e-4a0a-426b-9392-ccd72a000a16 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:30.283203 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1688644e-4a0a-426b-9392-ccd72a000a16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:30.309982 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83abbb20-16f9-47ea-b095-46db39b375a3 None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:30.337228 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-1688644e-4a0a-426b-9392-ccd72a000a16 None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:46:30.338999 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-1688644e-4a0a-426b-9392-ccd72a000a16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:30.362300 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:DELETE=7,keystone:SELECT=91,keystone:INSERT=2 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:46:30.512304 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a64112-5835-4d45-ab13-ae3c5c7fc9c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:30.513138 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:46:30.513243 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a64112-5835-4d45-ab13-ae3c5c7fc9c0 admin admin] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:30.513243 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a64112-5835-4d45-ab13-ae3c5c7fc9c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:30.513542 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a64112-5835-4d45-ab13-ae3c5c7fc9c0 admin admin] PATH_INFO: `/v3/users` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:30.516679 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a64112-5835-4d45-ab13-ae3c5c7fc9c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:30.521581 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a64112-5835-4d45-ab13-ae3c5c7fc9c0 admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:30.530539 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 963/1908] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:46:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:46:30.531890 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1688644e-4a0a-426b-9392-ccd72a000a16 None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:30.551664 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1688644e-4a0a-426b-9392-ccd72a000a16 None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:30.559474 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b12cbe-beb1-4e5c-91e1-175918fc8183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:30.560754 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b12cbe-beb1-4e5c-91e1-175918fc8183 admin admin] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:30.561295 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b12cbe-beb1-4e5c-91e1-175918fc8183 admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:30.561933 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b12cbe-beb1-4e5c-91e1-175918fc8183 admin admin] PATH_INFO: `/v3/users` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:30.562911 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b12cbe-beb1-4e5c-91e1-175918fc8183 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:30.567012 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b12cbe-beb1-4e5c-91e1-175918fc8183 admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:30.568085 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 946/1909] 10.222.0.26 () {60 vars in 1144 bytes} [Wed Aug 24 05:46:30 2022] POST /identity/v3/users => generated 290 bytes in 505 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:46:30.569027 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a64112-5835-4d45-ab13-ae3c5c7fc9c0 admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:30.585392 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a64112-5835-4d45-ab13-ae3c5c7fc9c0 admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:30.595428 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d472ee-2556-4cee-8c93-fdea1d32d773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:30.595983 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d472ee-2556-4cee-8c93-fdea1d32d773 admin admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:30.596265 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d472ee-2556-4cee-8c93-fdea1d32d773 admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:30.596658 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d472ee-2556-4cee-8c93-fdea1d32d773 admin admin] PATH_INFO: `/v3/domains` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:30.597199 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d472ee-2556-4cee-8c93-fdea1d32d773 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:46:30.597531 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d472ee-2556-4cee-8c93-fdea1d32d773 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:30.599409 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d472ee-2556-4cee-8c93-fdea1d32d773 admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:30.605170 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 964/1910] 10.222.0.26 () {60 vars in 1144 bytes} [Wed Aug 24 05:46:30 2022] POST /identity/v3/users => generated 300 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:46:30.606551 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b12cbe-beb1-4e5c-91e1-175918fc8183 admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:30.619909 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 947/1911] 10.222.0.26 () {58 vars in 1153 bytes} [Wed Aug 24 05:46:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:46:30.620874 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d472ee-2556-4cee-8c93-fdea1d32d773 admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:30.623053 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b12cbe-beb1-4e5c-91e1-175918fc8183 admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:30.630806 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08eed934-29e8-4d1e-af07-9b8a7118fee0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:30.632103 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eed934-29e8-4d1e-af07-9b8a7118fee0 admin admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:30.632213 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d472ee-2556-4cee-8c93-fdea1d32d773 admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:30.632969 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eed934-29e8-4d1e-af07-9b8a7118fee0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:30.633475 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eed934-29e8-4d1e-af07-9b8a7118fee0 admin admin] PATH_INFO: `/v3/roles` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:30.635237 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08eed934-29e8-4d1e-af07-9b8a7118fee0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:30.639059 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08eed934-29e8-4d1e-af07-9b8a7118fee0 admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:30.639242 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fdc097-7727-4901-9402-96829fb6181b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:30.639747 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fdc097-7727-4901-9402-96829fb6181b admin admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:30.640032 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fdc097-7727-4901-9402-96829fb6181b admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:30.640305 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fdc097-7727-4901-9402-96829fb6181b admin admin] PATH_INFO: `/v3/roles` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:30.641588 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fdc097-7727-4901-9402-96829fb6181b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:30.643422 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fdc097-7727-4901-9402-96829fb6181b admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:30.656554 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 965/1912] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Aug 24 05:46:30 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:46:30.657800 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08eed934-29e8-4d1e-af07-9b8a7118fee0 admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:30.664464 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 948/1913] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Aug 24 05:46:30 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:46:30.665748 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fdc097-7727-4901-9402-96829fb6181b admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:30.675068 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08eed934-29e8-4d1e-af07-9b8a7118fee0 admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:30.678901 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fdc097-7727-4901-9402-96829fb6181b admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:30.682434 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec91568-7980-4edc-9b6d-e01a2d19a0c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:30.684309 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec91568-7980-4edc-9b6d-e01a2d19a0c5 admin admin] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:30.685147 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec91568-7980-4edc-9b6d-e01a2d19a0c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:30.685802 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec91568-7980-4edc-9b6d-e01a2d19a0c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:30.686942 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec91568-7980-4edc-9b6d-e01a2d19a0c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:30.689744 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec91568-7980-4edc-9b6d-e01a2d19a0c5 admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:30.691329 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb7df99-0f3f-4758-b0a1-ce7135ba4dbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:30.692048 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb7df99-0f3f-4758-b0a1-ce7135ba4dbd admin admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:30.692250 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb7df99-0f3f-4758-b0a1-ce7135ba4dbd admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:30.692501 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb7df99-0f3f-4758-b0a1-ce7135ba4dbd admin admin] PATH_INFO: `/v3/roles` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:30.693248 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb7df99-0f3f-4758-b0a1-ce7135ba4dbd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:30.694820 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb7df99-0f3f-4758-b0a1-ce7135ba4dbd admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:30.729665 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 949/1914] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Aug 24 05:46:30 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:46:30.730894 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb7df99-0f3f-4758-b0a1-ce7135ba4dbd admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:30.743015 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb7df99-0f3f-4758-b0a1-ce7135ba4dbd admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:30.748832 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26eebe86-1eaf-435f-a6cf-0b38e6f10ea3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:30.749615 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26eebe86-1eaf-435f-a6cf-0b38e6f10ea3 admin admin] REQUEST_METHOD: `PUT` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:30.749941 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26eebe86-1eaf-435f-a6cf-0b38e6f10ea3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:30.750263 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26eebe86-1eaf-435f-a6cf-0b38e6f10ea3 admin admin] PATH_INFO: `/v3/projects/37060db7e56d4d6b903463ede787165a/users/f637c50b417b49e1b83622b36fb48e12/roles/640bda0879494e60b72680ee505285f0` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:30.768804 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 966/1915] 10.222.0.26 () {60 vars in 1153 bytes} [Wed Aug 24 05:46:30 2022] POST /identity/v3/projects => generated 379 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:46:30.770228 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26eebe86-1eaf-435f-a6cf-0b38e6f10ea3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=37060db7e56d4d6b903463ede787165a, user_id=f637c50b417b49e1b83622b36fb48e12, role_id=640bda0879494e60b72680ee505285f0)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:30.771662 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec91568-7980-4edc-9b6d-e01a2d19a0c5 admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:30.773602 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26eebe86-1eaf-435f-a6cf-0b38e6f10ea3 admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:30.804844 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 950/1916] 10.222.0.26 () {60 vars in 1483 bytes} [Wed Aug 24 05:46:30 2022] PUT /identity/v3/projects/37060db7e56d4d6b903463ede787165a/users/f637c50b417b49e1b83622b36fb48e12/roles/640bda0879494e60b72680ee505285f0 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:46:30.811041 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26eebe86-1eaf-435f-a6cf-0b38e6f10ea3 admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:30.958895 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec91568-7980-4edc-9b6d-e01a2d19a0c5 admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:30.977247 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56226849-2546-4ce7-9942-a1c54f6d4f13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:30.979968 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56226849-2546-4ce7-9942-a1c54f6d4f13 admin admin] REQUEST_METHOD: `PUT` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:30.980664 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56226849-2546-4ce7-9942-a1c54f6d4f13 admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:30.981264 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56226849-2546-4ce7-9942-a1c54f6d4f13 admin admin] PATH_INFO: `/v3/projects/5d6eaf30566a4a4ba778c07ba4e50cde/users/a1322bd7a56246ebad690c32cde6e2fe/roles/f7aa4a2c74c94c1b9ca8ecdcccccda5c` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:30.986232 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26eebe86-1eaf-435f-a6cf-0b38e6f10ea3 admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:31.002442 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2487c4-0ea4-4d47-a311-b4346c08cc31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:31.003182 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2487c4-0ea4-4d47-a311-b4346c08cc31 admin admin] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:31.003534 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2487c4-0ea4-4d47-a311-b4346c08cc31 admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:31.003878 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2487c4-0ea4-4d47-a311-b4346c08cc31 admin admin] PATH_INFO: `/v3/users` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:31.004600 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2487c4-0ea4-4d47-a311-b4346c08cc31 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:31.006914 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2487c4-0ea4-4d47-a311-b4346c08cc31 admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:31.046509 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56226849-2546-4ce7-9942-a1c54f6d4f13 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d6eaf30566a4a4ba778c07ba4e50cde, user_id=a1322bd7a56246ebad690c32cde6e2fe, role_id=f7aa4a2c74c94c1b9ca8ecdcccccda5c)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:31.054754 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56226849-2546-4ce7-9942-a1c54f6d4f13 admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:31.058894 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 951/1917] 10.222.0.26 () {60 vars in 1144 bytes} [Wed Aug 24 05:46:30 2022] POST /identity/v3/users => generated 290 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:46:31.058894 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2487c4-0ea4-4d47-a311-b4346c08cc31 admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:31.078686 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2487c4-0ea4-4d47-a311-b4346c08cc31 admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:31.117726 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 967/1918] 10.222.0.26 () {60 vars in 1483 bytes} [Wed Aug 24 05:46:30 2022] PUT /identity/v3/projects/5d6eaf30566a4a4ba778c07ba4e50cde/users/a1322bd7a56246ebad690c32cde6e2fe/roles/f7aa4a2c74c94c1b9ca8ecdcccccda5c => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:46:31.118828 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56226849-2546-4ce7-9942-a1c54f6d4f13 admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:31.164760 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:46:31.212725 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55716eee-3865-404f-88b2-48a9057c6f2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:31.213474 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55716eee-3865-404f-88b2-48a9057c6f2c admin admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:31.213710 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55716eee-3865-404f-88b2-48a9057c6f2c admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:31.214006 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55716eee-3865-404f-88b2-48a9057c6f2c admin admin] PATH_INFO: `/v3/roles` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:31.214684 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55716eee-3865-404f-88b2-48a9057c6f2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:31.216343 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55716eee-3865-404f-88b2-48a9057c6f2c admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:31.265995 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 952/1919] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Aug 24 05:46:31 2022] GET /identity/v3/roles => generated 1420 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:46:31.265995 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb061c9-d7e8-452b-94da-5b24c00674a7 None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:31.265995 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb061c9-d7e8-452b-94da-5b24c00674a7 None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:31.265995 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb061c9-d7e8-452b-94da-5b24c00674a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:31.354840 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56226849-2546-4ce7-9942-a1c54f6d4f13 admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:31.356063 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-eeb061c9-d7e8-452b-94da-5b24c00674a7 None None] MFA Rules not processed for user `a1322bd7a56246ebad690c32cde6e2fe`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:46:31.357612 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-eeb061c9-d7e8-452b-94da-5b24c00674a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:31.368212 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4929e02e-9241-4632-af16-49c3d0cf2f8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:31.369884 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4929e02e-9241-4632-af16-49c3d0cf2f8e admin admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:31.370194 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4929e02e-9241-4632-af16-49c3d0cf2f8e admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:31.370466 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4929e02e-9241-4632-af16-49c3d0cf2f8e admin admin] PATH_INFO: `/v3/roles` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:31.371130 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4929e02e-9241-4632-af16-49c3d0cf2f8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:31.377107 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4929e02e-9241-4632-af16-49c3d0cf2f8e admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:31.411993 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 968/1920] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Aug 24 05:46:31 2022] GET /identity/v3/roles => generated 1420 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:46:31.415099 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4929e02e-9241-4632-af16-49c3d0cf2f8e admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:31.465474 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4929e02e-9241-4632-af16-49c3d0cf2f8e admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:31.491179 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d958d7c2-c367-4aa4-ac42-be65d670b31b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:31.494271 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d958d7c2-c367-4aa4-ac42-be65d670b31b admin admin] REQUEST_METHOD: `PUT` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:31.494563 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d958d7c2-c367-4aa4-ac42-be65d670b31b admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:31.494846 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d958d7c2-c367-4aa4-ac42-be65d670b31b admin admin] PATH_INFO: `/v3/projects/37060db7e56d4d6b903463ede787165a/users/f637c50b417b49e1b83622b36fb48e12/roles/640bda0879494e60b72680ee505285f0` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:31.503314 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d958d7c2-c367-4aa4-ac42-be65d670b31b admin admin] RBAC: Authorizing `identity:create_grant(project_id=37060db7e56d4d6b903463ede787165a, user_id=f637c50b417b49e1b83622b36fb48e12, role_id=640bda0879494e60b72680ee505285f0)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:31.508219 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d958d7c2-c367-4aa4-ac42-be65d670b31b admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:31.517848 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 953/1921] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:46:31 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:46:31.519347 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb061c9-d7e8-452b-94da-5b24c00674a7 None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:31.538501 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb061c9-d7e8-452b-94da-5b24c00674a7 None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:31.541387 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 969/1922] 10.222.0.26 () {60 vars in 1483 bytes} [Wed Aug 24 05:46:31 2022] PUT /identity/v3/projects/37060db7e56d4d6b903463ede787165a/users/f637c50b417b49e1b83622b36fb48e12/roles/640bda0879494e60b72680ee505285f0 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:46:31.550005 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d958d7c2-c367-4aa4-ac42-be65d670b31b admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:31.638201 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:46:31.666687 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375eb17d-2e4c-42fa-a627-cce929ccf4b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:31.667666 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375eb17d-2e4c-42fa-a627-cce929ccf4b3 admin admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:31.668145 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375eb17d-2e4c-42fa-a627-cce929ccf4b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:31.668644 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375eb17d-2e4c-42fa-a627-cce929ccf4b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:31.670094 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375eb17d-2e4c-42fa-a627-cce929ccf4b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:31.671941 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375eb17d-2e4c-42fa-a627-cce929ccf4b3 admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:31.696487 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 954/1923] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Aug 24 05:46:31 2022] GET /identity/v3/roles => generated 1420 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:46:31.700052 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2970f4-452c-481c-892d-2ad25997a1ef None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:31.701846 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2970f4-452c-481c-892d-2ad25997a1ef None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:31.702908 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2970f4-452c-481c-892d-2ad25997a1ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:31.765390 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-0b2970f4-452c-481c-892d-2ad25997a1ef None None] MFA Rules not processed for user `f637c50b417b49e1b83622b36fb48e12`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:46:31.766816 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-0b2970f4-452c-481c-892d-2ad25997a1ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:31.878371 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d958d7c2-c367-4aa4-ac42-be65d670b31b admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:31.883017 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:46:31.898877 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00144e0-3eb7-40ac-8de7-b4e2d4997df6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:31.899182 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00144e0-3eb7-40ac-8de7-b4e2d4997df6 admin admin] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:31.899744 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00144e0-3eb7-40ac-8de7-b4e2d4997df6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:31.900086 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00144e0-3eb7-40ac-8de7-b4e2d4997df6 admin admin] PATH_INFO: `/v3/projects` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:31.900915 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00144e0-3eb7-40ac-8de7-b4e2d4997df6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:31.911126 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00144e0-3eb7-40ac-8de7-b4e2d4997df6 admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:31.926664 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 955/1924] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:46:31 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:46:31.926664 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2970f4-452c-481c-892d-2ad25997a1ef None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:31.943925 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2970f4-452c-481c-892d-2ad25997a1ef None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:31.949320 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67507f7-742f-4c3e-9b48-8105025c997c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:31.950686 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67507f7-742f-4c3e-9b48-8105025c997c admin admin] REQUEST_METHOD: `PUT` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:31.950981 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67507f7-742f-4c3e-9b48-8105025c997c admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:31.951250 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67507f7-742f-4c3e-9b48-8105025c997c admin admin] PATH_INFO: `/v3/projects/a51e92b7074a4cab9676c828e4bf203e/users/2ac781990fae4936a5f59462ca01db35/roles/f7aa4a2c74c94c1b9ca8ecdcccccda5c` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:31.977785 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67507f7-742f-4c3e-9b48-8105025c997c admin admin] RBAC: Authorizing `identity:create_grant(project_id=a51e92b7074a4cab9676c828e4bf203e, user_id=2ac781990fae4936a5f59462ca01db35, role_id=f7aa4a2c74c94c1b9ca8ecdcccccda5c)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:31.984168 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67507f7-742f-4c3e-9b48-8105025c997c admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:32.023433 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 956/1925] 10.222.0.26 () {60 vars in 1483 bytes} [Wed Aug 24 05:46:31 2022] PUT /identity/v3/projects/a51e92b7074a4cab9676c828e4bf203e/users/2ac781990fae4936a5f59462ca01db35/roles/f7aa4a2c74c94c1b9ca8ecdcccccda5c => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:46:32.023433 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67507f7-742f-4c3e-9b48-8105025c997c admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:32.027399 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-f67507f7-742f-4c3e-9b48-8105025c997c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:32.034954 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 970/1926] 10.222.0.26 () {60 vars in 1153 bytes} [Wed Aug 24 05:46:31 2022] POST /identity/v3/projects => generated 379 bytes in 493 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:46:32.043626 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dab013-5bfc-4c93-a2aa-75d47bbcd57d None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:32.044074 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dab013-5bfc-4c93-a2aa-75d47bbcd57d None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:32.045179 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dab013-5bfc-4c93-a2aa-75d47bbcd57d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:32.103943 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-43dab013-5bfc-4c93-a2aa-75d47bbcd57d None None] MFA Rules not processed for user `2ac781990fae4936a5f59462ca01db35`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:46:32.105419 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-43dab013-5bfc-4c93-a2aa-75d47bbcd57d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:32.217913 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67507f7-742f-4c3e-9b48-8105025c997c admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:32.259396 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 971/1927] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:46:32 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:46:32.261520 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dab013-5bfc-4c93-a2aa-75d47bbcd57d None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:32.328817 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c350189f-63dc-4a6d-9d9b-8e7efb6673ab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17b450afe795495680fc70f522c83750', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:32.329624 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c350189f-63dc-4a6d-9d9b-8e7efb6673ab service cinder] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:32.329913 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c350189f-63dc-4a6d-9d9b-8e7efb6673ab service cinder] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:32.330442 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c350189f-63dc-4a6d-9d9b-8e7efb6673ab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:32.409351 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dab013-5bfc-4c93-a2aa-75d47bbcd57d None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:32.418424 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b163f0b5-0c36-4165-94cd-dd89ce288adc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:32.419917 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b163f0b5-0c36-4165-94cd-dd89ce288adc admin admin] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:32.420774 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b163f0b5-0c36-4165-94cd-dd89ce288adc admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:32.421425 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b163f0b5-0c36-4165-94cd-dd89ce288adc admin admin] PATH_INFO: `/v3/users` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:32.422361 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b163f0b5-0c36-4165-94cd-dd89ce288adc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:32.426510 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b163f0b5-0c36-4165-94cd-dd89ce288adc admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:32.472159 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 972/1928] 10.222.0.26 () {60 vars in 1144 bytes} [Wed Aug 24 05:46:32 2022] POST /identity/v3/users => generated 290 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:46:32.472159 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b163f0b5-0c36-4165-94cd-dd89ce288adc admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:32.485311 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b163f0b5-0c36-4165-94cd-dd89ce288adc admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:32.491471 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1785e32-9e6f-45b5-81a9-a6328d0eb3bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:32.492208 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1785e32-9e6f-45b5-81a9-a6328d0eb3bc admin admin] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:32.492539 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1785e32-9e6f-45b5-81a9-a6328d0eb3bc admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:32.493500 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1785e32-9e6f-45b5-81a9-a6328d0eb3bc admin admin] PATH_INFO: `/v3/projects` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:32.493681 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1785e32-9e6f-45b5-81a9-a6328d0eb3bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:32.496007 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1785e32-9e6f-45b5-81a9-a6328d0eb3bc admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:32.498299 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c350189f-63dc-4a6d-9d9b-8e7efb6673ab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:32.500030 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c350189f-63dc-4a6d-9d9b-8e7efb6673ab service cinder] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:32.511261 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 957/1929] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 24 05:46:32 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 496 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:46:32.512200 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c350189f-63dc-4a6d-9d9b-8e7efb6673ab service cinder] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:32.535217 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c350189f-63dc-4a6d-9d9b-8e7efb6673ab service cinder] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:32.536741 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:46:32.552937 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 973/1930] 10.222.0.26 () {60 vars in 1153 bytes} [Wed Aug 24 05:46:32 2022] POST /identity/v3/projects => generated 383 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:46:32.554645 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d863b2b8-8960-4cb5-82bd-9a42984794c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:32.555286 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1785e32-9e6f-45b5-81a9-a6328d0eb3bc admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:32.555402 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d863b2b8-8960-4cb5-82bd-9a42984794c6 admin admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:32.555728 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d863b2b8-8960-4cb5-82bd-9a42984794c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:32.556076 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d863b2b8-8960-4cb5-82bd-9a42984794c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:32.557141 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d863b2b8-8960-4cb5-82bd-9a42984794c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:32.559054 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d863b2b8-8960-4cb5-82bd-9a42984794c6 admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:32.583415 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 958/1931] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Aug 24 05:46:32 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:46:32.585566 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d863b2b8-8960-4cb5-82bd-9a42984794c6 admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:32.602819 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d863b2b8-8960-4cb5-82bd-9a42984794c6 admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:32.654581 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:46:32.664433 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1785e32-9e6f-45b5-81a9-a6328d0eb3bc admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:32.672015 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b603658-fd0b-457b-963e-73bb92bf5f9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:32.672701 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b603658-fd0b-457b-963e-73bb92bf5f9f admin admin] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:32.672985 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b603658-fd0b-457b-963e-73bb92bf5f9f admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:32.673805 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b603658-fd0b-457b-963e-73bb92bf5f9f admin admin] PATH_INFO: `/v3/users` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:32.674527 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b603658-fd0b-457b-963e-73bb92bf5f9f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:32.677170 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b603658-fd0b-457b-963e-73bb92bf5f9f admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:32.717971 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3914ea11-5fad-4a81-86bb-b8d19b85619e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:32.718604 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3914ea11-5fad-4a81-86bb-b8d19b85619e admin admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:32.718929 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3914ea11-5fad-4a81-86bb-b8d19b85619e admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:32.719279 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3914ea11-5fad-4a81-86bb-b8d19b85619e admin admin] PATH_INFO: `/v3/roles` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:32.719799 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3914ea11-5fad-4a81-86bb-b8d19b85619e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:32.721422 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3914ea11-5fad-4a81-86bb-b8d19b85619e admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:32.733132 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 974/1932] 10.222.0.26 () {60 vars in 1144 bytes} [Wed Aug 24 05:46:32 2022] POST /identity/v3/users => generated 298 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:46:32.734111 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b603658-fd0b-457b-963e-73bb92bf5f9f admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:32.751336 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 959/1933] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Aug 24 05:46:32 2022] GET /identity/v3/roles => generated 1420 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:46:32.752510 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3914ea11-5fad-4a81-86bb-b8d19b85619e admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:32.757818 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b603658-fd0b-457b-963e-73bb92bf5f9f admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:32.766631 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38c5815-8215-41e0-b66a-86dfaf50ed1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:32.769049 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3914ea11-5fad-4a81-86bb-b8d19b85619e admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:32.770045 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38c5815-8215-41e0-b66a-86dfaf50ed1f admin admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:32.770522 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38c5815-8215-41e0-b66a-86dfaf50ed1f admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:32.770854 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38c5815-8215-41e0-b66a-86dfaf50ed1f admin admin] PATH_INFO: `/v3/roles` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:32.771528 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38c5815-8215-41e0-b66a-86dfaf50ed1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:32.774593 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c61af34-f151-4d4a-bbd1-b7335b3a38b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:32.775212 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38c5815-8215-41e0-b66a-86dfaf50ed1f admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:32.775324 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c61af34-f151-4d4a-bbd1-b7335b3a38b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:32.779188 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c61af34-f151-4d4a-bbd1-b7335b3a38b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:32.779188 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c61af34-f151-4d4a-bbd1-b7335b3a38b4 admin admin] PATH_INFO: `/v3/projects/4de4279843dc479195aa344056d9d8c3/users/b362b4c14190423581744dda99915575/roles/f7aa4a2c74c94c1b9ca8ecdcccccda5c` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:32.793228 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c61af34-f151-4d4a-bbd1-b7335b3a38b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4de4279843dc479195aa344056d9d8c3, user_id=b362b4c14190423581744dda99915575, role_id=f7aa4a2c74c94c1b9ca8ecdcccccda5c)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:32.796693 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c61af34-f151-4d4a-bbd1-b7335b3a38b4 admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:32.807398 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 975/1934] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Aug 24 05:46:32 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:46:32.808325 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38c5815-8215-41e0-b66a-86dfaf50ed1f admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:32.822640 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38c5815-8215-41e0-b66a-86dfaf50ed1f admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:32.824610 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 960/1935] 10.222.0.26 () {60 vars in 1483 bytes} [Wed Aug 24 05:46:32 2022] PUT /identity/v3/projects/4de4279843dc479195aa344056d9d8c3/users/b362b4c14190423581744dda99915575/roles/f7aa4a2c74c94c1b9ca8ecdcccccda5c => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:46:32.835516 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e231c3f-6005-4d0c-b72b-5e2e27330b2f None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:32.835792 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e231c3f-6005-4d0c-b72b-5e2e27330b2f None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:32.836075 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e231c3f-6005-4d0c-b72b-5e2e27330b2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:32.908876 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-9e231c3f-6005-4d0c-b72b-5e2e27330b2f None None] MFA Rules not processed for user `b362b4c14190423581744dda99915575`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:46:32.910212 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-9e231c3f-6005-4d0c-b72b-5e2e27330b2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:32.957896 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a056103f-48fa-48bf-ba63-acd15839351b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:32.958676 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a056103f-48fa-48bf-ba63-acd15839351b admin admin] REQUEST_METHOD: `PUT` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:32.959084 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a056103f-48fa-48bf-ba63-acd15839351b admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:32.959237 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a056103f-48fa-48bf-ba63-acd15839351b admin admin] PATH_INFO: `/v3/projects/60c6ef9b87af4203b8ab937359d7acb4/users/add99c468b00439d884e2c800372bade/roles/640bda0879494e60b72680ee505285f0` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:32.976689 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a056103f-48fa-48bf-ba63-acd15839351b admin admin] RBAC: Authorizing `identity:create_grant(project_id=60c6ef9b87af4203b8ab937359d7acb4, user_id=add99c468b00439d884e2c800372bade, role_id=640bda0879494e60b72680ee505285f0)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:32.979551 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a056103f-48fa-48bf-ba63-acd15839351b admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:32.994281 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 976/1936] 10.222.0.26 () {60 vars in 1483 bytes} [Wed Aug 24 05:46:32 2022] PUT /identity/v3/projects/60c6ef9b87af4203b8ab937359d7acb4/users/add99c468b00439d884e2c800372bade/roles/640bda0879494e60b72680ee505285f0 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:46:32.998203 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a056103f-48fa-48bf-ba63-acd15839351b admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:33.016421 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 961/1937] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:46:32 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:46:33.022119 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e231c3f-6005-4d0c-b72b-5e2e27330b2f None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:33.036150 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e231c3f-6005-4d0c-b72b-5e2e27330b2f None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:33.080113 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a056103f-48fa-48bf-ba63-acd15839351b admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:33.086670 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5c8638-ee57-470d-b90c-ba7bf23442f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:33.087291 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5c8638-ee57-470d-b90c-ba7bf23442f2 admin admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:33.087557 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5c8638-ee57-470d-b90c-ba7bf23442f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:33.087836 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5c8638-ee57-470d-b90c-ba7bf23442f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:33.089857 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5c8638-ee57-470d-b90c-ba7bf23442f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:33.103391 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5c8638-ee57-470d-b90c-ba7bf23442f2 admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:33.105108 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:46:33.109616 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e4d0b2-2902-49d4-8642-1718ed7c4074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:33.110345 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e4d0b2-2902-49d4-8642-1718ed7c4074 admin admin] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:33.110720 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e4d0b2-2902-49d4-8642-1718ed7c4074 admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:33.111006 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e4d0b2-2902-49d4-8642-1718ed7c4074 admin admin] PATH_INFO: `/v3/projects` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:33.111669 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e4d0b2-2902-49d4-8642-1718ed7c4074 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:33.113581 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e4d0b2-2902-49d4-8642-1718ed7c4074 admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:33.121998 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 977/1938] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Aug 24 05:46:32 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 05:46:33.125622 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5c8638-ee57-470d-b90c-ba7bf23442f2 admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:33.136390 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5c8638-ee57-470d-b90c-ba7bf23442f2 admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:33.143040 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f933f2-86f6-4f10-8b81-08a957fe8bc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:33.144365 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f933f2-86f6-4f10-8b81-08a957fe8bc7 admin admin] REQUEST_METHOD: `PUT` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:33.144648 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f933f2-86f6-4f10-8b81-08a957fe8bc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:33.145098 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f933f2-86f6-4f10-8b81-08a957fe8bc7 admin admin] PATH_INFO: `/v3/projects/60c6ef9b87af4203b8ab937359d7acb4/users/add99c468b00439d884e2c800372bade/roles/640bda0879494e60b72680ee505285f0` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:33.149150 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f933f2-86f6-4f10-8b81-08a957fe8bc7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=60c6ef9b87af4203b8ab937359d7acb4, user_id=add99c468b00439d884e2c800372bade, role_id=640bda0879494e60b72680ee505285f0)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:33.156286 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f933f2-86f6-4f10-8b81-08a957fe8bc7 admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:33.165730 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 962/1939] 10.222.0.26 () {60 vars in 1153 bytes} [Wed Aug 24 05:46:33 2022] POST /identity/v3/projects => generated 379 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:46:33.166745 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e4d0b2-2902-49d4-8642-1718ed7c4074 admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:33.176900 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 978/1940] 10.222.0.26 () {60 vars in 1483 bytes} [Wed Aug 24 05:46:33 2022] PUT /identity/v3/projects/60c6ef9b87af4203b8ab937359d7acb4/users/add99c468b00439d884e2c800372bade/roles/640bda0879494e60b72680ee505285f0 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 05:46:33.189019 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b0bed4-3ef9-4cc9-9693-bc30402b6fba None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:33.189377 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b0bed4-3ef9-4cc9-9693-bc30402b6fba None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:33.189724 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b0bed4-3ef9-4cc9-9693-bc30402b6fba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:33.194675 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:46:33.228398 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-88b0bed4-3ef9-4cc9-9693-bc30402b6fba None None] MFA Rules not processed for user `add99c468b00439d884e2c800372bade`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:46:33.229788 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-88b0bed4-3ef9-4cc9-9693-bc30402b6fba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:33.296085 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e4d0b2-2902-49d4-8642-1718ed7c4074 admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:33.357348 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 979/1941] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:46:33 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:46:33.365669 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b0bed4-3ef9-4cc9-9693-bc30402b6fba None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:33.367114 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-88b0bed4-3ef9-4cc9-9693-bc30402b6fba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:33.380520 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0bdba1-b73a-4bab-86f8-182b69afb1b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:33.382338 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0bdba1-b73a-4bab-86f8-182b69afb1b3 admin admin] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:33.383038 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0bdba1-b73a-4bab-86f8-182b69afb1b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:33.383278 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0bdba1-b73a-4bab-86f8-182b69afb1b3 admin admin] PATH_INFO: `/v3/users` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:33.383975 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0bdba1-b73a-4bab-86f8-182b69afb1b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:33.386045 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0bdba1-b73a-4bab-86f8-182b69afb1b3 admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:33.413926 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 963/1942] 10.222.0.26 () {60 vars in 1144 bytes} [Wed Aug 24 05:46:33 2022] POST /identity/v3/users => generated 296 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:46:33.417823 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0bdba1-b73a-4bab-86f8-182b69afb1b3 admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:33.427690 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0bdba1-b73a-4bab-86f8-182b69afb1b3 admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:33.433316 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466da319-d05d-469a-9f45-1176a32564c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:33.434033 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466da319-d05d-469a-9f45-1176a32564c3 admin admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:33.434320 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466da319-d05d-469a-9f45-1176a32564c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:33.434594 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466da319-d05d-469a-9f45-1176a32564c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:33.435993 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466da319-d05d-469a-9f45-1176a32564c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:33.437562 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466da319-d05d-469a-9f45-1176a32564c3 admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:33.444561 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b0bed4-3ef9-4cc9-9693-bc30402b6fba None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:33.448135 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 964/1943] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Aug 24 05:46:33 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:46:33.448899 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbf26cb-0480-4424-bb3e-af3cd3e41a5e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17b450afe795495680fc70f522c83750', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:33.449609 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbf26cb-0480-4424-bb3e-af3cd3e41a5e service cinder] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:33.450042 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbf26cb-0480-4424-bb3e-af3cd3e41a5e service cinder] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:33.450419 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbf26cb-0480-4424-bb3e-af3cd3e41a5e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:33.453982 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466da319-d05d-469a-9f45-1176a32564c3 admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:33.463100 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466da319-d05d-469a-9f45-1176a32564c3 admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:33.464168 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbf26cb-0480-4424-bb3e-af3cd3e41a5e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:33.465599 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbf26cb-0480-4424-bb3e-af3cd3e41a5e service cinder] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:33.471588 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82f2936-e284-48e6-8122-6c3145d17d30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:33.472252 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82f2936-e284-48e6-8122-6c3145d17d30 admin admin] REQUEST_METHOD: `PUT` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:33.472528 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82f2936-e284-48e6-8122-6c3145d17d30 admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:33.472941 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82f2936-e284-48e6-8122-6c3145d17d30 admin admin] PATH_INFO: `/v3/projects/0a4fe5bb5aa642458b77f99cc3e5710b/users/b4fd5c2242a34248aa3f1ebc96639557/roles/640bda0879494e60b72680ee505285f0` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:33.476324 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 980/1944] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 24 05:46:33 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 05:46:33.477185 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbf26cb-0480-4424-bb3e-af3cd3e41a5e service cinder] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:33.486409 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbf26cb-0480-4424-bb3e-af3cd3e41a5e service cinder] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:33.491286 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a891189d-d393-415f-937e-344bd6346352 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17b450afe795495680fc70f522c83750', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:33.491886 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a891189d-d393-415f-937e-344bd6346352 service cinder] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:33.492069 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82f2936-e284-48e6-8122-6c3145d17d30 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a4fe5bb5aa642458b77f99cc3e5710b, user_id=b4fd5c2242a34248aa3f1ebc96639557, role_id=640bda0879494e60b72680ee505285f0)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:33.492181 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a891189d-d393-415f-937e-344bd6346352 service cinder] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:33.492422 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a891189d-d393-415f-937e-344bd6346352 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:33.494228 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-a891189d-d393-415f-937e-344bd6346352 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:33.494729 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82f2936-e284-48e6-8122-6c3145d17d30 admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:33.519739 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 965/1945] 10.222.0.26 () {60 vars in 1483 bytes} [Wed Aug 24 05:46:33 2022] PUT /identity/v3/projects/0a4fe5bb5aa642458b77f99cc3e5710b/users/b4fd5c2242a34248aa3f1ebc96639557/roles/640bda0879494e60b72680ee505285f0 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 05:46:33.520846 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82f2936-e284-48e6-8122-6c3145d17d30 admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:33.574454 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a891189d-d393-415f-937e-344bd6346352 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:33.576721 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a891189d-d393-415f-937e-344bd6346352 service cinder] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:33.588078 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 981/1946] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 24 05:46:33 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:46:33.598965 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a891189d-d393-415f-937e-344bd6346352 service cinder] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:33.607359 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82f2936-e284-48e6-8122-6c3145d17d30 admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:33.607900 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a891189d-d393-415f-937e-344bd6346352 service cinder] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:33.612515 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:46:33.612855 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddbb0d5-3fbb-4512-838c-385ec3fa9457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:33.614031 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddbb0d5-3fbb-4512-838c-385ec3fa9457 admin admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:33.614248 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddbb0d5-3fbb-4512-838c-385ec3fa9457 admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:33.614607 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddbb0d5-3fbb-4512-838c-385ec3fa9457 admin admin] PATH_INFO: `/v3/roles` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:33.615287 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddbb0d5-3fbb-4512-838c-385ec3fa9457 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:33.617038 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddbb0d5-3fbb-4512-838c-385ec3fa9457 admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:33.631350 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 966/1947] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Aug 24 05:46:33 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:46:33.632296 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddbb0d5-3fbb-4512-838c-385ec3fa9457 admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:33.643551 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddbb0d5-3fbb-4512-838c-385ec3fa9457 admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:33.648690 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1edb30a-e7b6-4809-89e8-83d003efc56c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:33.649368 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1edb30a-e7b6-4809-89e8-83d003efc56c admin admin] REQUEST_METHOD: `PUT` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:33.649627 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1edb30a-e7b6-4809-89e8-83d003efc56c admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:33.650817 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1edb30a-e7b6-4809-89e8-83d003efc56c admin admin] PATH_INFO: `/v3/projects/0a4fe5bb5aa642458b77f99cc3e5710b/users/b4fd5c2242a34248aa3f1ebc96639557/roles/640bda0879494e60b72680ee505285f0` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:33.652329 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1edb30a-e7b6-4809-89e8-83d003efc56c admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a4fe5bb5aa642458b77f99cc3e5710b, user_id=b4fd5c2242a34248aa3f1ebc96639557, role_id=640bda0879494e60b72680ee505285f0)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:33.655762 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1edb30a-e7b6-4809-89e8-83d003efc56c admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:33.658194 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:46:33.676391 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2797d2ec-7b14-4398-89e8-04ba9d0eb558 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17b450afe795495680fc70f522c83750', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:33.677062 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2797d2ec-7b14-4398-89e8-04ba9d0eb558 service cinder] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:33.677359 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2797d2ec-7b14-4398-89e8-04ba9d0eb558 service cinder] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:33.677581 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 967/1948] 10.222.0.26 () {60 vars in 1483 bytes} [Wed Aug 24 05:46:33 2022] PUT /identity/v3/projects/0a4fe5bb5aa642458b77f99cc3e5710b/users/b4fd5c2242a34248aa3f1ebc96639557/roles/640bda0879494e60b72680ee505285f0 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:46:33.677986 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2797d2ec-7b14-4398-89e8-04ba9d0eb558 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:33.689674 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b1d5da-381e-44ac-95c3-6e6aaf848803 None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:33.690047 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b1d5da-381e-44ac-95c3-6e6aaf848803 None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:33.690371 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b1d5da-381e-44ac-95c3-6e6aaf848803 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:33.728668 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-91b1d5da-381e-44ac-95c3-6e6aaf848803 None None] MFA Rules not processed for user `b4fd5c2242a34248aa3f1ebc96639557`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:46:33.729895 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-91b1d5da-381e-44ac-95c3-6e6aaf848803 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:33.784792 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2797d2ec-7b14-4398-89e8-04ba9d0eb558 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:33.786643 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2797d2ec-7b14-4398-89e8-04ba9d0eb558 service cinder] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:33.804792 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 982/1949] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 24 05:46:33 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 05:46:33.832117 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 968/1950] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:46:33 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 05:46:33.925019 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2797d2ec-7b14-4398-89e8-04ba9d0eb558 service cinder] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:33.929465 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2797d2ec-7b14-4398-89e8-04ba9d0eb558 service cinder] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:34.051618 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9a2af7-45a1-4367-bad8-2ecc1499b389 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17b450afe795495680fc70f522c83750', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:34.052412 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9a2af7-45a1-4367-bad8-2ecc1499b389 service cinder] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:34.052783 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9a2af7-45a1-4367-bad8-2ecc1499b389 service cinder] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:34.053252 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9a2af7-45a1-4367-bad8-2ecc1499b389 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:34.066774 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9a2af7-45a1-4367-bad8-2ecc1499b389 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:34.068556 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9a2af7-45a1-4367-bad8-2ecc1499b389 service cinder] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:34.082318 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 983/1951] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 24 05:46:33 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:46:34.179686 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b1d5da-381e-44ac-95c3-6e6aaf848803 None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:34.202781 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b1d5da-381e-44ac-95c3-6e6aaf848803 None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:34.216467 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e8b946-3ed9-4322-8c5a-ed21cd064466 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17b450afe795495680fc70f522c83750', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:34.217316 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e8b946-3ed9-4322-8c5a-ed21cd064466 service cinder] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:34.217769 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e8b946-3ed9-4322-8c5a-ed21cd064466 service cinder] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:34.218218 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e8b946-3ed9-4322-8c5a-ed21cd064466 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:34.295047 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e8b946-3ed9-4322-8c5a-ed21cd064466 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:34.296637 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e8b946-3ed9-4322-8c5a-ed21cd064466 service cinder] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:34.306387 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 969/1952] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 24 05:46:34 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:46:34.638214 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9a2af7-45a1-4367-bad8-2ecc1499b389 service cinder] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:34.639900 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-ac9a2af7-45a1-4367-bad8-2ecc1499b389 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:34.723065 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9a2af7-45a1-4367-bad8-2ecc1499b389 service cinder] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:34.728644 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff3c160-f1ae-40ae-ad63-6b63422c4399 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:34.728972 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff3c160-f1ae-40ae-ad63-6b63422c4399 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:34.729471 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff3c160-f1ae-40ae-ad63-6b63422c4399 admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:34.729583 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff3c160-f1ae-40ae-ad63-6b63422c4399 admin admin] PATH_INFO: `/v3/users/b4c778efce634b6e83e08074cee24bea` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:34.730914 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff3c160-f1ae-40ae-ad63-6b63422c4399 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b4c778efce634b6e83e08074cee24bea)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:34.733707 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff3c160-f1ae-40ae-ad63-6b63422c4399 admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:34.740398 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:46:34.783057 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-aff3c160-f1ae-40ae-ad63-6b63422c4399 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b4c778efce634b6e83e08074cee24bea'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:34.790117 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-aff3c160-f1ae-40ae-ad63-6b63422c4399 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b4c778efce634b6e83e08074cee24bea'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:34.790789 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-aff3c160-f1ae-40ae-ad63-6b63422c4399 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b4c778efce634b6e83e08074cee24bea'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:34.803926 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-aff3c160-f1ae-40ae-ad63-6b63422c4399 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b4c778efce634b6e83e08074cee24bea'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:34.810603 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-aff3c160-f1ae-40ae-ad63-6b63422c4399 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b4c778efce634b6e83e08074cee24bea'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:34.816558 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 984/1953] 10.222.0.26 () {58 vars in 1224 bytes} [Wed Aug 24 05:46:34 2022] DELETE /identity/v3/users/b4c778efce634b6e83e08074cee24bea => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:46:34.821469 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4c3b3f-bf99-4465-b7ab-108c142f8974 None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:34.822458 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4c3b3f-bf99-4465-b7ab-108c142f8974 None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:34.822458 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4c3b3f-bf99-4465-b7ab-108c142f8974 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:34.841564 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-2b4c3b3f-bf99-4465-b7ab-108c142f8974 None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:46:34.842715 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-2b4c3b3f-bf99-4465-b7ab-108c142f8974 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:34.901308 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 970/1954] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:46:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 05:46:34.912685 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff3c160-f1ae-40ae-ad63-6b63422c4399 admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:34.914158 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-aff3c160-f1ae-40ae-ad63-6b63422c4399 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:34.971990 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff3c160-f1ae-40ae-ad63-6b63422c4399 admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:34.975544 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57daafe7-a2ea-4416-b6f6-254bc22349ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '874348b647194ac2b5ecbf12c33bf59e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:34.976151 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57daafe7-a2ea-4416-b6f6-254bc22349ea service neutron] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:34.976427 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57daafe7-a2ea-4416-b6f6-254bc22349ea service neutron] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:34.976694 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57daafe7-a2ea-4416-b6f6-254bc22349ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:34.986529 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57daafe7-a2ea-4416-b6f6-254bc22349ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:34.987955 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57daafe7-a2ea-4416-b6f6-254bc22349ea service neutron] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:34.997299 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 985/1955] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 24 05:46:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:46:35.288138 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4c3b3f-bf99-4465-b7ab-108c142f8974 None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:35.290053 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-2b4c3b3f-bf99-4465-b7ab-108c142f8974 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:35.322147 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4c3b3f-bf99-4465-b7ab-108c142f8974 None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:35.330524 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcdb4da-7d90-4c90-8d8f-40e46350ce34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:35.331202 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcdb4da-7d90-4c90-8d8f-40e46350ce34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:35.331482 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcdb4da-7d90-4c90-8d8f-40e46350ce34 admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:35.331752 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcdb4da-7d90-4c90-8d8f-40e46350ce34 admin admin] PATH_INFO: `/v3/projects/d306a792d1c7437ca3019198bb59dce2` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:35.333047 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcdb4da-7d90-4c90-8d8f-40e46350ce34 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d306a792d1c7437ca3019198bb59dce2)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:35.334997 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcdb4da-7d90-4c90-8d8f-40e46350ce34 admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:35.350129 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:46:35.392226 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-5fcdb4da-7d90-4c90-8d8f-40e46350ce34 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd306a792d1c7437ca3019198bb59dce2', 'request_id': 'req-5fcdb4da-7d90-4c90-8d8f-40e46350ce34'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:35.402850 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-5fcdb4da-7d90-4c90-8d8f-40e46350ce34 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd306a792d1c7437ca3019198bb59dce2', 'request_id': 'req-5fcdb4da-7d90-4c90-8d8f-40e46350ce34'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:35.411141 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-5fcdb4da-7d90-4c90-8d8f-40e46350ce34 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd306a792d1c7437ca3019198bb59dce2', 'request_id': 'req-5fcdb4da-7d90-4c90-8d8f-40e46350ce34'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:35.424616 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-5fcdb4da-7d90-4c90-8d8f-40e46350ce34 admin admin] The token cache is being invalidate because project d306a792d1c7437ca3019198bb59dce2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88112) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:46:35.427155 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-5fcdb4da-7d90-4c90-8d8f-40e46350ce34 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:35.430413 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-5fcdb4da-7d90-4c90-8d8f-40e46350ce34 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:35.432605 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 971/1956] 10.222.0.26 () {58 vars in 1233 bytes} [Wed Aug 24 05:46:35 2022] DELETE /identity/v3/projects/d306a792d1c7437ca3019198bb59dce2 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:46:35.437257 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57daafe7-a2ea-4416-b6f6-254bc22349ea service neutron] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:35.448093 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57daafe7-a2ea-4416-b6f6-254bc22349ea service neutron] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:35.539507 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19edb2b-d05e-427c-b0e5-c51237e10442 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:35.540296 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19edb2b-d05e-427c-b0e5-c51237e10442 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:35.543168 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19edb2b-d05e-427c-b0e5-c51237e10442 admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:35.543458 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19edb2b-d05e-427c-b0e5-c51237e10442 admin admin] PATH_INFO: `/v3/users/9aae15e9d2f443018165e7297caa0424` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:35.544759 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19edb2b-d05e-427c-b0e5-c51237e10442 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9aae15e9d2f443018165e7297caa0424)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:35.546766 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19edb2b-d05e-427c-b0e5-c51237e10442 admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:35.607021 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:46:35.629002 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-b19edb2b-d05e-427c-b0e5-c51237e10442 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9aae15e9d2f443018165e7297caa0424'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:35.636906 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-b19edb2b-d05e-427c-b0e5-c51237e10442 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9aae15e9d2f443018165e7297caa0424'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:35.637607 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-b19edb2b-d05e-427c-b0e5-c51237e10442 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9aae15e9d2f443018165e7297caa0424'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:35.661637 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-b19edb2b-d05e-427c-b0e5-c51237e10442 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9aae15e9d2f443018165e7297caa0424'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:35.669921 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-b19edb2b-d05e-427c-b0e5-c51237e10442 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9aae15e9d2f443018165e7297caa0424'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:35.676513 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 986/1957] 10.222.0.26 () {58 vars in 1224 bytes} [Wed Aug 24 05:46:35 2022] DELETE /identity/v3/users/9aae15e9d2f443018165e7297caa0424 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:46:35.971272 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcdb4da-7d90-4c90-8d8f-40e46350ce34 admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:35.973924 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-5fcdb4da-7d90-4c90-8d8f-40e46350ce34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:35.992601 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcdb4da-7d90-4c90-8d8f-40e46350ce34 admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:36.078461 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d1ac83-d9ed-4af7-b180-e50f9df3ab20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:36.079332 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d1ac83-d9ed-4af7-b180-e50f9df3ab20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:36.080084 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d1ac83-d9ed-4af7-b180-e50f9df3ab20 admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:36.080478 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d1ac83-d9ed-4af7-b180-e50f9df3ab20 admin admin] PATH_INFO: `/v3/projects/39dae25a5dce4ae9bb7625a674b678fd` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:36.081721 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d1ac83-d9ed-4af7-b180-e50f9df3ab20 admin admin] RBAC: Authorizing `identity:delete_project(project_id=39dae25a5dce4ae9bb7625a674b678fd)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:36.083939 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d1ac83-d9ed-4af7-b180-e50f9df3ab20 admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:36.146135 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-36d1ac83-d9ed-4af7-b180-e50f9df3ab20 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '39dae25a5dce4ae9bb7625a674b678fd', 'request_id': 'req-36d1ac83-d9ed-4af7-b180-e50f9df3ab20'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:36.155306 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-36d1ac83-d9ed-4af7-b180-e50f9df3ab20 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '39dae25a5dce4ae9bb7625a674b678fd', 'request_id': 'req-36d1ac83-d9ed-4af7-b180-e50f9df3ab20'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:36.163015 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-36d1ac83-d9ed-4af7-b180-e50f9df3ab20 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '39dae25a5dce4ae9bb7625a674b678fd', 'request_id': 'req-36d1ac83-d9ed-4af7-b180-e50f9df3ab20'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:36.175114 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-36d1ac83-d9ed-4af7-b180-e50f9df3ab20 admin admin] The token cache is being invalidate because project 39dae25a5dce4ae9bb7625a674b678fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88112) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:46:36.175411 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-36d1ac83-d9ed-4af7-b180-e50f9df3ab20 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:36.176174 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-36d1ac83-d9ed-4af7-b180-e50f9df3ab20 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:36.177887 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 972/1958] 10.222.0.26 () {58 vars in 1233 bytes} [Wed Aug 24 05:46:35 2022] DELETE /identity/v3/projects/39dae25a5dce4ae9bb7625a674b678fd => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:46:36.182543 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050dcf3a-1fde-4c46-b6f0-2c66f29af915 None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:36.182834 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050dcf3a-1fde-4c46-b6f0-2c66f29af915 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:36.183106 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050dcf3a-1fde-4c46-b6f0-2c66f29af915 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:36.205444 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-050dcf3a-1fde-4c46-b6f0-2c66f29af915 None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:46:36.206784 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-050dcf3a-1fde-4c46-b6f0-2c66f29af915 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:36.277631 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 987/1959] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:46:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:46:36.286202 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a5372e-b206-462c-bd3e-c17478bd8d4a None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:36.286556 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a5372e-b206-462c-bd3e-c17478bd8d4a None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:36.286986 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a5372e-b206-462c-bd3e-c17478bd8d4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:36.307355 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-b2a5372e-b206-462c-bd3e-c17478bd8d4a None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:46:36.308678 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-b2a5372e-b206-462c-bd3e-c17478bd8d4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:36.317019 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 973/1960] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:46:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:46:36.321488 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050dcf3a-1fde-4c46-b6f0-2c66f29af915 None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:36.331943 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050dcf3a-1fde-4c46-b6f0-2c66f29af915 None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:36.337373 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118f37c5-068a-4ef9-974a-94567ff646e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:36.338005 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118f37c5-068a-4ef9-974a-94567ff646e2 admin admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:36.338289 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118f37c5-068a-4ef9-974a-94567ff646e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:36.338558 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118f37c5-068a-4ef9-974a-94567ff646e2 admin admin] PATH_INFO: `/v3/domains` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:36.339220 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118f37c5-068a-4ef9-974a-94567ff646e2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:46:36.339515 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118f37c5-068a-4ef9-974a-94567ff646e2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:36.342112 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118f37c5-068a-4ef9-974a-94567ff646e2 admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:36.355585 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 988/1961] 10.222.0.26 () {58 vars in 1153 bytes} [Wed Aug 24 05:46:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:46:36.360805 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a5372e-b206-462c-bd3e-c17478bd8d4a None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:36.370435 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a5372e-b206-462c-bd3e-c17478bd8d4a None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:36.375152 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed3f195-2b50-4097-9b45-c39873b603bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:36.375823 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed3f195-2b50-4097-9b45-c39873b603bf admin admin] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:36.376014 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed3f195-2b50-4097-9b45-c39873b603bf admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:36.376259 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed3f195-2b50-4097-9b45-c39873b603bf admin admin] PATH_INFO: `/v3/projects` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:36.376887 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed3f195-2b50-4097-9b45-c39873b603bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:36.378834 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed3f195-2b50-4097-9b45-c39873b603bf admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:36.410844 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 974/1962] 10.222.0.26 () {60 vars in 1153 bytes} [Wed Aug 24 05:46:36 2022] POST /identity/v3/projects => generated 409 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:46:36.414900 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118f37c5-068a-4ef9-974a-94567ff646e2 admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:36.426972 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118f37c5-068a-4ef9-974a-94567ff646e2 admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:36.485259 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc055ea5-9f73-4b3c-816a-a11cce6efabe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:36.486220 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc055ea5-9f73-4b3c-816a-a11cce6efabe admin admin] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:36.486464 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc055ea5-9f73-4b3c-816a-a11cce6efabe admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:36.486739 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc055ea5-9f73-4b3c-816a-a11cce6efabe admin admin] PATH_INFO: `/v3/users` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:36.487435 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc055ea5-9f73-4b3c-816a-a11cce6efabe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:36.489417 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc055ea5-9f73-4b3c-816a-a11cce6efabe admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:36.524826 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed3f195-2b50-4097-9b45-c39873b603bf admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:36.530120 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 989/1963] 10.222.0.26 () {60 vars in 1144 bytes} [Wed Aug 24 05:46:36 2022] POST /identity/v3/users => generated 305 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:46:36.532278 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:46:36.538470 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed3f195-2b50-4097-9b45-c39873b603bf admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:36.548093 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee0e586-917d-4834-b4b1-2c8c19e0fc27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:36.549281 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee0e586-917d-4834-b4b1-2c8c19e0fc27 admin admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:36.549651 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee0e586-917d-4834-b4b1-2c8c19e0fc27 admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:36.550032 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee0e586-917d-4834-b4b1-2c8c19e0fc27 admin admin] PATH_INFO: `/v3/roles` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:36.550754 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee0e586-917d-4834-b4b1-2c8c19e0fc27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:36.552477 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee0e586-917d-4834-b4b1-2c8c19e0fc27 admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:36.565973 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 975/1964] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Aug 24 05:46:36 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:46:36.569267 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc055ea5-9f73-4b3c-816a-a11cce6efabe admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:36.583122 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc055ea5-9f73-4b3c-816a-a11cce6efabe admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:36.588260 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8132707-264a-4655-8baa-4d26a1eb91a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:36.588881 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8132707-264a-4655-8baa-4d26a1eb91a0 admin admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:36.589167 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8132707-264a-4655-8baa-4d26a1eb91a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:36.589613 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8132707-264a-4655-8baa-4d26a1eb91a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:36.590301 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8132707-264a-4655-8baa-4d26a1eb91a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:36.592460 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8132707-264a-4655-8baa-4d26a1eb91a0 admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:36.604470 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 990/1965] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Aug 24 05:46:36 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:46:36.608915 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee0e586-917d-4834-b4b1-2c8c19e0fc27 admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:36.633060 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee0e586-917d-4834-b4b1-2c8c19e0fc27 admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:36.639932 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a869ea47-b8a3-4a25-8798-4853587fb16c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:36.640334 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8132707-264a-4655-8baa-4d26a1eb91a0 admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:36.640945 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a869ea47-b8a3-4a25-8798-4853587fb16c admin admin] REQUEST_METHOD: `PUT` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:36.641234 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a869ea47-b8a3-4a25-8798-4853587fb16c admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:36.641511 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a869ea47-b8a3-4a25-8798-4853587fb16c admin admin] PATH_INFO: `/v3/projects/940b143e02d844c1992ce48992e1746e/users/346e3a6e9ba444e4b3f6865f8f1cb741/roles/f7aa4a2c74c94c1b9ca8ecdcccccda5c` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:36.642789 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-b8132707-264a-4655-8baa-4d26a1eb91a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:36.657776 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8132707-264a-4655-8baa-4d26a1eb91a0 admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:36.662047 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a869ea47-b8a3-4a25-8798-4853587fb16c admin admin] RBAC: Authorizing `identity:create_grant(project_id=940b143e02d844c1992ce48992e1746e, user_id=346e3a6e9ba444e4b3f6865f8f1cb741, role_id=f7aa4a2c74c94c1b9ca8ecdcccccda5c)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:36.663097 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478e5116-95ae-4c93-b36e-02c73726c792 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:36.663833 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478e5116-95ae-4c93-b36e-02c73726c792 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:36.664112 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478e5116-95ae-4c93-b36e-02c73726c792 admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:36.664439 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478e5116-95ae-4c93-b36e-02c73726c792 admin admin] PATH_INFO: `/v3/users/2ac781990fae4936a5f59462ca01db35` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:36.664718 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a869ea47-b8a3-4a25-8798-4853587fb16c admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:36.665578 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478e5116-95ae-4c93-b36e-02c73726c792 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ac781990fae4936a5f59462ca01db35)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:36.667733 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478e5116-95ae-4c93-b36e-02c73726c792 admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:36.674980 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:46:36.683824 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 976/1966] 10.222.0.26 () {60 vars in 1483 bytes} [Wed Aug 24 05:46:36 2022] PUT /identity/v3/projects/940b143e02d844c1992ce48992e1746e/users/346e3a6e9ba444e4b3f6865f8f1cb741/roles/f7aa4a2c74c94c1b9ca8ecdcccccda5c => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 05:46:36.696404 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d335259-a360-4f84-909c-fd0438d43aa2 None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:36.697347 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d335259-a360-4f84-909c-fd0438d43aa2 None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:36.697632 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d335259-a360-4f84-909c-fd0438d43aa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:36.737721 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-478e5116-95ae-4c93-b36e-02c73726c792 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ac781990fae4936a5f59462ca01db35'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:36.746101 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-7d335259-a360-4f84-909c-fd0438d43aa2 None None] MFA Rules not processed for user `346e3a6e9ba444e4b3f6865f8f1cb741`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:46:36.748295 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-7d335259-a360-4f84-909c-fd0438d43aa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:36.748999 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-478e5116-95ae-4c93-b36e-02c73726c792 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ac781990fae4936a5f59462ca01db35'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:36.749924 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-478e5116-95ae-4c93-b36e-02c73726c792 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ac781990fae4936a5f59462ca01db35'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:36.772195 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-478e5116-95ae-4c93-b36e-02c73726c792 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ac781990fae4936a5f59462ca01db35'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:36.786178 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-478e5116-95ae-4c93-b36e-02c73726c792 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ac781990fae4936a5f59462ca01db35'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:36.800215 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 991/1967] 10.222.0.26 () {58 vars in 1224 bytes} [Wed Aug 24 05:46:36 2022] DELETE /identity/v3/users/2ac781990fae4936a5f59462ca01db35 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 05:46:36.802341 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31ef50a-7703-4e39-ade9-0bce3ad2b075 None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:36.802341 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31ef50a-7703-4e39-ade9-0bce3ad2b075 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:36.802485 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31ef50a-7703-4e39-ade9-0bce3ad2b075 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:36.837924 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-a31ef50a-7703-4e39-ade9-0bce3ad2b075 None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:46:36.847089 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-a31ef50a-7703-4e39-ade9-0bce3ad2b075 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:36.923340 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 977/1968] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:46:36 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:46:36.928537 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d335259-a360-4f84-909c-fd0438d43aa2 None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:36.932320 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-7d335259-a360-4f84-909c-fd0438d43aa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:36.982555 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 992/1969] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:46:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:46:36.994123 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31ef50a-7703-4e39-ade9-0bce3ad2b075 None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:36.995611 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-a31ef50a-7703-4e39-ade9-0bce3ad2b075 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:37.016328 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d335259-a360-4f84-909c-fd0438d43aa2 None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:37.022416 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296c9008-c595-4589-af26-4296dd3ed7a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:37.023029 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296c9008-c595-4589-af26-4296dd3ed7a0 admin admin] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:37.023304 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296c9008-c595-4589-af26-4296dd3ed7a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:37.023573 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296c9008-c595-4589-af26-4296dd3ed7a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:37.024199 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296c9008-c595-4589-af26-4296dd3ed7a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:37.026134 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296c9008-c595-4589-af26-4296dd3ed7a0 admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:37.053422 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 978/1970] 10.222.0.26 () {60 vars in 1153 bytes} [Wed Aug 24 05:46:36 2022] POST /identity/v3/projects => generated 409 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:46:37.056462 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31ef50a-7703-4e39-ade9-0bce3ad2b075 None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:37.057627 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296c9008-c595-4589-af26-4296dd3ed7a0 admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:37.098051 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:46:37.104992 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:46:37.110343 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73931f3-eded-4835-9c76-f7c85fd3c528 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '874348b647194ac2b5ecbf12c33bf59e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:37.110956 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73931f3-eded-4835-9c76-f7c85fd3c528 service neutron] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:37.111246 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73931f3-eded-4835-9c76-f7c85fd3c528 service neutron] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:37.111522 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73931f3-eded-4835-9c76-f7c85fd3c528 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:37.124794 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296c9008-c595-4589-af26-4296dd3ed7a0 admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:37.129404 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567e022a-b660-4cd4-bec8-33bb5c345215 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:37.130064 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567e022a-b660-4cd4-bec8-33bb5c345215 admin admin] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:37.130370 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567e022a-b660-4cd4-bec8-33bb5c345215 admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:37.130666 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567e022a-b660-4cd4-bec8-33bb5c345215 admin admin] PATH_INFO: `/v3/users` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:37.131286 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567e022a-b660-4cd4-bec8-33bb5c345215 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:37.133230 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567e022a-b660-4cd4-bec8-33bb5c345215 admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:37.156190 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 979/1971] 10.222.0.26 () {60 vars in 1144 bytes} [Wed Aug 24 05:46:37 2022] POST /identity/v3/users => generated 311 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:46:37.160188 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567e022a-b660-4cd4-bec8-33bb5c345215 admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:37.169633 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567e022a-b660-4cd4-bec8-33bb5c345215 admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:37.173226 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73931f3-eded-4835-9c76-f7c85fd3c528 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:37.174689 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73931f3-eded-4835-9c76-f7c85fd3c528 service neutron] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:37.174937 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1013a9-0f45-49d1-911e-ea3c0ff94d39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:37.175524 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1013a9-0f45-49d1-911e-ea3c0ff94d39 admin admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:37.175971 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1013a9-0f45-49d1-911e-ea3c0ff94d39 admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:37.176153 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1013a9-0f45-49d1-911e-ea3c0ff94d39 admin admin] PATH_INFO: `/v3/roles` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:37.176876 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1013a9-0f45-49d1-911e-ea3c0ff94d39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:37.178640 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1013a9-0f45-49d1-911e-ea3c0ff94d39 admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:37.186079 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 993/1972] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 24 05:46:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 05:46:37.193446 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 980/1973] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Aug 24 05:46:37 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:46:37.194587 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73931f3-eded-4835-9c76-f7c85fd3c528 service neutron] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:37.205132 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73931f3-eded-4835-9c76-f7c85fd3c528 service neutron] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:37.209809 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2e1477-89b1-4bd4-8165-69ff975f16bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:37.210520 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2e1477-89b1-4bd4-8165-69ff975f16bf admin admin] REQUEST_METHOD: `PUT` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:37.210803 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2e1477-89b1-4bd4-8165-69ff975f16bf admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:37.211079 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2e1477-89b1-4bd4-8165-69ff975f16bf admin admin] PATH_INFO: `/v3/projects/0f693135afb84d56846c2c91a6860c1a/users/05c4fe27bcfe4b979ca2831c6e768a81/roles/640bda0879494e60b72680ee505285f0` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:37.226435 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2e1477-89b1-4bd4-8165-69ff975f16bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f693135afb84d56846c2c91a6860c1a, user_id=05c4fe27bcfe4b979ca2831c6e768a81, role_id=640bda0879494e60b72680ee505285f0)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:37.229228 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2e1477-89b1-4bd4-8165-69ff975f16bf admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:37.248861 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 994/1974] 10.222.0.26 () {60 vars in 1483 bytes} [Wed Aug 24 05:46:37 2022] PUT /identity/v3/projects/0f693135afb84d56846c2c91a6860c1a/users/05c4fe27bcfe4b979ca2831c6e768a81/roles/640bda0879494e60b72680ee505285f0 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 05:46:37.253658 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1013a9-0f45-49d1-911e-ea3c0ff94d39 admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:37.269651 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1013a9-0f45-49d1-911e-ea3c0ff94d39 admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:37.334894 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57066fee-dac0-4ad7-96a4-126638f4aca4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:37.335722 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57066fee-dac0-4ad7-96a4-126638f4aca4 admin admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:37.336134 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57066fee-dac0-4ad7-96a4-126638f4aca4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:37.336785 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57066fee-dac0-4ad7-96a4-126638f4aca4 admin admin] PATH_INFO: `/v3/roles` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:37.337252 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57066fee-dac0-4ad7-96a4-126638f4aca4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:37.338956 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57066fee-dac0-4ad7-96a4-126638f4aca4 admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:37.355530 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 981/1975] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Aug 24 05:46:37 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:46:37.358837 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2e1477-89b1-4bd4-8165-69ff975f16bf admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:37.373735 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57066fee-dac0-4ad7-96a4-126638f4aca4 admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:37.375856 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-57066fee-dac0-4ad7-96a4-126638f4aca4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:37.377770 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2e1477-89b1-4bd4-8165-69ff975f16bf admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:37.384196 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddce325-f221-4741-9ec7-45d97112b0c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:37.385734 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddce325-f221-4741-9ec7-45d97112b0c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:37.386057 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddce325-f221-4741-9ec7-45d97112b0c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:37.386338 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddce325-f221-4741-9ec7-45d97112b0c7 admin admin] PATH_INFO: `/v3/projects/0f693135afb84d56846c2c91a6860c1a/users/05c4fe27bcfe4b979ca2831c6e768a81/roles/640bda0879494e60b72680ee505285f0` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:37.388933 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddce325-f221-4741-9ec7-45d97112b0c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f693135afb84d56846c2c91a6860c1a, user_id=05c4fe27bcfe4b979ca2831c6e768a81, role_id=640bda0879494e60b72680ee505285f0)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:37.391708 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddce325-f221-4741-9ec7-45d97112b0c7 admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:37.395374 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57066fee-dac0-4ad7-96a4-126638f4aca4 admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:37.401336 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23aa79d-984a-49c4-96b9-7347c29ab4df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:37.402265 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23aa79d-984a-49c4-96b9-7347c29ab4df admin admin] REQUEST_METHOD: `DELETE` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:37.402737 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23aa79d-984a-49c4-96b9-7347c29ab4df admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:37.403196 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23aa79d-984a-49c4-96b9-7347c29ab4df admin admin] PATH_INFO: `/v3/users/a1322bd7a56246ebad690c32cde6e2fe` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:37.403992 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 995/1976] 10.222.0.26 () {60 vars in 1483 bytes} [Wed Aug 24 05:46:37 2022] PUT /identity/v3/projects/0f693135afb84d56846c2c91a6860c1a/users/05c4fe27bcfe4b979ca2831c6e768a81/roles/640bda0879494e60b72680ee505285f0 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 05:46:37.404908 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23aa79d-984a-49c4-96b9-7347c29ab4df admin admin] RBAC: Authorizing `identity:delete_user(user_id=a1322bd7a56246ebad690c32cde6e2fe)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:37.407093 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23aa79d-984a-49c4-96b9-7347c29ab4df admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:37.415649 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c070d49e-fc27-4125-af76-517347e4014b None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:37.415963 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c070d49e-fc27-4125-af76-517347e4014b None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:37.416204 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c070d49e-fc27-4125-af76-517347e4014b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:37.452530 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-c070d49e-fc27-4125-af76-517347e4014b None None] MFA Rules not processed for user `05c4fe27bcfe4b979ca2831c6e768a81`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:46:37.454242 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-c070d49e-fc27-4125-af76-517347e4014b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:37.478623 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-f23aa79d-984a-49c4-96b9-7347c29ab4df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a1322bd7a56246ebad690c32cde6e2fe'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:37.487836 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-f23aa79d-984a-49c4-96b9-7347c29ab4df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a1322bd7a56246ebad690c32cde6e2fe'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:37.503265 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-f23aa79d-984a-49c4-96b9-7347c29ab4df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a1322bd7a56246ebad690c32cde6e2fe'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:37.512606 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-f23aa79d-984a-49c4-96b9-7347c29ab4df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a1322bd7a56246ebad690c32cde6e2fe'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:37.513537 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-f23aa79d-984a-49c4-96b9-7347c29ab4df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a1322bd7a56246ebad690c32cde6e2fe'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:37.523711 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 982/1977] 10.222.0.26 () {58 vars in 1224 bytes} [Wed Aug 24 05:46:37 2022] DELETE /identity/v3/users/a1322bd7a56246ebad690c32cde6e2fe => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 05:46:37.529874 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840376e0-fc41-468e-a24b-6ed8ecc8a6e5 None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:37.530198 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840376e0-fc41-468e-a24b-6ed8ecc8a6e5 None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:37.530482 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840376e0-fc41-468e-a24b-6ed8ecc8a6e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:37.548532 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 996/1978] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:46:37 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:46:37.559474 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c070d49e-fc27-4125-af76-517347e4014b None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:37.561840 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-c070d49e-fc27-4125-af76-517347e4014b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:37.562653 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-840376e0-fc41-468e-a24b-6ed8ecc8a6e5 None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:46:37.563838 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-840376e0-fc41-468e-a24b-6ed8ecc8a6e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:37.596167 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:46:37.613040 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:46:37.636435 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c070d49e-fc27-4125-af76-517347e4014b None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:37.637639 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 983/1979] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:46:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 05:46:37.638472 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840376e0-fc41-468e-a24b-6ed8ecc8a6e5 None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:37.639911 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-840376e0-fc41-468e-a24b-6ed8ecc8a6e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:37.646208 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7b2d78-025d-4daf-b9d7-1ef4a9e80c65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:37.646864 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7b2d78-025d-4daf-b9d7-1ef4a9e80c65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:37.647149 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7b2d78-025d-4daf-b9d7-1ef4a9e80c65 admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:37.647465 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7b2d78-025d-4daf-b9d7-1ef4a9e80c65 admin admin] PATH_INFO: `/v3/projects/a51e92b7074a4cab9676c828e4bf203e` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:37.651901 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7b2d78-025d-4daf-b9d7-1ef4a9e80c65 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a51e92b7074a4cab9676c828e4bf203e)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:37.653471 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7b2d78-025d-4daf-b9d7-1ef4a9e80c65 admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:37.705426 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840376e0-fc41-468e-a24b-6ed8ecc8a6e5 None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:37.712598 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-de7b2d78-025d-4daf-b9d7-1ef4a9e80c65 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a51e92b7074a4cab9676c828e4bf203e', 'request_id': 'req-de7b2d78-025d-4daf-b9d7-1ef4a9e80c65'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:37.724023 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-de7b2d78-025d-4daf-b9d7-1ef4a9e80c65 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a51e92b7074a4cab9676c828e4bf203e', 'request_id': 'req-de7b2d78-025d-4daf-b9d7-1ef4a9e80c65'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:37.731120 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-de7b2d78-025d-4daf-b9d7-1ef4a9e80c65 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a51e92b7074a4cab9676c828e4bf203e', 'request_id': 'req-de7b2d78-025d-4daf-b9d7-1ef4a9e80c65'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:37.746056 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-de7b2d78-025d-4daf-b9d7-1ef4a9e80c65 admin admin] The token cache is being invalidate because project a51e92b7074a4cab9676c828e4bf203e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:46:37.746353 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-de7b2d78-025d-4daf-b9d7-1ef4a9e80c65 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:37.747032 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-de7b2d78-025d-4daf-b9d7-1ef4a9e80c65 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:37.751726 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 997/1980] 10.222.0.26 () {58 vars in 1233 bytes} [Wed Aug 24 05:46:37 2022] DELETE /identity/v3/projects/a51e92b7074a4cab9676c828e4bf203e => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:46:37.751726 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7b2d78-025d-4daf-b9d7-1ef4a9e80c65 admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:37.751726 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-de7b2d78-025d-4daf-b9d7-1ef4a9e80c65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:37.771640 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3eaa765-6b41-49f5-9305-137179d51ddc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17b450afe795495680fc70f522c83750', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:37.772290 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3eaa765-6b41-49f5-9305-137179d51ddc service cinder] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:37.772963 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3eaa765-6b41-49f5-9305-137179d51ddc service cinder] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:37.773445 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3eaa765-6b41-49f5-9305-137179d51ddc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:37.775320 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-f3eaa765-6b41-49f5-9305-137179d51ddc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:37.820899 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7b2d78-025d-4daf-b9d7-1ef4a9e80c65 admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:37.828003 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d5ac41-54ff-433f-b56c-cdd23c9a370c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '874348b647194ac2b5ecbf12c33bf59e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:37.828003 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d5ac41-54ff-433f-b56c-cdd23c9a370c service neutron] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:37.828003 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d5ac41-54ff-433f-b56c-cdd23c9a370c service neutron] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:37.828003 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d5ac41-54ff-433f-b56c-cdd23c9a370c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:37.829315 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-92d5ac41-54ff-433f-b56c-cdd23c9a370c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:37.846314 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3eaa765-6b41-49f5-9305-137179d51ddc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:37.848111 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3eaa765-6b41-49f5-9305-137179d51ddc service cinder] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:37.859652 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 984/1981] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 24 05:46:37 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:46:37.860477 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3eaa765-6b41-49f5-9305-137179d51ddc service cinder] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:37.861924 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-f3eaa765-6b41-49f5-9305-137179d51ddc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:37.924695 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:46:37.932035 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d5ac41-54ff-433f-b56c-cdd23c9a370c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:37.935068 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d5ac41-54ff-433f-b56c-cdd23c9a370c service neutron] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:37.969616 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 998/1982] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 24 05:46:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:46:37.991276 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3eaa765-6b41-49f5-9305-137179d51ddc service cinder] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:37.996698 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6ad066-6779-4b04-b940-f5425ec09969 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:37.997193 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6ad066-6779-4b04-b940-f5425ec09969 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:37.997566 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6ad066-6779-4b04-b940-f5425ec09969 admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:37.997741 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6ad066-6779-4b04-b940-f5425ec09969 admin admin] PATH_INFO: `/v3/users/add99c468b00439d884e2c800372bade` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:37.999458 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6ad066-6779-4b04-b940-f5425ec09969 admin admin] RBAC: Authorizing `identity:delete_user(user_id=add99c468b00439d884e2c800372bade)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:38.001422 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6ad066-6779-4b04-b940-f5425ec09969 admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:38.099015 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-3c6ad066-6779-4b04-b940-f5425ec09969 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'add99c468b00439d884e2c800372bade'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:38.113577 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-3c6ad066-6779-4b04-b940-f5425ec09969 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'add99c468b00439d884e2c800372bade'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:38.136808 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-3c6ad066-6779-4b04-b940-f5425ec09969 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'add99c468b00439d884e2c800372bade'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:38.172116 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-3c6ad066-6779-4b04-b940-f5425ec09969 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'add99c468b00439d884e2c800372bade'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:38.172936 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-3c6ad066-6779-4b04-b940-f5425ec09969 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'add99c468b00439d884e2c800372bade'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:38.185919 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 985/1983] 10.222.0.26 () {58 vars in 1224 bytes} [Wed Aug 24 05:46:37 2022] DELETE /identity/v3/users/add99c468b00439d884e2c800372bade => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:46:38.189004 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d5ac41-54ff-433f-b56c-cdd23c9a370c service neutron] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:38.190464 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-92d5ac41-54ff-433f-b56c-cdd23c9a370c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:38.204180 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d5ac41-54ff-433f-b56c-cdd23c9a370c service neutron] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:38.223463 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:46:38.282537 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190236fc-0067-4720-bd84-9225c9ebb2e1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17b450afe795495680fc70f522c83750', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:38.283935 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190236fc-0067-4720-bd84-9225c9ebb2e1 service cinder] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:38.284254 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190236fc-0067-4720-bd84-9225c9ebb2e1 service cinder] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:38.284620 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190236fc-0067-4720-bd84-9225c9ebb2e1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:38.288376 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-190236fc-0067-4720-bd84-9225c9ebb2e1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:38.327067 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6ad066-6779-4b04-b940-f5425ec09969 admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:38.328821 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-3c6ad066-6779-4b04-b940-f5425ec09969 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:38.349416 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6ad066-6779-4b04-b940-f5425ec09969 admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:38.354561 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d5ef09-d3c6-4919-a2a4-e4ac0f90335c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17b450afe795495680fc70f522c83750', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:38.355270 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d5ef09-d3c6-4919-a2a4-e4ac0f90335c service cinder] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:38.355649 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d5ef09-d3c6-4919-a2a4-e4ac0f90335c service cinder] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:38.355931 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d5ef09-d3c6-4919-a2a4-e4ac0f90335c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:38.357983 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-43d5ef09-d3c6-4919-a2a4-e4ac0f90335c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:38.374038 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190236fc-0067-4720-bd84-9225c9ebb2e1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:38.375348 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190236fc-0067-4720-bd84-9225c9ebb2e1 service cinder] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:38.387408 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 999/1984] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 24 05:46:38 2022] GET /identity/v3/auth/tokens => generated 3286 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:46:38.502842 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d5ef09-d3c6-4919-a2a4-e4ac0f90335c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:38.505442 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d5ef09-d3c6-4919-a2a4-e4ac0f90335c service cinder] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:38.526007 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 986/1985] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 24 05:46:38 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:46:38.553644 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190236fc-0067-4720-bd84-9225c9ebb2e1 service cinder] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:38.555419 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-190236fc-0067-4720-bd84-9225c9ebb2e1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:38.667479 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190236fc-0067-4720-bd84-9225c9ebb2e1 service cinder] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:38.679105 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8449deb9-1dd1-4b76-8a5f-3ea7ce734051 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:38.680007 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8449deb9-1dd1-4b76-8a5f-3ea7ce734051 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:38.680493 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8449deb9-1dd1-4b76-8a5f-3ea7ce734051 admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:38.680999 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8449deb9-1dd1-4b76-8a5f-3ea7ce734051 admin admin] PATH_INFO: `/v3/projects/5d6eaf30566a4a4ba778c07ba4e50cde` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:38.684481 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8449deb9-1dd1-4b76-8a5f-3ea7ce734051 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d6eaf30566a4a4ba778c07ba4e50cde)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:38.688789 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8449deb9-1dd1-4b76-8a5f-3ea7ce734051 admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:38.780987 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d5ef09-d3c6-4919-a2a4-e4ac0f90335c service cinder] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:38.783088 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-43d5ef09-d3c6-4919-a2a4-e4ac0f90335c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:38.801660 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-8449deb9-1dd1-4b76-8a5f-3ea7ce734051 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d6eaf30566a4a4ba778c07ba4e50cde', 'request_id': 'req-8449deb9-1dd1-4b76-8a5f-3ea7ce734051'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:38.814251 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-8449deb9-1dd1-4b76-8a5f-3ea7ce734051 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d6eaf30566a4a4ba778c07ba4e50cde', 'request_id': 'req-8449deb9-1dd1-4b76-8a5f-3ea7ce734051'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:38.825912 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d5ef09-d3c6-4919-a2a4-e4ac0f90335c service cinder] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:38.826239 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-8449deb9-1dd1-4b76-8a5f-3ea7ce734051 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d6eaf30566a4a4ba778c07ba4e50cde', 'request_id': 'req-8449deb9-1dd1-4b76-8a5f-3ea7ce734051'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:38.846462 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-8449deb9-1dd1-4b76-8a5f-3ea7ce734051 admin admin] The token cache is being invalidate because project 5d6eaf30566a4a4ba778c07ba4e50cde was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:46:38.847545 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-8449deb9-1dd1-4b76-8a5f-3ea7ce734051 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:38.848642 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-8449deb9-1dd1-4b76-8a5f-3ea7ce734051 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:38.850462 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1000/1986] 10.222.0.26 () {58 vars in 1233 bytes} [Wed Aug 24 05:46:38 2022] DELETE /identity/v3/projects/5d6eaf30566a4a4ba778c07ba4e50cde => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:46:38.855035 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8449deb9-1dd1-4b76-8a5f-3ea7ce734051 admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:38.858689 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-8449deb9-1dd1-4b76-8a5f-3ea7ce734051 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:38.881127 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:46:38.928129 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:46:38.953931 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1af3d8c-6eff-4d92-ae7c-fba1735992a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:38.954941 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1af3d8c-6eff-4d92-ae7c-fba1735992a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:38.956132 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1af3d8c-6eff-4d92-ae7c-fba1735992a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:38.956621 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1af3d8c-6eff-4d92-ae7c-fba1735992a4 admin admin] PATH_INFO: `/v3/projects/60c6ef9b87af4203b8ab937359d7acb4` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:38.959635 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1af3d8c-6eff-4d92-ae7c-fba1735992a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=60c6ef9b87af4203b8ab937359d7acb4)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:38.963663 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1af3d8c-6eff-4d92-ae7c-fba1735992a4 admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:39.006022 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8449deb9-1dd1-4b76-8a5f-3ea7ce734051 admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:39.023939 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b194f77-e70f-4932-a2ab-17d71a72b457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:39.024779 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b194f77-e70f-4932-a2ab-17d71a72b457 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:39.025374 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b194f77-e70f-4932-a2ab-17d71a72b457 admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:39.025760 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b194f77-e70f-4932-a2ab-17d71a72b457 admin admin] PATH_INFO: `/v3/users/b362b4c14190423581744dda99915575` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:39.030628 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b194f77-e70f-4932-a2ab-17d71a72b457 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b362b4c14190423581744dda99915575)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:39.035086 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b194f77-e70f-4932-a2ab-17d71a72b457 admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:39.151527 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-f1af3d8c-6eff-4d92-ae7c-fba1735992a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '60c6ef9b87af4203b8ab937359d7acb4', 'request_id': 'req-f1af3d8c-6eff-4d92-ae7c-fba1735992a4'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:39.167997 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-4b194f77-e70f-4932-a2ab-17d71a72b457 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b362b4c14190423581744dda99915575'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:39.187733 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-4b194f77-e70f-4932-a2ab-17d71a72b457 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b362b4c14190423581744dda99915575'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:39.189464 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-4b194f77-e70f-4932-a2ab-17d71a72b457 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b362b4c14190423581744dda99915575'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:39.190404 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-f1af3d8c-6eff-4d92-ae7c-fba1735992a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '60c6ef9b87af4203b8ab937359d7acb4', 'request_id': 'req-f1af3d8c-6eff-4d92-ae7c-fba1735992a4'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:39.235777 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-f1af3d8c-6eff-4d92-ae7c-fba1735992a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '60c6ef9b87af4203b8ab937359d7acb4', 'request_id': 'req-f1af3d8c-6eff-4d92-ae7c-fba1735992a4'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:39.243272 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-4b194f77-e70f-4932-a2ab-17d71a72b457 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b362b4c14190423581744dda99915575'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:39.258392 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-f1af3d8c-6eff-4d92-ae7c-fba1735992a4 admin admin] The token cache is being invalidate because project 60c6ef9b87af4203b8ab937359d7acb4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88112) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:46:39.258888 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-f1af3d8c-6eff-4d92-ae7c-fba1735992a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:39.260074 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-f1af3d8c-6eff-4d92-ae7c-fba1735992a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:39.268091 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 987/1987] 10.222.0.26 () {58 vars in 1233 bytes} [Wed Aug 24 05:46:38 2022] DELETE /identity/v3/projects/60c6ef9b87af4203b8ab937359d7acb4 => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:46:39.271179 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-4b194f77-e70f-4932-a2ab-17d71a72b457 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b362b4c14190423581744dda99915575'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:39.271744 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d474b032-4926-4612-9877-826ccac0d666 None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:39.272662 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d474b032-4926-4612-9877-826ccac0d666 None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:39.273109 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d474b032-4926-4612-9877-826ccac0d666 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:39.285561 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1001/1988] 10.222.0.26 () {58 vars in 1224 bytes} [Wed Aug 24 05:46:38 2022] DELETE /identity/v3/users/b362b4c14190423581744dda99915575 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:46:39.314547 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-d474b032-4926-4612-9877-826ccac0d666 None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:46:39.316949 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-d474b032-4926-4612-9877-826ccac0d666 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:39.507091 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 988/1989] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:46:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 05:46:39.523372 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa774e2d-1ba4-4ef5-8601-c277927adbea None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:39.524266 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa774e2d-1ba4-4ef5-8601-c277927adbea None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:39.525071 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa774e2d-1ba4-4ef5-8601-c277927adbea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:39.582744 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-aa774e2d-1ba4-4ef5-8601-c277927adbea None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:46:39.585527 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-aa774e2d-1ba4-4ef5-8601-c277927adbea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:39.613942 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1002/1990] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:46:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:46:39.616073 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d474b032-4926-4612-9877-826ccac0d666 None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:39.648283 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d474b032-4926-4612-9877-826ccac0d666 None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:39.655423 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e33d361-372b-4393-bc73-b73c3165e483 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:39.656171 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e33d361-372b-4393-bc73-b73c3165e483 admin admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:39.656567 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e33d361-372b-4393-bc73-b73c3165e483 admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:39.657576 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e33d361-372b-4393-bc73-b73c3165e483 admin admin] PATH_INFO: `/v3/domains` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:39.658652 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e33d361-372b-4393-bc73-b73c3165e483 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:46:39.659800 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e33d361-372b-4393-bc73-b73c3165e483 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:39.662902 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e33d361-372b-4393-bc73-b73c3165e483 admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:39.680340 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 989/1991] 10.222.0.26 () {58 vars in 1153 bytes} [Wed Aug 24 05:46:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:46:39.685839 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa774e2d-1ba4-4ef5-8601-c277927adbea None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:39.706761 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa774e2d-1ba4-4ef5-8601-c277927adbea None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:39.720075 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6438f186-83c0-48ab-a517-39e4083ae256 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:39.721277 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6438f186-83c0-48ab-a517-39e4083ae256 admin admin] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:39.721984 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6438f186-83c0-48ab-a517-39e4083ae256 admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:39.722449 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6438f186-83c0-48ab-a517-39e4083ae256 admin admin] PATH_INFO: `/v3/projects` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:39.723714 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6438f186-83c0-48ab-a517-39e4083ae256 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:39.727878 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6438f186-83c0-48ab-a517-39e4083ae256 admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:39.783688 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1003/1992] 10.222.0.26 () {60 vars in 1153 bytes} [Wed Aug 24 05:46:39 2022] POST /identity/v3/projects => generated 385 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:46:39.787236 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e33d361-372b-4393-bc73-b73c3165e483 admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:39.822308 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e33d361-372b-4393-bc73-b73c3165e483 admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:39.982485 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae4bcd8-50ad-4d4c-b8aa-8203229e4ff3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:39.983700 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae4bcd8-50ad-4d4c-b8aa-8203229e4ff3 admin admin] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:39.984277 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae4bcd8-50ad-4d4c-b8aa-8203229e4ff3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:39.984935 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae4bcd8-50ad-4d4c-b8aa-8203229e4ff3 admin admin] PATH_INFO: `/v3/users` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:39.986666 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae4bcd8-50ad-4d4c-b8aa-8203229e4ff3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:39.994452 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae4bcd8-50ad-4d4c-b8aa-8203229e4ff3 admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:40.056711 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:46:40.066705 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6438f186-83c0-48ab-a517-39e4083ae256 admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:40.070894 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-6438f186-83c0-48ab-a517-39e4083ae256 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:40.088377 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 990/1993] 10.222.0.26 () {60 vars in 1144 bytes} [Wed Aug 24 05:46:39 2022] POST /identity/v3/users => generated 293 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:46:40.093523 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae4bcd8-50ad-4d4c-b8aa-8203229e4ff3 admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:40.115453 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6438f186-83c0-48ab-a517-39e4083ae256 admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:40.124097 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae4bcd8-50ad-4d4c-b8aa-8203229e4ff3 admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:40.129919 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215045d5-4d57-4792-8513-5aee2dabdbe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:40.130945 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215045d5-4d57-4792-8513-5aee2dabdbe3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:40.131318 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215045d5-4d57-4792-8513-5aee2dabdbe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:40.131645 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215045d5-4d57-4792-8513-5aee2dabdbe3 admin admin] PATH_INFO: `/v3/projects/4de4279843dc479195aa344056d9d8c3` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:40.133283 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215045d5-4d57-4792-8513-5aee2dabdbe3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4de4279843dc479195aa344056d9d8c3)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:40.135753 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215045d5-4d57-4792-8513-5aee2dabdbe3 admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:40.138610 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa278d0-4113-4ab9-8ac9-15af5190f62e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:40.139232 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa278d0-4113-4ab9-8ac9-15af5190f62e admin admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:40.139508 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa278d0-4113-4ab9-8ac9-15af5190f62e admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:40.139776 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa278d0-4113-4ab9-8ac9-15af5190f62e admin admin] PATH_INFO: `/v3/roles` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:40.140792 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa278d0-4113-4ab9-8ac9-15af5190f62e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:40.142039 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa278d0-4113-4ab9-8ac9-15af5190f62e admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:40.159734 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 991/1994] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Aug 24 05:46:40 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:46:40.163318 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa278d0-4113-4ab9-8ac9-15af5190f62e admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:40.179378 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa278d0-4113-4ab9-8ac9-15af5190f62e admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:40.186627 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3e9495-5159-4f53-9ba5-8e7d2425a715 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:40.187279 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3e9495-5159-4f53-9ba5-8e7d2425a715 admin admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:40.187630 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3e9495-5159-4f53-9ba5-8e7d2425a715 admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:40.187933 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3e9495-5159-4f53-9ba5-8e7d2425a715 admin admin] PATH_INFO: `/v3/roles` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:40.188603 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3e9495-5159-4f53-9ba5-8e7d2425a715 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:40.190298 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3e9495-5159-4f53-9ba5-8e7d2425a715 admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:40.205411 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 992/1995] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Aug 24 05:46:40 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 05:46:40.206381 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3e9495-5159-4f53-9ba5-8e7d2425a715 admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:40.217032 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3e9495-5159-4f53-9ba5-8e7d2425a715 admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:40.218989 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-215045d5-4d57-4792-8513-5aee2dabdbe3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4de4279843dc479195aa344056d9d8c3', 'request_id': 'req-215045d5-4d57-4792-8513-5aee2dabdbe3'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:40.220811 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:46:40.229061 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-215045d5-4d57-4792-8513-5aee2dabdbe3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4de4279843dc479195aa344056d9d8c3', 'request_id': 'req-215045d5-4d57-4792-8513-5aee2dabdbe3'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:40.246725 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-215045d5-4d57-4792-8513-5aee2dabdbe3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4de4279843dc479195aa344056d9d8c3', 'request_id': 'req-215045d5-4d57-4792-8513-5aee2dabdbe3'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:40.263801 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-215045d5-4d57-4792-8513-5aee2dabdbe3 admin admin] The token cache is being invalidate because project 4de4279843dc479195aa344056d9d8c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:46:40.264176 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-215045d5-4d57-4792-8513-5aee2dabdbe3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:40.264915 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-215045d5-4d57-4792-8513-5aee2dabdbe3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:40.267121 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1004/1996] 10.222.0.26 () {58 vars in 1233 bytes} [Wed Aug 24 05:46:40 2022] DELETE /identity/v3/projects/4de4279843dc479195aa344056d9d8c3 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 05:46:40.270609 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215045d5-4d57-4792-8513-5aee2dabdbe3 admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:40.271996 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-215045d5-4d57-4792-8513-5aee2dabdbe3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:40.346205 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819a149b-4af7-437a-b641-e082a1cad2f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:40.346952 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819a149b-4af7-437a-b641-e082a1cad2f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:40.347237 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819a149b-4af7-437a-b641-e082a1cad2f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:40.347516 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819a149b-4af7-437a-b641-e082a1cad2f6 admin admin] PATH_INFO: `/v3/projects/180676460d164b4a9c6c4b733349c2b9/users/a7722bb931ae4c55a046ceea6dc929d5/roles/f7aa4a2c74c94c1b9ca8ecdcccccda5c` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:40.368208 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819a149b-4af7-437a-b641-e082a1cad2f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=180676460d164b4a9c6c4b733349c2b9, user_id=a7722bb931ae4c55a046ceea6dc929d5, role_id=f7aa4a2c74c94c1b9ca8ecdcccccda5c)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:40.371629 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819a149b-4af7-437a-b641-e082a1cad2f6 admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:40.384551 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215045d5-4d57-4792-8513-5aee2dabdbe3 admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:40.393988 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 993/1997] 10.222.0.26 () {60 vars in 1483 bytes} [Wed Aug 24 05:46:40 2022] PUT /identity/v3/projects/180676460d164b4a9c6c4b733349c2b9/users/a7722bb931ae4c55a046ceea6dc929d5/roles/f7aa4a2c74c94c1b9ca8ecdcccccda5c => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:46:40.402770 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a3a8fd-b62a-4ea0-bda5-b391f8a55501 None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:40.403223 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a3a8fd-b62a-4ea0-bda5-b391f8a55501 None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:40.404175 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a3a8fd-b62a-4ea0-bda5-b391f8a55501 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:40.439879 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-18a3a8fd-b62a-4ea0-bda5-b391f8a55501 None None] MFA Rules not processed for user `a7722bb931ae4c55a046ceea6dc929d5`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:46:40.441606 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-18a3a8fd-b62a-4ea0-bda5-b391f8a55501 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:40.477837 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28b7841-94b5-4f1a-8ae6-d41e7f4793ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:40.478611 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28b7841-94b5-4f1a-8ae6-d41e7f4793ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:40.478894 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28b7841-94b5-4f1a-8ae6-d41e7f4793ef admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:40.479320 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28b7841-94b5-4f1a-8ae6-d41e7f4793ef admin admin] PATH_INFO: `/v3/users/b4fd5c2242a34248aa3f1ebc96639557` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:40.481019 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28b7841-94b5-4f1a-8ae6-d41e7f4793ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=b4fd5c2242a34248aa3f1ebc96639557)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:40.483227 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28b7841-94b5-4f1a-8ae6-d41e7f4793ef admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:40.536072 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 994/1998] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:46:40 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:46:40.537022 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a3a8fd-b62a-4ea0-bda5-b391f8a55501 None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:40.538445 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-18a3a8fd-b62a-4ea0-bda5-b391f8a55501 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:40.555188 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a3a8fd-b62a-4ea0-bda5-b391f8a55501 None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:40.558984 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-a28b7841-94b5-4f1a-8ae6-d41e7f4793ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b4fd5c2242a34248aa3f1ebc96639557'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:40.561323 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04fac5b-00b8-42b9-8928-86d0e3a5f847 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:40.561959 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04fac5b-00b8-42b9-8928-86d0e3a5f847 admin admin] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:40.562254 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04fac5b-00b8-42b9-8928-86d0e3a5f847 admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:40.562531 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04fac5b-00b8-42b9-8928-86d0e3a5f847 admin admin] PATH_INFO: `/v3/projects` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:40.563172 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04fac5b-00b8-42b9-8928-86d0e3a5f847 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:40.565335 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04fac5b-00b8-42b9-8928-86d0e3a5f847 admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:40.567586 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-a28b7841-94b5-4f1a-8ae6-d41e7f4793ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b4fd5c2242a34248aa3f1ebc96639557'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:40.569123 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-a28b7841-94b5-4f1a-8ae6-d41e7f4793ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b4fd5c2242a34248aa3f1ebc96639557'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:40.587323 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-a28b7841-94b5-4f1a-8ae6-d41e7f4793ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b4fd5c2242a34248aa3f1ebc96639557'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:40.597590 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-a28b7841-94b5-4f1a-8ae6-d41e7f4793ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b4fd5c2242a34248aa3f1ebc96639557'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:40.606659 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 995/1999] 10.222.0.26 () {60 vars in 1153 bytes} [Wed Aug 24 05:46:40 2022] POST /identity/v3/projects => generated 385 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:46:40.607633 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1005/2000] 10.222.0.26 () {58 vars in 1224 bytes} [Wed Aug 24 05:46:40 2022] DELETE /identity/v3/users/b4fd5c2242a34248aa3f1ebc96639557 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 05:46:40.607866 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04fac5b-00b8-42b9-8928-86d0e3a5f847 admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:40.611460 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-a04fac5b-00b8-42b9-8928-86d0e3a5f847 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:40.646023 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:46:40.699443 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04fac5b-00b8-42b9-8928-86d0e3a5f847 admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:40.781171 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea66f14-9b57-4281-b3b0-99dcb39f63b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:40.781789 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea66f14-9b57-4281-b3b0-99dcb39f63b0 admin admin] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:40.782096 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea66f14-9b57-4281-b3b0-99dcb39f63b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:40.782373 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea66f14-9b57-4281-b3b0-99dcb39f63b0 admin admin] PATH_INFO: `/v3/users` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:40.783001 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea66f14-9b57-4281-b3b0-99dcb39f63b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:40.785009 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea66f14-9b57-4281-b3b0-99dcb39f63b0 admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:40.807186 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 996/2001] 10.222.0.26 () {60 vars in 1144 bytes} [Wed Aug 24 05:46:40 2022] POST /identity/v3/users => generated 299 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:46:40.811702 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28b7841-94b5-4f1a-8ae6-d41e7f4793ef admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:40.822033 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:INSERT=2,keystone:DELETE=13,keystone:SELECT=85 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:46:40.829002 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28b7841-94b5-4f1a-8ae6-d41e7f4793ef admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:40.836032 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1396acca-f7fb-4841-8aaf-98e5724ff4d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:40.836981 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1396acca-f7fb-4841-8aaf-98e5724ff4d0 admin admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:40.837516 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1396acca-f7fb-4841-8aaf-98e5724ff4d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:40.837793 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1396acca-f7fb-4841-8aaf-98e5724ff4d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:40.838487 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1396acca-f7fb-4841-8aaf-98e5724ff4d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:40.840102 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1396acca-f7fb-4841-8aaf-98e5724ff4d0 admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:40.853996 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1006/2002] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Aug 24 05:46:40 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:46:40.855415 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea66f14-9b57-4281-b3b0-99dcb39f63b0 admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:40.866788 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea66f14-9b57-4281-b3b0-99dcb39f63b0 admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:40.876689 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cc518f-8d61-4e75-9373-438170694fb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:40.877204 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cc518f-8d61-4e75-9373-438170694fb1 admin admin] REQUEST_METHOD: `PUT` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:40.877485 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cc518f-8d61-4e75-9373-438170694fb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:40.877762 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cc518f-8d61-4e75-9373-438170694fb1 admin admin] PATH_INFO: `/v3/projects/c22f686345bb43df81a956ab26f5d778/users/47419b5c2155422c83774ea7411c3f11/roles/640bda0879494e60b72680ee505285f0` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:40.899236 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cc518f-8d61-4e75-9373-438170694fb1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c22f686345bb43df81a956ab26f5d778, user_id=47419b5c2155422c83774ea7411c3f11, role_id=640bda0879494e60b72680ee505285f0)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:40.901889 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cc518f-8d61-4e75-9373-438170694fb1 admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:40.914840 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 997/2003] 10.222.0.26 () {60 vars in 1483 bytes} [Wed Aug 24 05:46:40 2022] PUT /identity/v3/projects/c22f686345bb43df81a956ab26f5d778/users/47419b5c2155422c83774ea7411c3f11/roles/640bda0879494e60b72680ee505285f0 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:46:40.918771 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1396acca-f7fb-4841-8aaf-98e5724ff4d0 admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:40.928977 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1396acca-f7fb-4841-8aaf-98e5724ff4d0 admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:40.969022 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cc518f-8d61-4e75-9373-438170694fb1 admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:40.970901 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-56cc518f-8d61-4e75-9373-438170694fb1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:40.998629 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea80690-0dd9-4f0a-a5d3-62d507690f50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:40.999190 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea80690-0dd9-4f0a-a5d3-62d507690f50 admin admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:40.999466 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea80690-0dd9-4f0a-a5d3-62d507690f50 admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:40.999744 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea80690-0dd9-4f0a-a5d3-62d507690f50 admin admin] PATH_INFO: `/v3/roles` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:41.000416 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea80690-0dd9-4f0a-a5d3-62d507690f50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:41.002070 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea80690-0dd9-4f0a-a5d3-62d507690f50 admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:41.012222 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1007/2004] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Aug 24 05:46:40 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:46:41.018407 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea80690-0dd9-4f0a-a5d3-62d507690f50 admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:41.029398 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea80690-0dd9-4f0a-a5d3-62d507690f50 admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:41.034187 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436c7df6-a98e-407c-a6b1-222763caba8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:41.034822 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436c7df6-a98e-407c-a6b1-222763caba8a admin admin] REQUEST_METHOD: `PUT` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:41.035099 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436c7df6-a98e-407c-a6b1-222763caba8a admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:41.035368 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436c7df6-a98e-407c-a6b1-222763caba8a admin admin] PATH_INFO: `/v3/projects/c22f686345bb43df81a956ab26f5d778/users/47419b5c2155422c83774ea7411c3f11/roles/640bda0879494e60b72680ee505285f0` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:41.037235 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436c7df6-a98e-407c-a6b1-222763caba8a admin admin] RBAC: Authorizing `identity:create_grant(project_id=c22f686345bb43df81a956ab26f5d778, user_id=47419b5c2155422c83774ea7411c3f11, role_id=640bda0879494e60b72680ee505285f0)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:41.039887 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436c7df6-a98e-407c-a6b1-222763caba8a admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:41.042181 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cc518f-8d61-4e75-9373-438170694fb1 admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:41.046841 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ad43c7-1b19-4608-aafd-6d8dd99a5eec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:41.047470 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ad43c7-1b19-4608-aafd-6d8dd99a5eec admin admin] REQUEST_METHOD: `DELETE` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:41.047750 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ad43c7-1b19-4608-aafd-6d8dd99a5eec admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:41.048026 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ad43c7-1b19-4608-aafd-6d8dd99a5eec admin admin] PATH_INFO: `/v3/projects/0a4fe5bb5aa642458b77f99cc3e5710b` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:41.049136 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ad43c7-1b19-4608-aafd-6d8dd99a5eec admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a4fe5bb5aa642458b77f99cc3e5710b)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:41.050236 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1008/2005] 10.222.0.26 () {60 vars in 1483 bytes} [Wed Aug 24 05:46:41 2022] PUT /identity/v3/projects/c22f686345bb43df81a956ab26f5d778/users/47419b5c2155422c83774ea7411c3f11/roles/640bda0879494e60b72680ee505285f0 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:46:41.051059 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ad43c7-1b19-4608-aafd-6d8dd99a5eec admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:41.062432 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eac474b-6237-4380-af0f-9d4a90de8db0 None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:41.062722 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eac474b-6237-4380-af0f-9d4a90de8db0 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:41.063001 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eac474b-6237-4380-af0f-9d4a90de8db0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:41.095386 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-9eac474b-6237-4380-af0f-9d4a90de8db0 None None] MFA Rules not processed for user `47419b5c2155422c83774ea7411c3f11`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:46:41.096397 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-9eac474b-6237-4380-af0f-9d4a90de8db0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:41.104830 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:46:41.110441 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-85ad43c7-1b19-4608-aafd-6d8dd99a5eec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a4fe5bb5aa642458b77f99cc3e5710b', 'request_id': 'req-85ad43c7-1b19-4608-aafd-6d8dd99a5eec'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:41.123015 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-85ad43c7-1b19-4608-aafd-6d8dd99a5eec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a4fe5bb5aa642458b77f99cc3e5710b', 'request_id': 'req-85ad43c7-1b19-4608-aafd-6d8dd99a5eec'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:41.131059 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-85ad43c7-1b19-4608-aafd-6d8dd99a5eec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a4fe5bb5aa642458b77f99cc3e5710b', 'request_id': 'req-85ad43c7-1b19-4608-aafd-6d8dd99a5eec'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:41.145122 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-85ad43c7-1b19-4608-aafd-6d8dd99a5eec admin admin] The token cache is being invalidate because project 0a4fe5bb5aa642458b77f99cc3e5710b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88112) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:46:41.145423 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-85ad43c7-1b19-4608-aafd-6d8dd99a5eec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:41.146250 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-85ad43c7-1b19-4608-aafd-6d8dd99a5eec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:41.148168 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 998/2006] 10.222.0.26 () {58 vars in 1233 bytes} [Wed Aug 24 05:46:40 2022] DELETE /identity/v3/projects/0a4fe5bb5aa642458b77f99cc3e5710b => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 05:46:41.154227 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66663734-44f5-4c0a-abd0-93eac86314e5 None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:41.154605 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66663734-44f5-4c0a-abd0-93eac86314e5 None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:41.154889 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66663734-44f5-4c0a-abd0-93eac86314e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:41.179905 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-66663734-44f5-4c0a-abd0-93eac86314e5 None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:46:41.180902 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1009/2007] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:46:41 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:46:41.182764 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-66663734-44f5-4c0a-abd0-93eac86314e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:41.193869 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eac474b-6237-4380-af0f-9d4a90de8db0 None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:41.195298 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-9eac474b-6237-4380-af0f-9d4a90de8db0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:41.255616 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 999/2008] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:46:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:46:41.260636 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eac474b-6237-4380-af0f-9d4a90de8db0 None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:41.263955 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8185ef-11b3-462d-b171-4215eda299e9 None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:41.264487 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8185ef-11b3-462d-b171-4215eda299e9 None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:41.264944 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8185ef-11b3-462d-b171-4215eda299e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:41.265548 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c39235-46ef-4018-94ed-93cb8a7c8ff3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17b450afe795495680fc70f522c83750', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:41.266201 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c39235-46ef-4018-94ed-93cb8a7c8ff3 service cinder] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:41.266481 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c39235-46ef-4018-94ed-93cb8a7c8ff3 service cinder] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:41.266750 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c39235-46ef-4018-94ed-93cb8a7c8ff3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:41.268564 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-02c39235-46ef-4018-94ed-93cb8a7c8ff3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:41.287372 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:46:41.288842 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-7f8185ef-11b3-462d-b171-4215eda299e9 None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:46:41.290226 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-7f8185ef-11b3-462d-b171-4215eda299e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:41.299999 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1000/2009] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:46:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:46:41.306983 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8185ef-11b3-462d-b171-4215eda299e9 None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:41.318934 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8185ef-11b3-462d-b171-4215eda299e9 None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:41.325256 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4e41d6-fabc-45a9-8b7c-d5e7e3dc3ce9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:41.326010 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4e41d6-fabc-45a9-8b7c-d5e7e3dc3ce9 admin admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:41.326371 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4e41d6-fabc-45a9-8b7c-d5e7e3dc3ce9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:41.326747 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4e41d6-fabc-45a9-8b7c-d5e7e3dc3ce9 admin admin] PATH_INFO: `/v3/domains` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:41.327492 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4e41d6-fabc-45a9-8b7c-d5e7e3dc3ce9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:46:41.327874 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4e41d6-fabc-45a9-8b7c-d5e7e3dc3ce9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:41.330674 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4e41d6-fabc-45a9-8b7c-d5e7e3dc3ce9 admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:41.351535 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1001/2010] 10.222.0.26 () {58 vars in 1153 bytes} [Wed Aug 24 05:46:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:46:41.352625 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4e41d6-fabc-45a9-8b7c-d5e7e3dc3ce9 admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:41.358136 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c39235-46ef-4018-94ed-93cb8a7c8ff3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:41.359930 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c39235-46ef-4018-94ed-93cb8a7c8ff3 service cinder] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:41.370578 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1010/2011] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 24 05:46:41 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 05:46:41.380128 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4e41d6-fabc-45a9-8b7c-d5e7e3dc3ce9 admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:41.389467 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741436e2-5068-436d-a19b-f998db14e585 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:41.390141 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741436e2-5068-436d-a19b-f998db14e585 admin admin] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:41.390430 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741436e2-5068-436d-a19b-f998db14e585 admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:41.390705 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741436e2-5068-436d-a19b-f998db14e585 admin admin] PATH_INFO: `/v3/projects` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:41.391356 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741436e2-5068-436d-a19b-f998db14e585 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:41.393299 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741436e2-5068-436d-a19b-f998db14e585 admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:41.441223 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1002/2012] 10.222.0.26 () {60 vars in 1153 bytes} [Wed Aug 24 05:46:41 2022] POST /identity/v3/projects => generated 371 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 05:46:41.451544 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c39235-46ef-4018-94ed-93cb8a7c8ff3 service cinder] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:41.464334 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c39235-46ef-4018-94ed-93cb8a7c8ff3 service cinder] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:41.597230 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7960132-9cfa-4a7d-b1f3-3ada33cba04e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:41.597964 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7960132-9cfa-4a7d-b1f3-3ada33cba04e admin admin] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:41.600209 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7960132-9cfa-4a7d-b1f3-3ada33cba04e admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:41.600680 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7960132-9cfa-4a7d-b1f3-3ada33cba04e admin admin] PATH_INFO: `/v3/users` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:41.601408 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7960132-9cfa-4a7d-b1f3-3ada33cba04e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:41.603907 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7960132-9cfa-4a7d-b1f3-3ada33cba04e admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:41.648468 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1011/2013] 10.222.0.26 () {60 vars in 1144 bytes} [Wed Aug 24 05:46:41 2022] POST /identity/v3/users => generated 286 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:46:41.653028 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741436e2-5068-436d-a19b-f998db14e585 admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:41.670891 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741436e2-5068-436d-a19b-f998db14e585 admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:41.682034 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e2f31f-a773-425d-92d5-a9b023ab8211 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:41.682676 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e2f31f-a773-425d-92d5-a9b023ab8211 admin admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:41.683306 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e2f31f-a773-425d-92d5-a9b023ab8211 admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:41.683723 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e2f31f-a773-425d-92d5-a9b023ab8211 admin admin] PATH_INFO: `/v3/roles` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:41.684644 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e2f31f-a773-425d-92d5-a9b023ab8211 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:41.686782 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e2f31f-a773-425d-92d5-a9b023ab8211 admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:41.704885 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1003/2014] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Aug 24 05:46:41 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:46:41.709571 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7960132-9cfa-4a7d-b1f3-3ada33cba04e admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:41.725442 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7960132-9cfa-4a7d-b1f3-3ada33cba04e admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:41.732380 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96af508b-2abb-43aa-b74a-290c9b2b8df4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:41.733314 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96af508b-2abb-43aa-b74a-290c9b2b8df4 admin admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:41.733922 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96af508b-2abb-43aa-b74a-290c9b2b8df4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:41.734324 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96af508b-2abb-43aa-b74a-290c9b2b8df4 admin admin] PATH_INFO: `/v3/roles` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:41.735260 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96af508b-2abb-43aa-b74a-290c9b2b8df4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:41.737291 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96af508b-2abb-43aa-b74a-290c9b2b8df4 admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:41.762896 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e2f31f-a773-425d-92d5-a9b023ab8211 admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:41.764148 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1012/2015] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Aug 24 05:46:41 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:46:41.781165 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e2f31f-a773-425d-92d5-a9b023ab8211 admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:41.795306 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e652d7-ee54-4fcb-8e64-90f211521d0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:41.797450 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e652d7-ee54-4fcb-8e64-90f211521d0d admin admin] REQUEST_METHOD: `PUT` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:41.797736 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e652d7-ee54-4fcb-8e64-90f211521d0d admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:41.799667 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e652d7-ee54-4fcb-8e64-90f211521d0d admin admin] PATH_INFO: `/v3/projects/ec547256768942888afaea0dd2f9eedd/users/246cc4e07c754c62bb5337197867e8ce/roles/f7aa4a2c74c94c1b9ca8ecdcccccda5c` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:41.849746 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e652d7-ee54-4fcb-8e64-90f211521d0d admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec547256768942888afaea0dd2f9eedd, user_id=246cc4e07c754c62bb5337197867e8ce, role_id=f7aa4a2c74c94c1b9ca8ecdcccccda5c)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:41.853076 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e652d7-ee54-4fcb-8e64-90f211521d0d admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:41.904657 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1004/2016] 10.222.0.26 () {60 vars in 1483 bytes} [Wed Aug 24 05:46:41 2022] PUT /identity/v3/projects/ec547256768942888afaea0dd2f9eedd/users/246cc4e07c754c62bb5337197867e8ce/roles/f7aa4a2c74c94c1b9ca8ecdcccccda5c => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 05:46:41.909667 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4021ca8-d80e-4462-814b-e455177c5416 None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:41.910434 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4021ca8-d80e-4462-814b-e455177c5416 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:41.910760 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4021ca8-d80e-4462-814b-e455177c5416 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:41.925727 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cbdc6f-6b60-4519-8e8d-32f6da8e758e None None] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:41.926110 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cbdc6f-6b60-4519-8e8d-32f6da8e758e None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:41.926391 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cbdc6f-6b60-4519-8e8d-32f6da8e758e None None] PATH_INFO: `/` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:41.927978 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1005/2017] 10.222.0.26 () {54 vars in 921 bytes} [Wed Aug 24 05:46:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:46:41.944498 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1b7e40-33e5-4a36-bd93-b456989b2b2e None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:41.944900 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1b7e40-33e5-4a36-bd93-b456989b2b2e None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:41.945188 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1b7e40-33e5-4a36-bd93-b456989b2b2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:41.949996 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-c4021ca8-d80e-4462-814b-e455177c5416 None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:46:41.956060 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-c4021ca8-d80e-4462-814b-e455177c5416 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:41.983524 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-9c1b7e40-33e5-4a36-bd93-b456989b2b2e None None] MFA Rules not processed for user `7b633e1aec6c4269bce13aa9c89e911a`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:46:41.990230 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-9c1b7e40-33e5-4a36-bd93-b456989b2b2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:42.128059 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:46:42.147712 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1013/2018] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:46:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:46:42.166456 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4021ca8-d80e-4462-814b-e455177c5416 None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:42.168798 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-c4021ca8-d80e-4462-814b-e455177c5416 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:42.180781 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1006/2019] 10.222.0.26 () {58 vars in 1018 bytes} [Wed Aug 24 05:46:41 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 05:46:42.209276 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1b7e40-33e5-4a36-bd93-b456989b2b2e None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:42.210790 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-9c1b7e40-33e5-4a36-bd93-b456989b2b2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:42.235695 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1b7e40-33e5-4a36-bd93-b456989b2b2e None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:42.248166 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942c300f-32c8-4fe0-bded-4bcb4f60e552 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b633e1aec6c4269bce13aa9c89e911a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:42.248803 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942c300f-32c8-4fe0-bded-4bcb4f60e552 service nova] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:42.249078 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942c300f-32c8-4fe0-bded-4bcb4f60e552 service nova] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:42.249347 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942c300f-32c8-4fe0-bded-4bcb4f60e552 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:42.273916 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942c300f-32c8-4fe0-bded-4bcb4f60e552 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:42.275512 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942c300f-32c8-4fe0-bded-4bcb4f60e552 service nova] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:42.279088 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:46:42.298858 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1007/2020] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 24 05:46:42 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:46:42.299779 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942c300f-32c8-4fe0-bded-4bcb4f60e552 service nova] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:42.301290 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-942c300f-32c8-4fe0-bded-4bcb4f60e552 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:42.317649 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4021ca8-d80e-4462-814b-e455177c5416 None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:42.330275 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610b3327-ea79-4873-a575-10073d8e8e44 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '874348b647194ac2b5ecbf12c33bf59e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:42.332553 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942c300f-32c8-4fe0-bded-4bcb4f60e552 service nova] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:42.340041 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610b3327-ea79-4873-a575-10073d8e8e44 service neutron] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:42.341744 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610b3327-ea79-4873-a575-10073d8e8e44 service neutron] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:42.342188 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610b3327-ea79-4873-a575-10073d8e8e44 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:42.343937 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534e5a3f-838d-4ed0-bdb0-1229150c94f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:42.344587 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534e5a3f-838d-4ed0-bdb0-1229150c94f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:42.344873 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534e5a3f-838d-4ed0-bdb0-1229150c94f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:42.345143 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534e5a3f-838d-4ed0-bdb0-1229150c94f6 admin admin] PATH_INFO: `/v3/users/f0e428207ee049fd90f3e69a8318b139` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:42.354845 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534e5a3f-838d-4ed0-bdb0-1229150c94f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f0e428207ee049fd90f3e69a8318b139)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:42.357641 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534e5a3f-838d-4ed0-bdb0-1229150c94f6 admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:42.371864 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610b3327-ea79-4873-a575-10073d8e8e44 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:42.373872 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610b3327-ea79-4873-a575-10073d8e8e44 service neutron] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:42.397824 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1014/2021] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 24 05:46:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:46:42.460056 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-534e5a3f-838d-4ed0-bdb0-1229150c94f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f0e428207ee049fd90f3e69a8318b139'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:42.472502 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-534e5a3f-838d-4ed0-bdb0-1229150c94f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f0e428207ee049fd90f3e69a8318b139'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:42.489250 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-534e5a3f-838d-4ed0-bdb0-1229150c94f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f0e428207ee049fd90f3e69a8318b139'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:42.507585 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-534e5a3f-838d-4ed0-bdb0-1229150c94f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f0e428207ee049fd90f3e69a8318b139'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:42.508498 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-534e5a3f-838d-4ed0-bdb0-1229150c94f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f0e428207ee049fd90f3e69a8318b139'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:42.517897 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1008/2022] 10.222.0.26 () {58 vars in 1224 bytes} [Wed Aug 24 05:46:42 2022] DELETE /identity/v3/users/f0e428207ee049fd90f3e69a8318b139 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:46:42.522199 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee82f44-82b9-4d92-aaeb-9978a8209001 None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:42.522931 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee82f44-82b9-4d92-aaeb-9978a8209001 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:42.524414 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee82f44-82b9-4d92-aaeb-9978a8209001 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:42.560437 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-8ee82f44-82b9-4d92-aaeb-9978a8209001 None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:46:42.562352 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-8ee82f44-82b9-4d92-aaeb-9978a8209001 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:42.651875 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1015/2023] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:46:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:46:42.665656 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534e5a3f-838d-4ed0-bdb0-1229150c94f6 admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:42.667984 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-534e5a3f-838d-4ed0-bdb0-1229150c94f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:42.831756 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534e5a3f-838d-4ed0-bdb0-1229150c94f6 admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:42.838134 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c25b75-5b29-4b1f-90fa-4de75f97853f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '874348b647194ac2b5ecbf12c33bf59e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:42.839173 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c25b75-5b29-4b1f-90fa-4de75f97853f service neutron] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:42.839593 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c25b75-5b29-4b1f-90fa-4de75f97853f service neutron] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:42.840119 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c25b75-5b29-4b1f-90fa-4de75f97853f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:42.859152 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c25b75-5b29-4b1f-90fa-4de75f97853f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:42.860908 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c25b75-5b29-4b1f-90fa-4de75f97853f service neutron] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:42.901195 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1009/2024] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 24 05:46:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:46:43.369102 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee82f44-82b9-4d92-aaeb-9978a8209001 None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:43.370579 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-8ee82f44-82b9-4d92-aaeb-9978a8209001 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:43.395650 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee82f44-82b9-4d92-aaeb-9978a8209001 None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:43.400525 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b27ec8c-5fbb-41ba-9d03-d9e8d48410ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:43.401266 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b27ec8c-5fbb-41ba-9d03-d9e8d48410ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:43.401433 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b27ec8c-5fbb-41ba-9d03-d9e8d48410ac admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:43.401900 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b27ec8c-5fbb-41ba-9d03-d9e8d48410ac admin admin] PATH_INFO: `/v3/projects/9420146df5524e0bb86138d04b38be28` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:43.406089 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b27ec8c-5fbb-41ba-9d03-d9e8d48410ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=9420146df5524e0bb86138d04b38be28)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:43.408221 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b27ec8c-5fbb-41ba-9d03-d9e8d48410ac admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:43.515786 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-2b27ec8c-5fbb-41ba-9d03-d9e8d48410ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9420146df5524e0bb86138d04b38be28', 'request_id': 'req-2b27ec8c-5fbb-41ba-9d03-d9e8d48410ac'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:43.546541 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-2b27ec8c-5fbb-41ba-9d03-d9e8d48410ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9420146df5524e0bb86138d04b38be28', 'request_id': 'req-2b27ec8c-5fbb-41ba-9d03-d9e8d48410ac'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:43.556438 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-2b27ec8c-5fbb-41ba-9d03-d9e8d48410ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9420146df5524e0bb86138d04b38be28', 'request_id': 'req-2b27ec8c-5fbb-41ba-9d03-d9e8d48410ac'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:43.584726 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-2b27ec8c-5fbb-41ba-9d03-d9e8d48410ac admin admin] The token cache is being invalidate because project 9420146df5524e0bb86138d04b38be28 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:46:43.585430 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-2b27ec8c-5fbb-41ba-9d03-d9e8d48410ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:43.586627 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-2b27ec8c-5fbb-41ba-9d03-d9e8d48410ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:43.592148 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1016/2025] 10.222.0.26 () {58 vars in 1233 bytes} [Wed Aug 24 05:46:43 2022] DELETE /identity/v3/projects/9420146df5524e0bb86138d04b38be28 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:46:43.596366 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c25b75-5b29-4b1f-90fa-4de75f97853f service neutron] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:43.613794 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c25b75-5b29-4b1f-90fa-4de75f97853f service neutron] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:43.699781 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:46:43.716170 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527265dc-4f9c-4bf9-be66-b11d2e16919f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:43.717817 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527265dc-4f9c-4bf9-be66-b11d2e16919f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:43.717817 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527265dc-4f9c-4bf9-be66-b11d2e16919f admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:43.719134 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527265dc-4f9c-4bf9-be66-b11d2e16919f admin admin] PATH_INFO: `/v3/users/d79f734e79184efbb2f1f52c2a597dfe` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:43.719897 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527265dc-4f9c-4bf9-be66-b11d2e16919f admin admin] RBAC: Authorizing `identity:delete_user(user_id=d79f734e79184efbb2f1f52c2a597dfe)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:43.722220 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527265dc-4f9c-4bf9-be66-b11d2e16919f admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:43.784694 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec6eee1-ba57-497c-beed-e860a87f87b5 None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:43.785044 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec6eee1-ba57-497c-beed-e860a87f87b5 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:43.785287 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec6eee1-ba57-497c-beed-e860a87f87b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:43.808194 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-527265dc-4f9c-4bf9-be66-b11d2e16919f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd79f734e79184efbb2f1f52c2a597dfe'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:43.822413 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-527265dc-4f9c-4bf9-be66-b11d2e16919f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd79f734e79184efbb2f1f52c2a597dfe'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:43.852673 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-527265dc-4f9c-4bf9-be66-b11d2e16919f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd79f734e79184efbb2f1f52c2a597dfe'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:43.863749 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-4ec6eee1-ba57-497c-beed-e860a87f87b5 None None] MFA Rules not processed for user `246cc4e07c754c62bb5337197867e8ce`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:46:43.867352 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-4ec6eee1-ba57-497c-beed-e860a87f87b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:43.871813 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-527265dc-4f9c-4bf9-be66-b11d2e16919f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd79f734e79184efbb2f1f52c2a597dfe'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:43.872492 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-527265dc-4f9c-4bf9-be66-b11d2e16919f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd79f734e79184efbb2f1f52c2a597dfe'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:43.882397 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1010/2026] 10.222.0.26 () {58 vars in 1224 bytes} [Wed Aug 24 05:46:43 2022] DELETE /identity/v3/users/d79f734e79184efbb2f1f52c2a597dfe => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:46:43.987777 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:46:44.046973 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1017/2027] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:46:43 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:46:44.066363 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527265dc-4f9c-4bf9-be66-b11d2e16919f admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:44.071391 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-527265dc-4f9c-4bf9-be66-b11d2e16919f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:44.178213 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527265dc-4f9c-4bf9-be66-b11d2e16919f admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:44.183244 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b32f02-a7ed-4d25-bfb6-b77fd4b166c1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17b450afe795495680fc70f522c83750', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:44.184823 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b32f02-a7ed-4d25-bfb6-b77fd4b166c1 service cinder] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:44.185204 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b32f02-a7ed-4d25-bfb6-b77fd4b166c1 service cinder] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:44.185603 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b32f02-a7ed-4d25-bfb6-b77fd4b166c1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:44.302366 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b32f02-a7ed-4d25-bfb6-b77fd4b166c1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:44.303823 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b32f02-a7ed-4d25-bfb6-b77fd4b166c1 service cinder] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:44.314977 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1011/2028] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 24 05:46:44 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:46:44.512117 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec6eee1-ba57-497c-beed-e860a87f87b5 None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:44.516558 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-4ec6eee1-ba57-497c-beed-e860a87f87b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:44.566206 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec6eee1-ba57-497c-beed-e860a87f87b5 None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:44.662670 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ab294e-3ff5-4445-afae-be812e83b1c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:44.663569 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ab294e-3ff5-4445-afae-be812e83b1c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:44.664027 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ab294e-3ff5-4445-afae-be812e83b1c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:44.664360 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ab294e-3ff5-4445-afae-be812e83b1c2 admin admin] PATH_INFO: `/v3/projects/29ae82aaf8104fec9f92393c470c2009` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:44.666490 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ab294e-3ff5-4445-afae-be812e83b1c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=29ae82aaf8104fec9f92393c470c2009)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:44.668486 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ab294e-3ff5-4445-afae-be812e83b1c2 admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:44.762165 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-56ab294e-3ff5-4445-afae-be812e83b1c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '29ae82aaf8104fec9f92393c470c2009', 'request_id': 'req-56ab294e-3ff5-4445-afae-be812e83b1c2'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:44.779167 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-56ab294e-3ff5-4445-afae-be812e83b1c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '29ae82aaf8104fec9f92393c470c2009', 'request_id': 'req-56ab294e-3ff5-4445-afae-be812e83b1c2'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:44.802316 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-56ab294e-3ff5-4445-afae-be812e83b1c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '29ae82aaf8104fec9f92393c470c2009', 'request_id': 'req-56ab294e-3ff5-4445-afae-be812e83b1c2'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:44.818935 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-56ab294e-3ff5-4445-afae-be812e83b1c2 admin admin] The token cache is being invalidate because project 29ae82aaf8104fec9f92393c470c2009 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:46:44.819495 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-56ab294e-3ff5-4445-afae-be812e83b1c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:44.820336 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-56ab294e-3ff5-4445-afae-be812e83b1c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:44.823902 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1018/2029] 10.222.0.26 () {58 vars in 1233 bytes} [Wed Aug 24 05:46:44 2022] DELETE /identity/v3/projects/29ae82aaf8104fec9f92393c470c2009 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:46:44.828533 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b32f02-a7ed-4d25-bfb6-b77fd4b166c1 service cinder] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:44.850344 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b32f02-a7ed-4d25-bfb6-b77fd4b166c1 service cinder] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:44.881768 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:46:44.934561 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadcdfaf-759f-43d4-9b30-2142c9a413e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:44.935341 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadcdfaf-759f-43d4-9b30-2142c9a413e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:44.935746 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadcdfaf-759f-43d4-9b30-2142c9a413e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:44.936096 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadcdfaf-759f-43d4-9b30-2142c9a413e9 admin admin] PATH_INFO: `/v3/users/f637c50b417b49e1b83622b36fb48e12` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:44.937470 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadcdfaf-759f-43d4-9b30-2142c9a413e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f637c50b417b49e1b83622b36fb48e12)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:44.940170 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadcdfaf-759f-43d4-9b30-2142c9a413e9 admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:45.026437 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-eadcdfaf-759f-43d4-9b30-2142c9a413e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f637c50b417b49e1b83622b36fb48e12'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:45.052081 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-eadcdfaf-759f-43d4-9b30-2142c9a413e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f637c50b417b49e1b83622b36fb48e12'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:45.077792 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-eadcdfaf-759f-43d4-9b30-2142c9a413e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f637c50b417b49e1b83622b36fb48e12'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:45.087860 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-eadcdfaf-759f-43d4-9b30-2142c9a413e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f637c50b417b49e1b83622b36fb48e12'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:45.088787 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-eadcdfaf-759f-43d4-9b30-2142c9a413e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f637c50b417b49e1b83622b36fb48e12'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:45.097614 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1012/2030] 10.222.0.26 () {58 vars in 1224 bytes} [Wed Aug 24 05:46:44 2022] DELETE /identity/v3/users/f637c50b417b49e1b83622b36fb48e12 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 05:46:45.196101 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ab294e-3ff5-4445-afae-be812e83b1c2 admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:45.198041 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-56ab294e-3ff5-4445-afae-be812e83b1c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:45.213297 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ab294e-3ff5-4445-afae-be812e83b1c2 admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:45.281825 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e73c7fe-9fcc-4bd6-97bb-8d7cda4c2127 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:45.282501 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e73c7fe-9fcc-4bd6-97bb-8d7cda4c2127 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:45.282783 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e73c7fe-9fcc-4bd6-97bb-8d7cda4c2127 admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:45.283054 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e73c7fe-9fcc-4bd6-97bb-8d7cda4c2127 admin admin] PATH_INFO: `/v3/users/346e3a6e9ba444e4b3f6865f8f1cb741` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:45.284289 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e73c7fe-9fcc-4bd6-97bb-8d7cda4c2127 admin admin] RBAC: Authorizing `identity:delete_user(user_id=346e3a6e9ba444e4b3f6865f8f1cb741)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:45.286289 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e73c7fe-9fcc-4bd6-97bb-8d7cda4c2127 admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:45.311660 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:46:45.352609 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-7e73c7fe-9fcc-4bd6-97bb-8d7cda4c2127 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '346e3a6e9ba444e4b3f6865f8f1cb741'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:45.371668 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-7e73c7fe-9fcc-4bd6-97bb-8d7cda4c2127 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '346e3a6e9ba444e4b3f6865f8f1cb741'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:45.379870 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-7e73c7fe-9fcc-4bd6-97bb-8d7cda4c2127 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '346e3a6e9ba444e4b3f6865f8f1cb741'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:45.397501 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-7e73c7fe-9fcc-4bd6-97bb-8d7cda4c2127 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '346e3a6e9ba444e4b3f6865f8f1cb741'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:45.410461 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-7e73c7fe-9fcc-4bd6-97bb-8d7cda4c2127 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '346e3a6e9ba444e4b3f6865f8f1cb741'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:45.421352 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1019/2031] 10.222.0.26 () {58 vars in 1224 bytes} [Wed Aug 24 05:46:45 2022] DELETE /identity/v3/users/346e3a6e9ba444e4b3f6865f8f1cb741 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:46:45.428620 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd76911f-eaeb-42b8-b9ea-14d79ccaad7a None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:45.431366 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd76911f-eaeb-42b8-b9ea-14d79ccaad7a None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:45.431867 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd76911f-eaeb-42b8-b9ea-14d79ccaad7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:45.459606 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e73c7fe-9fcc-4bd6-97bb-8d7cda4c2127 admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:45.461493 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-7e73c7fe-9fcc-4bd6-97bb-8d7cda4c2127 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:45.464028 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-fd76911f-eaeb-42b8-b9ea-14d79ccaad7a None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:46:45.466390 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-fd76911f-eaeb-42b8-b9ea-14d79ccaad7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:45.562370 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1013/2032] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:46:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:46:45.572608 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e73c7fe-9fcc-4bd6-97bb-8d7cda4c2127 admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:45.573102 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd76911f-eaeb-42b8-b9ea-14d79ccaad7a None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:45.574269 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-fd76911f-eaeb-42b8-b9ea-14d79ccaad7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:45.579716 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b87bd5-9983-41b4-9b2c-8df03614740b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:45.580452 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b87bd5-9983-41b4-9b2c-8df03614740b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:45.580811 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b87bd5-9983-41b4-9b2c-8df03614740b admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:45.581160 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b87bd5-9983-41b4-9b2c-8df03614740b admin admin] PATH_INFO: `/v3/projects/37060db7e56d4d6b903463ede787165a` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:45.582932 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b87bd5-9983-41b4-9b2c-8df03614740b admin admin] RBAC: Authorizing `identity:delete_project(project_id=37060db7e56d4d6b903463ede787165a)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:45.587292 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b87bd5-9983-41b4-9b2c-8df03614740b admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:45.629798 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:46:45.646207 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd76911f-eaeb-42b8-b9ea-14d79ccaad7a None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:45.659774 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-a6b87bd5-9983-41b4-9b2c-8df03614740b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '37060db7e56d4d6b903463ede787165a', 'request_id': 'req-a6b87bd5-9983-41b4-9b2c-8df03614740b'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:45.672395 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-a6b87bd5-9983-41b4-9b2c-8df03614740b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '37060db7e56d4d6b903463ede787165a', 'request_id': 'req-a6b87bd5-9983-41b4-9b2c-8df03614740b'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:45.680930 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-a6b87bd5-9983-41b4-9b2c-8df03614740b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '37060db7e56d4d6b903463ede787165a', 'request_id': 'req-a6b87bd5-9983-41b4-9b2c-8df03614740b'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:45.701113 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-a6b87bd5-9983-41b4-9b2c-8df03614740b admin admin] The token cache is being invalidate because project 37060db7e56d4d6b903463ede787165a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:46:45.701466 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-a6b87bd5-9983-41b4-9b2c-8df03614740b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:45.702335 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-a6b87bd5-9983-41b4-9b2c-8df03614740b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:45.703995 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1020/2033] 10.222.0.26 () {58 vars in 1233 bytes} [Wed Aug 24 05:46:45 2022] DELETE /identity/v3/projects/37060db7e56d4d6b903463ede787165a => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 05:46:45.711160 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dd13a9-233e-47c4-90c2-2336e32729bc None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:45.711525 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dd13a9-233e-47c4-90c2-2336e32729bc None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:45.712285 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dd13a9-233e-47c4-90c2-2336e32729bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:45.723616 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d3d5db-02d6-4343-904a-992140f52fb7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '874348b647194ac2b5ecbf12c33bf59e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:45.724245 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d3d5db-02d6-4343-904a-992140f52fb7 service neutron] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:45.724529 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d3d5db-02d6-4343-904a-992140f52fb7 service neutron] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:45.724944 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d3d5db-02d6-4343-904a-992140f52fb7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:45.726734 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-d0d3d5db-02d6-4343-904a-992140f52fb7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:45.735190 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-44dd13a9-233e-47c4-90c2-2336e32729bc None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:46:45.736526 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-44dd13a9-233e-47c4-90c2-2336e32729bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:45.766373 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:46:45.808633 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1021/2034] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:46:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 05:46:45.813759 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d3d5db-02d6-4343-904a-992140f52fb7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:45.816143 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d3d5db-02d6-4343-904a-992140f52fb7 service neutron] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:45.817079 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5756c921-da74-4ef7-91f6-385eb5a52152 None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:45.817373 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5756c921-da74-4ef7-91f6-385eb5a52152 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:45.817650 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5756c921-da74-4ef7-91f6-385eb5a52152 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:45.830148 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1014/2035] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 24 05:46:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 05:46:45.854779 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-5756c921-da74-4ef7-91f6-385eb5a52152 None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:46:45.856177 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-5756c921-da74-4ef7-91f6-385eb5a52152 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:45.866678 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1022/2036] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:46:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 05:46:45.871018 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d3d5db-02d6-4343-904a-992140f52fb7 service neutron] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:45.881331 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d3d5db-02d6-4343-904a-992140f52fb7 service neutron] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:45.889503 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6313dd9-182b-4679-b599-80f20b666dac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:45.890292 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6313dd9-182b-4679-b599-80f20b666dac admin admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:45.890993 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6313dd9-182b-4679-b599-80f20b666dac admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:45.891340 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6313dd9-182b-4679-b599-80f20b666dac admin admin] PATH_INFO: `/v3/domains` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:45.892214 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6313dd9-182b-4679-b599-80f20b666dac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:46:45.892637 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6313dd9-182b-4679-b599-80f20b666dac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:45.894654 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6313dd9-182b-4679-b599-80f20b666dac admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:45.909263 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1015/2037] 10.222.0.26 () {58 vars in 1153 bytes} [Wed Aug 24 05:46:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:46:45.913311 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5756c921-da74-4ef7-91f6-385eb5a52152 None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:45.924671 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5756c921-da74-4ef7-91f6-385eb5a52152 None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:45.931035 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1658274-362d-4f03-abe8-399cf9ba43c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:45.932201 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1658274-362d-4f03-abe8-399cf9ba43c8 admin admin] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:45.932968 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1658274-362d-4f03-abe8-399cf9ba43c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:45.933481 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1658274-362d-4f03-abe8-399cf9ba43c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:45.934932 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1658274-362d-4f03-abe8-399cf9ba43c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:45.937435 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1658274-362d-4f03-abe8-399cf9ba43c8 admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:45.971478 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a244445-ab6a-47e2-8956-eca7ee17bc9c None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:45.971902 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a244445-ab6a-47e2-8956-eca7ee17bc9c None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:45.972420 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a244445-ab6a-47e2-8956-eca7ee17bc9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:45.982085 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1023/2038] 10.222.0.26 () {60 vars in 1153 bytes} [Wed Aug 24 05:46:45 2022] POST /identity/v3/projects => generated 379 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:46:45.986337 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1658274-362d-4f03-abe8-399cf9ba43c8 admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:46.009787 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-2a244445-ab6a-47e2-8956-eca7ee17bc9c None None] MFA Rules not processed for user `246cc4e07c754c62bb5337197867e8ce`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:46:46.011341 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-2a244445-ab6a-47e2-8956-eca7ee17bc9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:46.104623 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1658274-362d-4f03-abe8-399cf9ba43c8 admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:46.130150 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1016/2039] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:46:45 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 05:46:46.130547 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4d0168-b98e-42d8-b349-68db88641c9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:46.131483 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4d0168-b98e-42d8-b349-68db88641c9e admin admin] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:46.132044 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4d0168-b98e-42d8-b349-68db88641c9e admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:46.132624 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4d0168-b98e-42d8-b349-68db88641c9e admin admin] PATH_INFO: `/v3/users` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:46.133459 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4d0168-b98e-42d8-b349-68db88641c9e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:46.135655 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4d0168-b98e-42d8-b349-68db88641c9e admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:46.175260 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1024/2040] 10.222.0.26 () {60 vars in 1144 bytes} [Wed Aug 24 05:46:45 2022] POST /identity/v3/users => generated 290 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 05:46:46.180066 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a244445-ab6a-47e2-8956-eca7ee17bc9c None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:46.191492 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4d0168-b98e-42d8-b349-68db88641c9e admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:46.195469 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-8d4d0168-b98e-42d8-b349-68db88641c9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:46.202037 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a244445-ab6a-47e2-8956-eca7ee17bc9c None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:46.212668 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a6d724-cdd6-49ce-9fdf-a31ba7fccc60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:46.213356 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a6d724-cdd6-49ce-9fdf-a31ba7fccc60 admin admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:46.213640 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a6d724-cdd6-49ce-9fdf-a31ba7fccc60 admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:46.213899 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a6d724-cdd6-49ce-9fdf-a31ba7fccc60 admin admin] PATH_INFO: `/v3/roles` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:46.214688 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a6d724-cdd6-49ce-9fdf-a31ba7fccc60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:46.216375 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a6d724-cdd6-49ce-9fdf-a31ba7fccc60 admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:46.223777 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4d0168-b98e-42d8-b349-68db88641c9e admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:46.230710 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed60014b-6869-46db-a885-1adbe5f0f235 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:46.231489 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed60014b-6869-46db-a885-1adbe5f0f235 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:46.231773 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed60014b-6869-46db-a885-1adbe5f0f235 admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:46.232191 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed60014b-6869-46db-a885-1adbe5f0f235 admin admin] PATH_INFO: `/v3/users/de0c11a177ed46f48613adda772262a9` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:46.233400 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed60014b-6869-46db-a885-1adbe5f0f235 admin admin] RBAC: Authorizing `identity:delete_user(user_id=de0c11a177ed46f48613adda772262a9)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:46.237825 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed60014b-6869-46db-a885-1adbe5f0f235 admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:46.244057 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1017/2041] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Aug 24 05:46:46 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:46:46.251325 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a6d724-cdd6-49ce-9fdf-a31ba7fccc60 admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:46.267403 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a6d724-cdd6-49ce-9fdf-a31ba7fccc60 admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:46.279421 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6e6135-0d5b-4cfe-b0fb-ae86692c1bfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:46.280047 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6e6135-0d5b-4cfe-b0fb-ae86692c1bfa admin admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:46.280328 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6e6135-0d5b-4cfe-b0fb-ae86692c1bfa admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:46.280595 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6e6135-0d5b-4cfe-b0fb-ae86692c1bfa admin admin] PATH_INFO: `/v3/roles` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:46.281245 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6e6135-0d5b-4cfe-b0fb-ae86692c1bfa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:46.283351 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6e6135-0d5b-4cfe-b0fb-ae86692c1bfa admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:46.308816 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1018/2042] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Aug 24 05:46:46 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:46:46.313597 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6e6135-0d5b-4cfe-b0fb-ae86692c1bfa admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:46.341055 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-ed60014b-6869-46db-a885-1adbe5f0f235 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de0c11a177ed46f48613adda772262a9'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:46.353249 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6e6135-0d5b-4cfe-b0fb-ae86692c1bfa admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:46.357155 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-ed60014b-6869-46db-a885-1adbe5f0f235 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de0c11a177ed46f48613adda772262a9'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:46.358324 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-ed60014b-6869-46db-a885-1adbe5f0f235 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de0c11a177ed46f48613adda772262a9'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:46.363480 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc688cfb-5e44-4dc9-86ab-dd9006c41cee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:46.364444 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc688cfb-5e44-4dc9-86ab-dd9006c41cee admin admin] REQUEST_METHOD: `PUT` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:46.364725 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc688cfb-5e44-4dc9-86ab-dd9006c41cee admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:46.364993 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc688cfb-5e44-4dc9-86ab-dd9006c41cee admin admin] PATH_INFO: `/v3/projects/a99654d3ac1249b29779dbf35ae524f8/users/5e3b1a1e2be241f19aaeb49c41ba4101/roles/f7aa4a2c74c94c1b9ca8ecdcccccda5c` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:46.399448 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-ed60014b-6869-46db-a885-1adbe5f0f235 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de0c11a177ed46f48613adda772262a9'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:46.406706 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc688cfb-5e44-4dc9-86ab-dd9006c41cee admin admin] RBAC: Authorizing `identity:create_grant(project_id=a99654d3ac1249b29779dbf35ae524f8, user_id=5e3b1a1e2be241f19aaeb49c41ba4101, role_id=f7aa4a2c74c94c1b9ca8ecdcccccda5c)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:46.409356 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc688cfb-5e44-4dc9-86ab-dd9006c41cee admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:46.413379 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:46:46.426589 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-ed60014b-6869-46db-a885-1adbe5f0f235 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de0c11a177ed46f48613adda772262a9'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:46.433276 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1019/2043] 10.222.0.26 () {60 vars in 1483 bytes} [Wed Aug 24 05:46:46 2022] PUT /identity/v3/projects/a99654d3ac1249b29779dbf35ae524f8/users/5e3b1a1e2be241f19aaeb49c41ba4101/roles/f7aa4a2c74c94c1b9ca8ecdcccccda5c => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 05:46:46.438081 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1025/2044] 10.222.0.26 () {58 vars in 1224 bytes} [Wed Aug 24 05:46:46 2022] DELETE /identity/v3/users/de0c11a177ed46f48613adda772262a9 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:46:46.439348 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7507884-4b49-47e1-be40-f9c97d2b40c6 None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:46.439584 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7507884-4b49-47e1-be40-f9c97d2b40c6 None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:46.439856 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7507884-4b49-47e1-be40-f9c97d2b40c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:46.460115 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de508fa2-3d31-4ae1-a4c5-a32d09f96391 None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:46.460367 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de508fa2-3d31-4ae1-a4c5-a32d09f96391 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:46.460606 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de508fa2-3d31-4ae1-a4c5-a32d09f96391 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:46.474248 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-f7507884-4b49-47e1-be40-f9c97d2b40c6 None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:46:46.475473 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-f7507884-4b49-47e1-be40-f9c97d2b40c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:46.489705 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:46:46.541796 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-de508fa2-3d31-4ae1-a4c5-a32d09f96391 None None] MFA Rules not processed for user `5e3b1a1e2be241f19aaeb49c41ba4101`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:46:46.544188 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-de508fa2-3d31-4ae1-a4c5-a32d09f96391 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:46.583322 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1020/2045] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:46:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 05:46:46.584431 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7507884-4b49-47e1-be40-f9c97d2b40c6 None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:46.586097 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-f7507884-4b49-47e1-be40-f9c97d2b40c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:46.608625 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7507884-4b49-47e1-be40-f9c97d2b40c6 None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:46.613555 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b16654-22cd-43c7-956d-91bfc22c7add admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:46.614226 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b16654-22cd-43c7-956d-91bfc22c7add admin admin] REQUEST_METHOD: `DELETE` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:46.614504 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b16654-22cd-43c7-956d-91bfc22c7add admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:46.614803 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b16654-22cd-43c7-956d-91bfc22c7add admin admin] PATH_INFO: `/v3/projects/940b143e02d844c1992ce48992e1746e` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:46.616017 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b16654-22cd-43c7-956d-91bfc22c7add admin admin] RBAC: Authorizing `identity:delete_project(project_id=940b143e02d844c1992ce48992e1746e)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:46.617772 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b16654-22cd-43c7-956d-91bfc22c7add admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:46.640561 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1026/2046] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:46:46 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:46:46.641613 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de508fa2-3d31-4ae1-a4c5-a32d09f96391 None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:46.643873 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-de508fa2-3d31-4ae1-a4c5-a32d09f96391 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:46.691994 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-84b16654-22cd-43c7-956d-91bfc22c7add admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '940b143e02d844c1992ce48992e1746e', 'request_id': 'req-84b16654-22cd-43c7-956d-91bfc22c7add'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:46.703211 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-84b16654-22cd-43c7-956d-91bfc22c7add admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '940b143e02d844c1992ce48992e1746e', 'request_id': 'req-84b16654-22cd-43c7-956d-91bfc22c7add'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:46.716477 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-84b16654-22cd-43c7-956d-91bfc22c7add admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '940b143e02d844c1992ce48992e1746e', 'request_id': 'req-84b16654-22cd-43c7-956d-91bfc22c7add'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:46.727922 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de508fa2-3d31-4ae1-a4c5-a32d09f96391 None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:46.730470 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-84b16654-22cd-43c7-956d-91bfc22c7add admin admin] The token cache is being invalidate because project 940b143e02d844c1992ce48992e1746e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88112) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:46:46.730824 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-84b16654-22cd-43c7-956d-91bfc22c7add admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:46.734319 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-84b16654-22cd-43c7-956d-91bfc22c7add admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:46.736349 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1021/2047] 10.222.0.26 () {58 vars in 1233 bytes} [Wed Aug 24 05:46:46 2022] DELETE /identity/v3/projects/940b143e02d844c1992ce48992e1746e => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:46:46.738236 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b16654-22cd-43c7-956d-91bfc22c7add admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:46.740417 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-84b16654-22cd-43c7-956d-91bfc22c7add admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:46.791806 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a63bd6-42c3-444a-bab4-96eb5095f230 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '874348b647194ac2b5ecbf12c33bf59e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:46.792428 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a63bd6-42c3-444a-bab4-96eb5095f230 service neutron] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:46.792710 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a63bd6-42c3-444a-bab4-96eb5095f230 service neutron] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:46.792986 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a63bd6-42c3-444a-bab4-96eb5095f230 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:46.795622 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-a8a63bd6-42c3-444a-bab4-96eb5095f230 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:46.824041 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b16654-22cd-43c7-956d-91bfc22c7add admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:46.829212 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bed120-9274-4ec6-beb6-88b83e0d3d2d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17b450afe795495680fc70f522c83750', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:46.830153 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bed120-9274-4ec6-beb6-88b83e0d3d2d service cinder] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:46.830153 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bed120-9274-4ec6-beb6-88b83e0d3d2d service cinder] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:46.830684 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bed120-9274-4ec6-beb6-88b83e0d3d2d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:46.832144 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-84bed120-9274-4ec6-beb6-88b83e0d3d2d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:46.870022 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:INSERT=2,keystone:SELECT=91,keystone:DELETE=7 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:46:46.876371 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a63bd6-42c3-444a-bab4-96eb5095f230 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:46.878125 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a63bd6-42c3-444a-bab4-96eb5095f230 service neutron] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:46.885782 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:46:46.891701 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1027/2048] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 24 05:46:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:46:46.907973 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a63bd6-42c3-444a-bab4-96eb5095f230 service neutron] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:46.910840 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-a8a63bd6-42c3-444a-bab4-96eb5095f230 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:46.921666 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bed120-9274-4ec6-beb6-88b83e0d3d2d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:46.923162 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bed120-9274-4ec6-beb6-88b83e0d3d2d service cinder] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:46.929670 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a63bd6-42c3-444a-bab4-96eb5095f230 service neutron] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:46.935134 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c281f8d-047c-45c6-994f-1317d074ddeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:46.935798 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c281f8d-047c-45c6-994f-1317d074ddeb admin admin] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:46.936079 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c281f8d-047c-45c6-994f-1317d074ddeb admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:46.936348 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c281f8d-047c-45c6-994f-1317d074ddeb admin admin] PATH_INFO: `/v3/projects` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:46.937223 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c281f8d-047c-45c6-994f-1317d074ddeb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:46.939879 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c281f8d-047c-45c6-994f-1317d074ddeb admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:46.949016 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1022/2049] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 24 05:46:46 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:46:46.949991 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bed120-9274-4ec6-beb6-88b83e0d3d2d service cinder] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:46.952401 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-84bed120-9274-4ec6-beb6-88b83e0d3d2d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:46.985123 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bed120-9274-4ec6-beb6-88b83e0d3d2d service cinder] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:46.995503 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8d9ac7-8197-46a6-b1e0-0fbb26487b04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:46.997212 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8d9ac7-8197-46a6-b1e0-0fbb26487b04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:46.997500 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8d9ac7-8197-46a6-b1e0-0fbb26487b04 admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:46.997814 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8d9ac7-8197-46a6-b1e0-0fbb26487b04 admin admin] PATH_INFO: `/v3/users/05c4fe27bcfe4b979ca2831c6e768a81` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:47.002375 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8d9ac7-8197-46a6-b1e0-0fbb26487b04 admin admin] RBAC: Authorizing `identity:delete_user(user_id=05c4fe27bcfe4b979ca2831c6e768a81)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:47.004279 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1028/2050] 10.222.0.26 () {60 vars in 1153 bytes} [Wed Aug 24 05:46:46 2022] POST /identity/v3/projects => generated 379 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:46:47.007364 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8d9ac7-8197-46a6-b1e0-0fbb26487b04 admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:47.009321 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c281f8d-047c-45c6-994f-1317d074ddeb admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:47.094253 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-6c8d9ac7-8197-46a6-b1e0-0fbb26487b04 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '05c4fe27bcfe4b979ca2831c6e768a81'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:47.115164 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-6c8d9ac7-8197-46a6-b1e0-0fbb26487b04 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '05c4fe27bcfe4b979ca2831c6e768a81'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:47.129139 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c281f8d-047c-45c6-994f-1317d074ddeb admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:47.139944 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c678b541-5c75-44d1-9fdc-c8efa89be3f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:47.142071 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c678b541-5c75-44d1-9fdc-c8efa89be3f3 admin admin] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:47.142344 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c678b541-5c75-44d1-9fdc-c8efa89be3f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:47.142619 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c678b541-5c75-44d1-9fdc-c8efa89be3f3 admin admin] PATH_INFO: `/v3/users` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:47.144174 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c678b541-5c75-44d1-9fdc-c8efa89be3f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:47.150240 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c678b541-5c75-44d1-9fdc-c8efa89be3f3 admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:47.153803 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-6c8d9ac7-8197-46a6-b1e0-0fbb26487b04 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '05c4fe27bcfe4b979ca2831c6e768a81'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:47.167920 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-6c8d9ac7-8197-46a6-b1e0-0fbb26487b04 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '05c4fe27bcfe4b979ca2831c6e768a81'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:47.168853 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-6c8d9ac7-8197-46a6-b1e0-0fbb26487b04 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '05c4fe27bcfe4b979ca2831c6e768a81'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:47.178732 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1023/2051] 10.222.0.26 () {58 vars in 1224 bytes} [Wed Aug 24 05:46:46 2022] DELETE /identity/v3/users/05c4fe27bcfe4b979ca2831c6e768a81 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:46:47.213981 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1029/2052] 10.222.0.26 () {60 vars in 1144 bytes} [Wed Aug 24 05:46:47 2022] POST /identity/v3/users => generated 296 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:46:47.218219 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8d9ac7-8197-46a6-b1e0-0fbb26487b04 admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:47.220567 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-6c8d9ac7-8197-46a6-b1e0-0fbb26487b04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:47.318280 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8d9ac7-8197-46a6-b1e0-0fbb26487b04 admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:47.325725 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9091465-3774-4c56-9a50-8c06d226cab7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:47.326407 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9091465-3774-4c56-9a50-8c06d226cab7 admin admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:47.326748 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9091465-3774-4c56-9a50-8c06d226cab7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:47.327024 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9091465-3774-4c56-9a50-8c06d226cab7 admin admin] PATH_INFO: `/v3/roles` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:47.327778 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9091465-3774-4c56-9a50-8c06d226cab7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:47.329540 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9091465-3774-4c56-9a50-8c06d226cab7 admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:47.346632 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1024/2053] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Aug 24 05:46:47 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:46:47.347883 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c678b541-5c75-44d1-9fdc-c8efa89be3f3 admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:47.360200 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c678b541-5c75-44d1-9fdc-c8efa89be3f3 admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:47.367170 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c020d46-5d56-4847-8faa-8090dc58b3b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:47.368229 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c020d46-5d56-4847-8faa-8090dc58b3b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:47.368693 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c020d46-5d56-4847-8faa-8090dc58b3b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:47.369119 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c020d46-5d56-4847-8faa-8090dc58b3b8 admin admin] PATH_INFO: `/v3/projects/c5999d7813c44ad78ccca66d96f8e75b/users/6ebb820123a94d41ac0bcb75df20dfc6/roles/640bda0879494e60b72680ee505285f0` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:47.404814 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c020d46-5d56-4847-8faa-8090dc58b3b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5999d7813c44ad78ccca66d96f8e75b, user_id=6ebb820123a94d41ac0bcb75df20dfc6, role_id=640bda0879494e60b72680ee505285f0)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:47.408033 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c020d46-5d56-4847-8faa-8090dc58b3b8 admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:47.427729 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1030/2054] 10.222.0.26 () {60 vars in 1483 bytes} [Wed Aug 24 05:46:47 2022] PUT /identity/v3/projects/c5999d7813c44ad78ccca66d96f8e75b/users/6ebb820123a94d41ac0bcb75df20dfc6/roles/640bda0879494e60b72680ee505285f0 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:46:47.431728 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9091465-3774-4c56-9a50-8c06d226cab7 admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:47.448371 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9091465-3774-4c56-9a50-8c06d226cab7 admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:47.510829 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:46:47.548874 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3373486-c65a-4727-8b9a-b5d47245cfe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:47.549680 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3373486-c65a-4727-8b9a-b5d47245cfe5 admin admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:47.549989 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3373486-c65a-4727-8b9a-b5d47245cfe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:47.550270 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3373486-c65a-4727-8b9a-b5d47245cfe5 admin admin] PATH_INFO: `/v3/roles` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:47.551209 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3373486-c65a-4727-8b9a-b5d47245cfe5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:47.553150 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3373486-c65a-4727-8b9a-b5d47245cfe5 admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:47.571464 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1025/2055] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Aug 24 05:46:47 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:46:47.573095 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c020d46-5d56-4847-8faa-8090dc58b3b8 admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:47.586577 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c020d46-5d56-4847-8faa-8090dc58b3b8 admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:47.592140 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555f30aa-c910-45c8-9d06-5230e7e1c9af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:47.593370 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555f30aa-c910-45c8-9d06-5230e7e1c9af admin admin] REQUEST_METHOD: `PUT` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:47.593851 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555f30aa-c910-45c8-9d06-5230e7e1c9af admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:47.594347 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555f30aa-c910-45c8-9d06-5230e7e1c9af admin admin] PATH_INFO: `/v3/projects/c5999d7813c44ad78ccca66d96f8e75b/users/6ebb820123a94d41ac0bcb75df20dfc6/roles/640bda0879494e60b72680ee505285f0` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:47.599536 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555f30aa-c910-45c8-9d06-5230e7e1c9af admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5999d7813c44ad78ccca66d96f8e75b, user_id=6ebb820123a94d41ac0bcb75df20dfc6, role_id=640bda0879494e60b72680ee505285f0)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:47.603152 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555f30aa-c910-45c8-9d06-5230e7e1c9af admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:47.631163 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1031/2056] 10.222.0.26 () {60 vars in 1483 bytes} [Wed Aug 24 05:46:47 2022] PUT /identity/v3/projects/c5999d7813c44ad78ccca66d96f8e75b/users/6ebb820123a94d41ac0bcb75df20dfc6/roles/640bda0879494e60b72680ee505285f0 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:46:47.635969 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62eb511d-6892-4cbc-a3e9-a8b4392c6e60 None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:47.636510 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62eb511d-6892-4cbc-a3e9-a8b4392c6e60 None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:47.636946 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62eb511d-6892-4cbc-a3e9-a8b4392c6e60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:47.695229 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-62eb511d-6892-4cbc-a3e9-a8b4392c6e60 None None] MFA Rules not processed for user `6ebb820123a94d41ac0bcb75df20dfc6`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:46:47.696478 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-62eb511d-6892-4cbc-a3e9-a8b4392c6e60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:47.864681 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1026/2057] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:46:47 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:46:47.867214 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555f30aa-c910-45c8-9d06-5230e7e1c9af admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:47.870340 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-555f30aa-c910-45c8-9d06-5230e7e1c9af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:47.879586 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62eb511d-6892-4cbc-a3e9-a8b4392c6e60 None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:47.882067 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-62eb511d-6892-4cbc-a3e9-a8b4392c6e60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:48.070095 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555f30aa-c910-45c8-9d06-5230e7e1c9af admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:48.083008 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d61634-fe67-4d0b-9f46-c78a92903f14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:48.083907 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d61634-fe67-4d0b-9f46-c78a92903f14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:48.084338 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d61634-fe67-4d0b-9f46-c78a92903f14 admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:48.084787 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d61634-fe67-4d0b-9f46-c78a92903f14 admin admin] PATH_INFO: `/v3/projects/2ee97507178242e8a0010a4cd19a5578` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:48.086475 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d61634-fe67-4d0b-9f46-c78a92903f14 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ee97507178242e8a0010a4cd19a5578)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:48.090540 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d61634-fe67-4d0b-9f46-c78a92903f14 admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:48.101286 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62eb511d-6892-4cbc-a3e9-a8b4392c6e60 None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:48.113112 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29228fe-5fd7-4ea1-871a-4c59e3302c73 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17b450afe795495680fc70f522c83750', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:48.113777 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29228fe-5fd7-4ea1-871a-4c59e3302c73 service cinder] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:48.114129 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29228fe-5fd7-4ea1-871a-4c59e3302c73 service cinder] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:48.114351 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29228fe-5fd7-4ea1-871a-4c59e3302c73 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:48.130161 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29228fe-5fd7-4ea1-871a-4c59e3302c73 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:48.131684 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29228fe-5fd7-4ea1-871a-4c59e3302c73 service cinder] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:48.161918 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=92,keystone:INSERT=6,keystone:DELETE=2 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:46:48.168071 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1027/2058] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 24 05:46:47 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:46:48.207800 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-54d61634-fe67-4d0b-9f46-c78a92903f14 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ee97507178242e8a0010a4cd19a5578', 'request_id': 'req-54d61634-fe67-4d0b-9f46-c78a92903f14'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:48.237537 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-54d61634-fe67-4d0b-9f46-c78a92903f14 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ee97507178242e8a0010a4cd19a5578', 'request_id': 'req-54d61634-fe67-4d0b-9f46-c78a92903f14'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:48.258684 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-54d61634-fe67-4d0b-9f46-c78a92903f14 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ee97507178242e8a0010a4cd19a5578', 'request_id': 'req-54d61634-fe67-4d0b-9f46-c78a92903f14'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:48.282678 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-54d61634-fe67-4d0b-9f46-c78a92903f14 admin admin] The token cache is being invalidate because project 2ee97507178242e8a0010a4cd19a5578 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:46:48.282678 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-54d61634-fe67-4d0b-9f46-c78a92903f14 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:48.282678 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-54d61634-fe67-4d0b-9f46-c78a92903f14 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:48.282678 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1032/2059] 10.222.0.26 () {58 vars in 1233 bytes} [Wed Aug 24 05:46:47 2022] DELETE /identity/v3/projects/2ee97507178242e8a0010a4cd19a5578 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:46:48.287456 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29228fe-5fd7-4ea1-871a-4c59e3302c73 service cinder] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:48.301152 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29228fe-5fd7-4ea1-871a-4c59e3302c73 service cinder] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:48.420504 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831c43ae-a9c7-48fe-a56a-9fb2498d6fbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:48.421191 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831c43ae-a9c7-48fe-a56a-9fb2498d6fbc admin admin] REQUEST_METHOD: `DELETE` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:48.421486 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831c43ae-a9c7-48fe-a56a-9fb2498d6fbc admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:48.421768 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831c43ae-a9c7-48fe-a56a-9fb2498d6fbc admin admin] PATH_INFO: `/v3/users/4bc547397de541a0a9ab8272dc67fc28` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:48.424724 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831c43ae-a9c7-48fe-a56a-9fb2498d6fbc admin admin] RBAC: Authorizing `identity:delete_user(user_id=4bc547397de541a0a9ab8272dc67fc28)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:48.426912 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831c43ae-a9c7-48fe-a56a-9fb2498d6fbc admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:48.428552 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:46:48.433807 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d61634-fe67-4d0b-9f46-c78a92903f14 admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:48.437318 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-54d61634-fe67-4d0b-9f46-c78a92903f14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:48.472590 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d61634-fe67-4d0b-9f46-c78a92903f14 admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:48.489183 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e8e831-aafe-46fa-974d-ea097796037b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:48.489903 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e8e831-aafe-46fa-974d-ea097796037b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:48.490258 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e8e831-aafe-46fa-974d-ea097796037b admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:48.490603 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e8e831-aafe-46fa-974d-ea097796037b admin admin] PATH_INFO: `/v3/projects/0f693135afb84d56846c2c91a6860c1a` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:48.493266 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e8e831-aafe-46fa-974d-ea097796037b admin admin] RBAC: Authorizing `identity:delete_project(project_id=0f693135afb84d56846c2c91a6860c1a)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:48.505936 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e8e831-aafe-46fa-974d-ea097796037b admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:48.566080 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-831c43ae-a9c7-48fe-a56a-9fb2498d6fbc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4bc547397de541a0a9ab8272dc67fc28'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:48.574665 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-831c43ae-a9c7-48fe-a56a-9fb2498d6fbc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4bc547397de541a0a9ab8272dc67fc28'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:48.590337 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-831c43ae-a9c7-48fe-a56a-9fb2498d6fbc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4bc547397de541a0a9ab8272dc67fc28'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:48.604899 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-d7e8e831-aafe-46fa-974d-ea097796037b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f693135afb84d56846c2c91a6860c1a', 'request_id': 'req-d7e8e831-aafe-46fa-974d-ea097796037b'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:48.611458 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-831c43ae-a9c7-48fe-a56a-9fb2498d6fbc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4bc547397de541a0a9ab8272dc67fc28'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:48.612176 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-831c43ae-a9c7-48fe-a56a-9fb2498d6fbc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4bc547397de541a0a9ab8272dc67fc28'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:48.619349 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1028/2060] 10.222.0.26 () {58 vars in 1224 bytes} [Wed Aug 24 05:46:48 2022] DELETE /identity/v3/users/4bc547397de541a0a9ab8272dc67fc28 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:46:48.620433 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-d7e8e831-aafe-46fa-974d-ea097796037b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f693135afb84d56846c2c91a6860c1a', 'request_id': 'req-d7e8e831-aafe-46fa-974d-ea097796037b'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:48.628705 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-d7e8e831-aafe-46fa-974d-ea097796037b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f693135afb84d56846c2c91a6860c1a', 'request_id': 'req-d7e8e831-aafe-46fa-974d-ea097796037b'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:48.642095 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-d7e8e831-aafe-46fa-974d-ea097796037b admin admin] The token cache is being invalidate because project 0f693135afb84d56846c2c91a6860c1a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:46:48.642505 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-d7e8e831-aafe-46fa-974d-ea097796037b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:48.643331 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-d7e8e831-aafe-46fa-974d-ea097796037b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:48.645343 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1033/2061] 10.222.0.26 () {58 vars in 1233 bytes} [Wed Aug 24 05:46:48 2022] DELETE /identity/v3/projects/0f693135afb84d56846c2c91a6860c1a => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:46:48.650188 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0395d820-868f-4cac-bd0b-f03769d02415 None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:48.650382 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0395d820-868f-4cac-bd0b-f03769d02415 None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:48.650601 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0395d820-868f-4cac-bd0b-f03769d02415 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:48.688407 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-0395d820-868f-4cac-bd0b-f03769d02415 None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:46:48.689694 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-0395d820-868f-4cac-bd0b-f03769d02415 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:48.846200 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1029/2062] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:46:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:46:48.853812 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98c5f2c-1752-4cd1-916d-9b5d90c26b8d None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:48.854125 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98c5f2c-1752-4cd1-916d-9b5d90c26b8d None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:48.854498 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98c5f2c-1752-4cd1-916d-9b5d90c26b8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:48.896105 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-e98c5f2c-1752-4cd1-916d-9b5d90c26b8d None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:46:48.897472 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-e98c5f2c-1752-4cd1-916d-9b5d90c26b8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:48.914771 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1034/2063] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:46:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:46:48.920406 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0395d820-868f-4cac-bd0b-f03769d02415 None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:48.934889 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0395d820-868f-4cac-bd0b-f03769d02415 None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:48.948828 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96804e8-1ab0-444d-bd8a-c6ff28bc1548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:48.949843 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96804e8-1ab0-444d-bd8a-c6ff28bc1548 admin admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:48.950858 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96804e8-1ab0-444d-bd8a-c6ff28bc1548 admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:48.951207 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96804e8-1ab0-444d-bd8a-c6ff28bc1548 admin admin] PATH_INFO: `/v3/domains` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:48.951957 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96804e8-1ab0-444d-bd8a-c6ff28bc1548 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:46:48.952266 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96804e8-1ab0-444d-bd8a-c6ff28bc1548 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:48.957556 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96804e8-1ab0-444d-bd8a-c6ff28bc1548 admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:48.991416 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1030/2064] 10.222.0.26 () {58 vars in 1153 bytes} [Wed Aug 24 05:46:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:46:48.992771 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98c5f2c-1752-4cd1-916d-9b5d90c26b8d None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:49.009243 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98c5f2c-1752-4cd1-916d-9b5d90c26b8d None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:49.025886 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6147289-4d61-43e3-b875-22d992a4915f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:49.026566 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6147289-4d61-43e3-b875-22d992a4915f admin admin] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:49.027024 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6147289-4d61-43e3-b875-22d992a4915f admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:49.027306 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6147289-4d61-43e3-b875-22d992a4915f admin admin] PATH_INFO: `/v3/projects` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:49.028072 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6147289-4d61-43e3-b875-22d992a4915f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:49.032561 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6147289-4d61-43e3-b875-22d992a4915f admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:49.091703 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1035/2065] 10.222.0.26 () {60 vars in 1153 bytes} [Wed Aug 24 05:46:48 2022] POST /identity/v3/projects => generated 381 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 05:46:49.097086 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96804e8-1ab0-444d-bd8a-c6ff28bc1548 admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:49.111144 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96804e8-1ab0-444d-bd8a-c6ff28bc1548 admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:49.189350 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6147289-4d61-43e3-b875-22d992a4915f admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:49.191337 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-c6147289-4d61-43e3-b875-22d992a4915f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:49.218693 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44dfcfd-be98-47ae-8883-da28ca836b6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:49.220001 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44dfcfd-be98-47ae-8883-da28ca836b6d admin admin] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:49.220553 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44dfcfd-be98-47ae-8883-da28ca836b6d admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:49.221074 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44dfcfd-be98-47ae-8883-da28ca836b6d admin admin] PATH_INFO: `/v3/users` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:49.221875 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44dfcfd-be98-47ae-8883-da28ca836b6d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:49.224708 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44dfcfd-be98-47ae-8883-da28ca836b6d admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:49.239643 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:46:49.267834 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1031/2066] 10.222.0.26 () {60 vars in 1144 bytes} [Wed Aug 24 05:46:49 2022] POST /identity/v3/users => generated 291 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:46:49.269171 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44dfcfd-be98-47ae-8883-da28ca836b6d admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:49.276127 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6147289-4d61-43e3-b875-22d992a4915f admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:49.283108 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f891d5dd-6cd3-4b7e-9e37-871986129c75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:49.284026 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f891d5dd-6cd3-4b7e-9e37-871986129c75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:49.284315 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f891d5dd-6cd3-4b7e-9e37-871986129c75 admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:49.284639 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f891d5dd-6cd3-4b7e-9e37-871986129c75 admin admin] PATH_INFO: `/v3/projects/a7efca8b40bd41aea934ea0b27ba9335` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:49.286019 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f891d5dd-6cd3-4b7e-9e37-871986129c75 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a7efca8b40bd41aea934ea0b27ba9335)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:49.287408 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44dfcfd-be98-47ae-8883-da28ca836b6d admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:49.288499 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f891d5dd-6cd3-4b7e-9e37-871986129c75 admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:49.296619 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecd6cfc-780e-4b8e-a642-450830ed8aea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:49.301054 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecd6cfc-780e-4b8e-a642-450830ed8aea admin admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:49.301054 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecd6cfc-780e-4b8e-a642-450830ed8aea admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:49.301054 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecd6cfc-780e-4b8e-a642-450830ed8aea admin admin] PATH_INFO: `/v3/roles` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:49.301054 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecd6cfc-780e-4b8e-a642-450830ed8aea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:49.306607 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecd6cfc-780e-4b8e-a642-450830ed8aea admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:49.315446 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:46:49.325986 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1032/2067] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Aug 24 05:46:49 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:46:49.330140 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecd6cfc-780e-4b8e-a642-450830ed8aea admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:49.348120 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecd6cfc-780e-4b8e-a642-450830ed8aea admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:49.361906 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-f891d5dd-6cd3-4b7e-9e37-871986129c75 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a7efca8b40bd41aea934ea0b27ba9335', 'request_id': 'req-f891d5dd-6cd3-4b7e-9e37-871986129c75'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:49.375522 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-f891d5dd-6cd3-4b7e-9e37-871986129c75 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a7efca8b40bd41aea934ea0b27ba9335', 'request_id': 'req-f891d5dd-6cd3-4b7e-9e37-871986129c75'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:49.383663 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-f891d5dd-6cd3-4b7e-9e37-871986129c75 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a7efca8b40bd41aea934ea0b27ba9335', 'request_id': 'req-f891d5dd-6cd3-4b7e-9e37-871986129c75'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:49.399090 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-f891d5dd-6cd3-4b7e-9e37-871986129c75 admin admin] The token cache is being invalidate because project a7efca8b40bd41aea934ea0b27ba9335 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:46:49.399392 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-f891d5dd-6cd3-4b7e-9e37-871986129c75 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:49.400385 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-f891d5dd-6cd3-4b7e-9e37-871986129c75 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:49.402086 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1036/2068] 10.222.0.26 () {58 vars in 1233 bytes} [Wed Aug 24 05:46:49 2022] DELETE /identity/v3/projects/a7efca8b40bd41aea934ea0b27ba9335 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 05:46:49.402951 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f891d5dd-6cd3-4b7e-9e37-871986129c75 admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:49.404376 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-f891d5dd-6cd3-4b7e-9e37-871986129c75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:49.460004 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db2557b-0ef4-413f-80c5-a217240ee2c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:49.460738 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db2557b-0ef4-413f-80c5-a217240ee2c4 admin admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:49.461110 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db2557b-0ef4-413f-80c5-a217240ee2c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:49.461574 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db2557b-0ef4-413f-80c5-a217240ee2c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:49.462331 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db2557b-0ef4-413f-80c5-a217240ee2c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:49.464134 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db2557b-0ef4-413f-80c5-a217240ee2c4 admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:49.479466 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1033/2069] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Aug 24 05:46:49 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:46:49.479466 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cd4070-7953-426e-8552-3eb61f9de3bd None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:49.479466 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cd4070-7953-426e-8552-3eb61f9de3bd None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:49.479466 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cd4070-7953-426e-8552-3eb61f9de3bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:49.503106 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-b0cd4070-7953-426e-8552-3eb61f9de3bd None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:46:49.504339 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-b0cd4070-7953-426e-8552-3eb61f9de3bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:49.514887 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1034/2070] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:46:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:46:49.515856 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cd4070-7953-426e-8552-3eb61f9de3bd None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:49.517453 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-b0cd4070-7953-426e-8552-3eb61f9de3bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:49.528441 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f891d5dd-6cd3-4b7e-9e37-871986129c75 admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:49.531701 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cd4070-7953-426e-8552-3eb61f9de3bd None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:49.538032 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8679acc5-290f-47a9-86e4-d45550a06395 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:49.538032 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8679acc5-290f-47a9-86e4-d45550a06395 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:49.538032 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8679acc5-290f-47a9-86e4-d45550a06395 admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:49.538032 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8679acc5-290f-47a9-86e4-d45550a06395 admin admin] PATH_INFO: `/v3/users/5e3b1a1e2be241f19aaeb49c41ba4101` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:49.538443 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8679acc5-290f-47a9-86e4-d45550a06395 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e3b1a1e2be241f19aaeb49c41ba4101)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:49.538443 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8679acc5-290f-47a9-86e4-d45550a06395 admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:49.542957 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dcc63e-d887-4816-9f9c-d0939788fa31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:49.546049 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dcc63e-d887-4816-9f9c-d0939788fa31 admin admin] REQUEST_METHOD: `PUT` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:49.546574 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dcc63e-d887-4816-9f9c-d0939788fa31 admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:49.547277 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dcc63e-d887-4816-9f9c-d0939788fa31 admin admin] PATH_INFO: `/v3/projects/655689cda36947f0a6c769eb2d053127/users/eee266692f834303adfe97207302bb79/roles/f7aa4a2c74c94c1b9ca8ecdcccccda5c` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:49.574679 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dcc63e-d887-4816-9f9c-d0939788fa31 admin admin] RBAC: Authorizing `identity:create_grant(project_id=655689cda36947f0a6c769eb2d053127, user_id=eee266692f834303adfe97207302bb79, role_id=f7aa4a2c74c94c1b9ca8ecdcccccda5c)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:49.577459 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dcc63e-d887-4816-9f9c-d0939788fa31 admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:49.594653 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1035/2071] 10.222.0.26 () {60 vars in 1483 bytes} [Wed Aug 24 05:46:49 2022] PUT /identity/v3/projects/655689cda36947f0a6c769eb2d053127/users/eee266692f834303adfe97207302bb79/roles/f7aa4a2c74c94c1b9ca8ecdcccccda5c => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:46:49.596681 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4256b9-8697-465b-b3d2-1fe4ceb82ba8 None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:49.597296 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4256b9-8697-465b-b3d2-1fe4ceb82ba8 None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:49.597723 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4256b9-8697-465b-b3d2-1fe4ceb82ba8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:49.619573 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-af4256b9-8697-465b-b3d2-1fe4ceb82ba8 None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:46:49.620873 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-af4256b9-8697-465b-b3d2-1fe4ceb82ba8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:49.624002 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-8679acc5-290f-47a9-86e4-d45550a06395 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e3b1a1e2be241f19aaeb49c41ba4101'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:49.634707 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-8679acc5-290f-47a9-86e4-d45550a06395 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e3b1a1e2be241f19aaeb49c41ba4101'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:49.635820 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-8679acc5-290f-47a9-86e4-d45550a06395 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e3b1a1e2be241f19aaeb49c41ba4101'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:49.657165 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-8679acc5-290f-47a9-86e4-d45550a06395 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e3b1a1e2be241f19aaeb49c41ba4101'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:49.668113 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-8679acc5-290f-47a9-86e4-d45550a06395 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e3b1a1e2be241f19aaeb49c41ba4101'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:49.683959 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1037/2072] 10.222.0.26 () {58 vars in 1224 bytes} [Wed Aug 24 05:46:49 2022] DELETE /identity/v3/users/5e3b1a1e2be241f19aaeb49c41ba4101 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:46:49.683959 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2268dc24-461b-4804-bce9-571007d67664 None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:49.683959 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2268dc24-461b-4804-bce9-571007d67664 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:49.684863 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2268dc24-461b-4804-bce9-571007d67664 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:49.722900 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-2268dc24-461b-4804-bce9-571007d67664 None None] MFA Rules not processed for user `eee266692f834303adfe97207302bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:46:49.723656 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1036/2073] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:46:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:46:49.724799 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-2268dc24-461b-4804-bce9-571007d67664 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:49.725263 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2080c6d4-15f8-48df-8d6b-5223fbca11f4 None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:49.726979 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2080c6d4-15f8-48df-8d6b-5223fbca11f4 None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:49.728081 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2080c6d4-15f8-48df-8d6b-5223fbca11f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:49.746088 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:46:49.761347 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-2080c6d4-15f8-48df-8d6b-5223fbca11f4 None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:46:49.762636 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-2080c6d4-15f8-48df-8d6b-5223fbca11f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:49.816280 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:46:49.827683 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1038/2074] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:46:49 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:46:49.828482 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2268dc24-461b-4804-bce9-571007d67664 None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:49.844887 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1037/2075] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:46:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:46:49.844887 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2080c6d4-15f8-48df-8d6b-5223fbca11f4 None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:49.855869 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-2080c6d4-15f8-48df-8d6b-5223fbca11f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:49.872686 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2080c6d4-15f8-48df-8d6b-5223fbca11f4 None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:49.884069 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fe908a-8b85-4364-915d-db1ca194d4f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:49.884714 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fe908a-8b85-4364-915d-db1ca194d4f2 admin admin] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:49.884993 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fe908a-8b85-4364-915d-db1ca194d4f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:49.885264 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fe908a-8b85-4364-915d-db1ca194d4f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:49.885897 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fe908a-8b85-4364-915d-db1ca194d4f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:49.887967 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fe908a-8b85-4364-915d-db1ca194d4f2 admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:49.925548 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1038/2076] 10.222.0.26 () {60 vars in 1153 bytes} [Wed Aug 24 05:46:49 2022] POST /identity/v3/projects => generated 383 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:46:49.926320 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fe908a-8b85-4364-915d-db1ca194d4f2 admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:49.928025 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-f5fe908a-8b85-4364-915d-db1ca194d4f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:49.929604 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2268dc24-461b-4804-bce9-571007d67664 None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:49.997601 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a31492-1928-4ab6-80a7-8f90387aa193 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:49.998269 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a31492-1928-4ab6-80a7-8f90387aa193 admin admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:49.998567 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a31492-1928-4ab6-80a7-8f90387aa193 admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:49.998822 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a31492-1928-4ab6-80a7-8f90387aa193 admin admin] PATH_INFO: `/v3/domains` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:49.999491 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a31492-1928-4ab6-80a7-8f90387aa193 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:46:49.999796 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a31492-1928-4ab6-80a7-8f90387aa193 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:50.001672 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a31492-1928-4ab6-80a7-8f90387aa193 admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:50.006325 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fe908a-8b85-4364-915d-db1ca194d4f2 admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:50.010790 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fc5992-48be-44b8-affd-43d0557055d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '874348b647194ac2b5ecbf12c33bf59e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:50.011420 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fc5992-48be-44b8-affd-43d0557055d7 service neutron] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:50.011701 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fc5992-48be-44b8-affd-43d0557055d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:50.011974 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fc5992-48be-44b8-affd-43d0557055d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:50.017503 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1039/2077] 10.222.0.26 () {58 vars in 1153 bytes} [Wed Aug 24 05:46:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:46:50.018604 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a31492-1928-4ab6-80a7-8f90387aa193 admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:50.028993 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fc5992-48be-44b8-affd-43d0557055d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:50.030566 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fc5992-48be-44b8-affd-43d0557055d7 service neutron] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:50.030794 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a31492-1928-4ab6-80a7-8f90387aa193 admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:50.036093 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558b4bd9-5bec-41a5-b6a3-835206cfd6d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:50.036598 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558b4bd9-5bec-41a5-b6a3-835206cfd6d8 admin admin] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:50.036880 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558b4bd9-5bec-41a5-b6a3-835206cfd6d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:50.037166 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558b4bd9-5bec-41a5-b6a3-835206cfd6d8 admin admin] PATH_INFO: `/v3/users` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:50.037790 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558b4bd9-5bec-41a5-b6a3-835206cfd6d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:50.040262 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558b4bd9-5bec-41a5-b6a3-835206cfd6d8 admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:50.045028 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1039/2078] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 24 05:46:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:46:50.045028 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fc5992-48be-44b8-affd-43d0557055d7 service neutron] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:50.055776 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fc5992-48be-44b8-affd-43d0557055d7 service neutron] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:50.064060 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d7694b-1fd1-426d-aade-dd63d146285e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:50.064760 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d7694b-1fd1-426d-aade-dd63d146285e admin admin] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:50.065173 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d7694b-1fd1-426d-aade-dd63d146285e admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:50.065513 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d7694b-1fd1-426d-aade-dd63d146285e admin admin] PATH_INFO: `/v3/projects` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:50.066311 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d7694b-1fd1-426d-aade-dd63d146285e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:50.069038 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d7694b-1fd1-426d-aade-dd63d146285e admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:50.072008 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1040/2079] 10.222.0.26 () {60 vars in 1144 bytes} [Wed Aug 24 05:46:50 2022] POST /identity/v3/users => generated 298 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:46:50.087229 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558b4bd9-5bec-41a5-b6a3-835206cfd6d8 admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:50.119824 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1040/2080] 10.222.0.26 () {60 vars in 1153 bytes} [Wed Aug 24 05:46:50 2022] POST /identity/v3/projects => generated 379 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:46:50.123838 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d7694b-1fd1-426d-aade-dd63d146285e admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:50.124391 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558b4bd9-5bec-41a5-b6a3-835206cfd6d8 admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:50.228771 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:46:50.257818 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d7694b-1fd1-426d-aade-dd63d146285e admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:50.264340 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06152376-f906-4d0f-9658-62b88ab648ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:50.265096 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06152376-f906-4d0f-9658-62b88ab648ae admin admin] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:50.265478 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06152376-f906-4d0f-9658-62b88ab648ae admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:50.265866 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06152376-f906-4d0f-9658-62b88ab648ae admin admin] PATH_INFO: `/v3/users` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:50.267118 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06152376-f906-4d0f-9658-62b88ab648ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:50.269704 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06152376-f906-4d0f-9658-62b88ab648ae admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:50.296191 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691b25f9-cd22-48a3-8ab0-c1260c63d288 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:50.297464 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691b25f9-cd22-48a3-8ab0-c1260c63d288 admin admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:50.297758 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691b25f9-cd22-48a3-8ab0-c1260c63d288 admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:50.298965 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691b25f9-cd22-48a3-8ab0-c1260c63d288 admin admin] PATH_INFO: `/v3/roles` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:50.299768 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691b25f9-cd22-48a3-8ab0-c1260c63d288 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:50.306690 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1041/2081] 10.222.0.26 () {60 vars in 1144 bytes} [Wed Aug 24 05:46:50 2022] POST /identity/v3/users => generated 290 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 05:46:50.307685 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06152376-f906-4d0f-9658-62b88ab648ae admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:50.308090 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691b25f9-cd22-48a3-8ab0-c1260c63d288 admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:50.339514 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1041/2082] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Aug 24 05:46:50 2022] GET /identity/v3/roles => generated 1420 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:46:50.343586 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06152376-f906-4d0f-9658-62b88ab648ae admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:50.361324 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8cc8bc-05de-4aac-89d5-06adf71261fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:50.362473 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691b25f9-cd22-48a3-8ab0-c1260c63d288 admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:50.363601 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8cc8bc-05de-4aac-89d5-06adf71261fd admin admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:50.363888 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8cc8bc-05de-4aac-89d5-06adf71261fd admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:50.365724 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8cc8bc-05de-4aac-89d5-06adf71261fd admin admin] PATH_INFO: `/v3/roles` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:50.367748 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8cc8bc-05de-4aac-89d5-06adf71261fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:50.372576 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8cc8bc-05de-4aac-89d5-06adf71261fd admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:50.394800 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691b25f9-cd22-48a3-8ab0-c1260c63d288 admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:50.413178 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1042/2083] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Aug 24 05:46:50 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:46:50.414639 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8cc8bc-05de-4aac-89d5-06adf71261fd admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:50.418868 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b42660-a07e-4997-a131-d115fa752920 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:50.419870 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b42660-a07e-4997-a131-d115fa752920 admin admin] REQUEST_METHOD: `PUT` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:50.420378 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b42660-a07e-4997-a131-d115fa752920 admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:50.421836 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b42660-a07e-4997-a131-d115fa752920 admin admin] PATH_INFO: `/v3/projects/e3708973e87448bebb2c7f6d47512478/users/a1dd0f6c57fb4a4e9142188f83c1c640/roles/640bda0879494e60b72680ee505285f0` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:50.426545 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8cc8bc-05de-4aac-89d5-06adf71261fd admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:50.443853 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8996838a-62e9-47b0-bf23-5d8fc07efd7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:50.445626 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8996838a-62e9-47b0-bf23-5d8fc07efd7d admin admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:50.445986 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8996838a-62e9-47b0-bf23-5d8fc07efd7d admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:50.446275 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8996838a-62e9-47b0-bf23-5d8fc07efd7d admin admin] PATH_INFO: `/v3/roles` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:50.447413 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8996838a-62e9-47b0-bf23-5d8fc07efd7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:50.454124 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8996838a-62e9-47b0-bf23-5d8fc07efd7d admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:50.474243 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b42660-a07e-4997-a131-d115fa752920 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3708973e87448bebb2c7f6d47512478, user_id=a1dd0f6c57fb4a4e9142188f83c1c640, role_id=640bda0879494e60b72680ee505285f0)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:50.477223 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1043/2084] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Aug 24 05:46:50 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:46:50.481768 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b42660-a07e-4997-a131-d115fa752920 admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:50.482647 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8996838a-62e9-47b0-bf23-5d8fc07efd7d admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:50.502835 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8996838a-62e9-47b0-bf23-5d8fc07efd7d admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:50.511171 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf547301-b030-4bc9-a151-9871f6f83a2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:50.512246 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf547301-b030-4bc9-a151-9871f6f83a2c admin admin] REQUEST_METHOD: `PUT` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:50.513231 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf547301-b030-4bc9-a151-9871f6f83a2c admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:50.513517 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf547301-b030-4bc9-a151-9871f6f83a2c admin admin] PATH_INFO: `/v3/projects/29411794870d4ec6b31ee7fb4ec707de/users/94b2007139a14dbc81aebf93382e2818/roles/f7aa4a2c74c94c1b9ca8ecdcccccda5c` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:50.529724 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1042/2085] 10.222.0.26 () {60 vars in 1483 bytes} [Wed Aug 24 05:46:50 2022] PUT /identity/v3/projects/e3708973e87448bebb2c7f6d47512478/users/a1dd0f6c57fb4a4e9142188f83c1c640/roles/640bda0879494e60b72680ee505285f0 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:46:50.530961 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b42660-a07e-4997-a131-d115fa752920 admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:50.558224 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf547301-b030-4bc9-a151-9871f6f83a2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=29411794870d4ec6b31ee7fb4ec707de, user_id=94b2007139a14dbc81aebf93382e2818, role_id=f7aa4a2c74c94c1b9ca8ecdcccccda5c)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:50.562777 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf547301-b030-4bc9-a151-9871f6f83a2c admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:50.568448 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:46:50.592907 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1044/2086] 10.222.0.26 () {60 vars in 1483 bytes} [Wed Aug 24 05:46:50 2022] PUT /identity/v3/projects/29411794870d4ec6b31ee7fb4ec707de/users/94b2007139a14dbc81aebf93382e2818/roles/f7aa4a2c74c94c1b9ca8ecdcccccda5c => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:46:50.603189 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2d0791-e073-4c1b-a61f-5a94f1c865b1 None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:50.603684 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2d0791-e073-4c1b-a61f-5a94f1c865b1 None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:50.604108 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2d0791-e073-4c1b-a61f-5a94f1c865b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:50.633402 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b42660-a07e-4997-a131-d115fa752920 admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:50.648577 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-4f2d0791-e073-4c1b-a61f-5a94f1c865b1 None None] MFA Rules not processed for user `94b2007139a14dbc81aebf93382e2818`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:46:50.650335 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-4f2d0791-e073-4c1b-a61f-5a94f1c865b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:50.739912 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c385e0-ada8-422f-8b9e-b7cc67ec5fb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:50.740560 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c385e0-ada8-422f-8b9e-b7cc67ec5fb1 admin admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:50.740798 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c385e0-ada8-422f-8b9e-b7cc67ec5fb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:50.741686 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c385e0-ada8-422f-8b9e-b7cc67ec5fb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:50.742274 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c385e0-ada8-422f-8b9e-b7cc67ec5fb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:50.744373 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c385e0-ada8-422f-8b9e-b7cc67ec5fb1 admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:50.759391 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1043/2087] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Aug 24 05:46:50 2022] GET /identity/v3/roles => generated 1420 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:46:50.760469 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c385e0-ada8-422f-8b9e-b7cc67ec5fb1 admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:50.763070 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-18c385e0-ada8-422f-8b9e-b7cc67ec5fb1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:50.776672 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c385e0-ada8-422f-8b9e-b7cc67ec5fb1 admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:50.783269 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f3b379-6f14-435c-b390-0259b3ca3cc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:50.783909 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f3b379-6f14-435c-b390-0259b3ca3cc6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:50.784254 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f3b379-6f14-435c-b390-0259b3ca3cc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:50.784597 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f3b379-6f14-435c-b390-0259b3ca3cc6 admin admin] PATH_INFO: `/v3/projects/a99654d3ac1249b29779dbf35ae524f8` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:50.785811 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f3b379-6f14-435c-b390-0259b3ca3cc6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a99654d3ac1249b29779dbf35ae524f8)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:50.788104 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f3b379-6f14-435c-b390-0259b3ca3cc6 admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:50.852369 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:46:50.854064 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-e6f3b379-6f14-435c-b390-0259b3ca3cc6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a99654d3ac1249b29779dbf35ae524f8', 'request_id': 'req-e6f3b379-6f14-435c-b390-0259b3ca3cc6'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:50.869179 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-e6f3b379-6f14-435c-b390-0259b3ca3cc6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a99654d3ac1249b29779dbf35ae524f8', 'request_id': 'req-e6f3b379-6f14-435c-b390-0259b3ca3cc6'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:50.875047 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1045/2088] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:46:50 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:46:50.879204 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2d0791-e073-4c1b-a61f-5a94f1c865b1 None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:50.886729 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-e6f3b379-6f14-435c-b390-0259b3ca3cc6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a99654d3ac1249b29779dbf35ae524f8', 'request_id': 'req-e6f3b379-6f14-435c-b390-0259b3ca3cc6'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:50.898924 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2d0791-e073-4c1b-a61f-5a94f1c865b1 None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:50.915190 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-e6f3b379-6f14-435c-b390-0259b3ca3cc6 admin admin] The token cache is being invalidate because project a99654d3ac1249b29779dbf35ae524f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:46:50.916184 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-e6f3b379-6f14-435c-b390-0259b3ca3cc6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:50.917737 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-e6f3b379-6f14-435c-b390-0259b3ca3cc6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:50.921649 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1044/2089] 10.222.0.26 () {58 vars in 1233 bytes} [Wed Aug 24 05:46:50 2022] DELETE /identity/v3/projects/a99654d3ac1249b29779dbf35ae524f8 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:46:50.924256 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f3b379-6f14-435c-b390-0259b3ca3cc6 admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:50.927711 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-e6f3b379-6f14-435c-b390-0259b3ca3cc6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:51.048004 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6699034-6614-41f6-9c08-9ba0a00571c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:51.049780 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6699034-6614-41f6-9c08-9ba0a00571c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:51.049997 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6699034-6614-41f6-9c08-9ba0a00571c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:51.050275 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6699034-6614-41f6-9c08-9ba0a00571c3 admin admin] PATH_INFO: `/v3/projects/e3708973e87448bebb2c7f6d47512478/users/a1dd0f6c57fb4a4e9142188f83c1c640/roles/640bda0879494e60b72680ee505285f0` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:51.062368 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6699034-6614-41f6-9c08-9ba0a00571c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3708973e87448bebb2c7f6d47512478, user_id=a1dd0f6c57fb4a4e9142188f83c1c640, role_id=640bda0879494e60b72680ee505285f0)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:51.062368 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6699034-6614-41f6-9c08-9ba0a00571c3 admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:51.101082 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f3b379-6f14-435c-b390-0259b3ca3cc6 admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:51.106968 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1046/2090] 10.222.0.26 () {60 vars in 1483 bytes} [Wed Aug 24 05:46:50 2022] PUT /identity/v3/projects/e3708973e87448bebb2c7f6d47512478/users/a1dd0f6c57fb4a4e9142188f83c1c640/roles/640bda0879494e60b72680ee505285f0 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:46:51.108221 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6699034-6614-41f6-9c08-9ba0a00571c3 admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:51.119786 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-d6699034-6614-41f6-9c08-9ba0a00571c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:51.169328 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f40c529-b349-4184-a4ed-44b237c915d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:51.170058 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f40c529-b349-4184-a4ed-44b237c915d3 admin admin] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:51.170255 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f40c529-b349-4184-a4ed-44b237c915d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:51.170529 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f40c529-b349-4184-a4ed-44b237c915d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:51.171161 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f40c529-b349-4184-a4ed-44b237c915d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:51.173087 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f40c529-b349-4184-a4ed-44b237c915d3 admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:51.206455 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6699034-6614-41f6-9c08-9ba0a00571c3 admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:51.214589 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfc175b-4f5e-442f-b4fc-cfad4780d185 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:51.216206 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfc175b-4f5e-442f-b4fc-cfad4780d185 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:51.216959 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfc175b-4f5e-442f-b4fc-cfad4780d185 admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:51.217443 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfc175b-4f5e-442f-b4fc-cfad4780d185 admin admin] PATH_INFO: `/v3/users/6ebb820123a94d41ac0bcb75df20dfc6` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:51.218983 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfc175b-4f5e-442f-b4fc-cfad4780d185 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ebb820123a94d41ac0bcb75df20dfc6)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:51.221606 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfc175b-4f5e-442f-b4fc-cfad4780d185 admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:51.223525 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1045/2091] 10.222.0.26 () {60 vars in 1153 bytes} [Wed Aug 24 05:46:50 2022] POST /identity/v3/projects => generated 379 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:46:51.224943 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c1022c-9cd8-495f-ab86-a9d9120e5501 None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:51.225237 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c1022c-9cd8-495f-ab86-a9d9120e5501 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:51.228200 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c1022c-9cd8-495f-ab86-a9d9120e5501 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:51.289184 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-b8c1022c-9cd8-495f-ab86-a9d9120e5501 None None] MFA Rules not processed for user `a1dd0f6c57fb4a4e9142188f83c1c640`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:46:51.290452 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-b8c1022c-9cd8-495f-ab86-a9d9120e5501 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:51.292320 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:INSERT=2,keystone:SELECT=96,keystone:DELETE=2 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:46:51.360217 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-1dfc175b-4f5e-442f-b4fc-cfad4780d185 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ebb820123a94d41ac0bcb75df20dfc6'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:51.376755 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-1dfc175b-4f5e-442f-b4fc-cfad4780d185 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ebb820123a94d41ac0bcb75df20dfc6'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:51.400782 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-1dfc175b-4f5e-442f-b4fc-cfad4780d185 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ebb820123a94d41ac0bcb75df20dfc6'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:51.415559 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-1dfc175b-4f5e-442f-b4fc-cfad4780d185 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ebb820123a94d41ac0bcb75df20dfc6'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:51.416323 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-1dfc175b-4f5e-442f-b4fc-cfad4780d185 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ebb820123a94d41ac0bcb75df20dfc6'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:51.429901 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1047/2092] 10.222.0.26 () {58 vars in 1224 bytes} [Wed Aug 24 05:46:51 2022] DELETE /identity/v3/users/6ebb820123a94d41ac0bcb75df20dfc6 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:46:51.429901 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfc175b-4f5e-442f-b4fc-cfad4780d185 admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:51.431285 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-1dfc175b-4f5e-442f-b4fc-cfad4780d185 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:51.462872 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:46:51.491978 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1046/2093] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:46:51 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:46:51.597261 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c1022c-9cd8-495f-ab86-a9d9120e5501 None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:51.599323 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-b8c1022c-9cd8-495f-ab86-a9d9120e5501 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:51.606568 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfc175b-4f5e-442f-b4fc-cfad4780d185 admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:51.620277 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dea897-297f-4e61-87b7-6baa929a8bd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:51.621184 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dea897-297f-4e61-87b7-6baa929a8bd1 admin admin] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:51.622499 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dea897-297f-4e61-87b7-6baa929a8bd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:51.623303 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dea897-297f-4e61-87b7-6baa929a8bd1 admin admin] PATH_INFO: `/v3/users` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:51.625152 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0dea897-297f-4e61-87b7-6baa929a8bd1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:51.629719 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0dea897-297f-4e61-87b7-6baa929a8bd1 admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:51.690659 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1048/2094] 10.222.0.26 () {60 vars in 1144 bytes} [Wed Aug 24 05:46:51 2022] POST /identity/v3/users => generated 296 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:46:51.700997 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dea897-297f-4e61-87b7-6baa929a8bd1 admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:51.723440 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dea897-297f-4e61-87b7-6baa929a8bd1 admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:51.739064 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4655ca9-b78b-428a-9554-f5ce10ab9ea9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:51.739705 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4655ca9-b78b-428a-9554-f5ce10ab9ea9 admin admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:51.741551 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4655ca9-b78b-428a-9554-f5ce10ab9ea9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:51.741850 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4655ca9-b78b-428a-9554-f5ce10ab9ea9 admin admin] PATH_INFO: `/v3/roles` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:51.742719 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4655ca9-b78b-428a-9554-f5ce10ab9ea9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:51.744425 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4655ca9-b78b-428a-9554-f5ce10ab9ea9 admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:51.756105 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c1022c-9cd8-495f-ab86-a9d9120e5501 None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:51.768034 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1049/2095] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Aug 24 05:46:51 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:46:51.769281 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4655ca9-b78b-428a-9554-f5ce10ab9ea9 admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:51.796550 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4655ca9-b78b-428a-9554-f5ce10ab9ea9 admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:51.815283 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f80bfc-6807-4273-ae57-4303e7a904f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:51.815991 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f80bfc-6807-4273-ae57-4303e7a904f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:51.816276 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f80bfc-6807-4273-ae57-4303e7a904f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:51.816548 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f80bfc-6807-4273-ae57-4303e7a904f2 admin admin] PATH_INFO: `/v3/projects/1d724bc895a94267b0b9046bc82d7892/users/832c626515394400a80e451024d7e96a/roles/640bda0879494e60b72680ee505285f0` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:51.839870 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c019f924-a74d-4fea-8d3a-76b42e457fee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17b450afe795495680fc70f522c83750', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:51.842465 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c019f924-a74d-4fea-8d3a-76b42e457fee service cinder] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:51.843552 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c019f924-a74d-4fea-8d3a-76b42e457fee service cinder] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:51.844385 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c019f924-a74d-4fea-8d3a-76b42e457fee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:51.846962 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f80bfc-6807-4273-ae57-4303e7a904f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d724bc895a94267b0b9046bc82d7892, user_id=832c626515394400a80e451024d7e96a, role_id=640bda0879494e60b72680ee505285f0)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:51.850501 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f80bfc-6807-4273-ae57-4303e7a904f2 admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:51.885089 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1050/2096] 10.222.0.26 () {60 vars in 1483 bytes} [Wed Aug 24 05:46:51 2022] PUT /identity/v3/projects/1d724bc895a94267b0b9046bc82d7892/users/832c626515394400a80e451024d7e96a/roles/640bda0879494e60b72680ee505285f0 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:46:51.888152 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f80bfc-6807-4273-ae57-4303e7a904f2 admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:52.003564 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c019f924-a74d-4fea-8d3a-76b42e457fee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:52.007138 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c019f924-a74d-4fea-8d3a-76b42e457fee service cinder] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:52.038274 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1047/2097] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 24 05:46:51 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:46:52.109837 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:DELETE=8,keystone:SELECT=87,keystone:INSERT=5 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:46:52.170383 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f80bfc-6807-4273-ae57-4303e7a904f2 admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:52.183576 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb156f5-10ae-4df6-9976-01cc508a72f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:52.185045 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb156f5-10ae-4df6-9976-01cc508a72f9 admin admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:52.185481 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb156f5-10ae-4df6-9976-01cc508a72f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:52.185906 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb156f5-10ae-4df6-9976-01cc508a72f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:52.186796 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb156f5-10ae-4df6-9976-01cc508a72f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:52.188800 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb156f5-10ae-4df6-9976-01cc508a72f9 admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:52.215845 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c019f924-a74d-4fea-8d3a-76b42e457fee service cinder] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:52.223833 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1051/2098] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Aug 24 05:46:51 2022] GET /identity/v3/roles => generated 1420 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:46:52.236321 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c019f924-a74d-4fea-8d3a-76b42e457fee service cinder] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:52.249820 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff9f97d-5643-4346-8b60-46cddade2e32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:52.250889 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff9f97d-5643-4346-8b60-46cddade2e32 admin admin] REQUEST_METHOD: `PUT` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:52.251761 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff9f97d-5643-4346-8b60-46cddade2e32 admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:52.252361 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff9f97d-5643-4346-8b60-46cddade2e32 admin admin] PATH_INFO: `/v3/projects/1d724bc895a94267b0b9046bc82d7892/users/832c626515394400a80e451024d7e96a/roles/640bda0879494e60b72680ee505285f0` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:52.254646 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff9f97d-5643-4346-8b60-46cddade2e32 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d724bc895a94267b0b9046bc82d7892, user_id=832c626515394400a80e451024d7e96a, role_id=640bda0879494e60b72680ee505285f0)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:52.257729 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff9f97d-5643-4346-8b60-46cddade2e32 admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:52.273349 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1048/2099] 10.222.0.26 () {60 vars in 1483 bytes} [Wed Aug 24 05:46:52 2022] PUT /identity/v3/projects/1d724bc895a94267b0b9046bc82d7892/users/832c626515394400a80e451024d7e96a/roles/640bda0879494e60b72680ee505285f0 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:46:52.284591 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625073e8-31b0-42ec-a9ed-323305358cd0 None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:52.284918 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625073e8-31b0-42ec-a9ed-323305358cd0 None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:52.285150 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625073e8-31b0-42ec-a9ed-323305358cd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:52.327565 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-625073e8-31b0-42ec-a9ed-323305358cd0 None None] MFA Rules not processed for user `832c626515394400a80e451024d7e96a`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:46:52.329846 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-625073e8-31b0-42ec-a9ed-323305358cd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:52.334143 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff9f97d-5643-4346-8b60-46cddade2e32 admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:52.453225 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:46:52.466165 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff9f97d-5643-4346-8b60-46cddade2e32 admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:52.480015 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8f0aa4-1c37-4bf5-b38d-b0f5afa3d20a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17b450afe795495680fc70f522c83750', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:52.480707 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8f0aa4-1c37-4bf5-b38d-b0f5afa3d20a service cinder] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:52.481542 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8f0aa4-1c37-4bf5-b38d-b0f5afa3d20a service cinder] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:52.481814 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8f0aa4-1c37-4bf5-b38d-b0f5afa3d20a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:52.485412 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-9e8f0aa4-1c37-4bf5-b38d-b0f5afa3d20a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:52.498220 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1052/2100] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:46:52 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:46:52.514648 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625073e8-31b0-42ec-a9ed-323305358cd0 None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:52.517019 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-625073e8-31b0-42ec-a9ed-323305358cd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:52.549278 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625073e8-31b0-42ec-a9ed-323305358cd0 None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:52.568341 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d93a298-6578-4e13-9cbf-d86f7faeba64 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17b450afe795495680fc70f522c83750', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:52.568970 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d93a298-6578-4e13-9cbf-d86f7faeba64 service cinder] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:52.569249 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d93a298-6578-4e13-9cbf-d86f7faeba64 service cinder] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:52.569523 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d93a298-6578-4e13-9cbf-d86f7faeba64 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:52.586956 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d93a298-6578-4e13-9cbf-d86f7faeba64 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:52.588302 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d93a298-6578-4e13-9cbf-d86f7faeba64 service cinder] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:52.601679 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8f0aa4-1c37-4bf5-b38d-b0f5afa3d20a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:52.610706 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8f0aa4-1c37-4bf5-b38d-b0f5afa3d20a service cinder] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:52.634401 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1053/2101] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 24 05:46:52 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 05:46:52.639578 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1049/2102] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 24 05:46:52 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 05:46:52.739594 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d93a298-6578-4e13-9cbf-d86f7faeba64 service cinder] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:52.741682 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-8d93a298-6578-4e13-9cbf-d86f7faeba64 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:52.810376 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8f0aa4-1c37-4bf5-b38d-b0f5afa3d20a service cinder] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:52.828136 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8f0aa4-1c37-4bf5-b38d-b0f5afa3d20a service cinder] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:52.852388 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46e5bc8-a6f9-442c-94d6-6ed3cd3d301a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17b450afe795495680fc70f522c83750', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:52.856889 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46e5bc8-a6f9-442c-94d6-6ed3cd3d301a service cinder] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:52.859579 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46e5bc8-a6f9-442c-94d6-6ed3cd3d301a service cinder] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:52.861162 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46e5bc8-a6f9-442c-94d6-6ed3cd3d301a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:52.867608 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-c46e5bc8-a6f9-442c-94d6-6ed3cd3d301a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:52.917044 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d93a298-6578-4e13-9cbf-d86f7faeba64 service cinder] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:52.932472 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abcef4f-dc07-42e8-809b-aa8df152d57c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:52.934740 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abcef4f-dc07-42e8-809b-aa8df152d57c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:52.937942 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abcef4f-dc07-42e8-809b-aa8df152d57c admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:52.941228 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abcef4f-dc07-42e8-809b-aa8df152d57c admin admin] PATH_INFO: `/v3/users/a7722bb931ae4c55a046ceea6dc929d5` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:52.946455 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abcef4f-dc07-42e8-809b-aa8df152d57c admin admin] RBAC: Authorizing `identity:delete_user(user_id=a7722bb931ae4c55a046ceea6dc929d5)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:52.949859 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abcef4f-dc07-42e8-809b-aa8df152d57c admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:53.072067 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46e5bc8-a6f9-442c-94d6-6ed3cd3d301a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:53.076503 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46e5bc8-a6f9-442c-94d6-6ed3cd3d301a service cinder] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:53.102530 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-8abcef4f-dc07-42e8-809b-aa8df152d57c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a7722bb931ae4c55a046ceea6dc929d5'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:53.112062 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1050/2103] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 24 05:46:52 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:46:53.121990 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-8abcef4f-dc07-42e8-809b-aa8df152d57c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a7722bb931ae4c55a046ceea6dc929d5'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:53.132593 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:46:53.151231 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-8abcef4f-dc07-42e8-809b-aa8df152d57c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a7722bb931ae4c55a046ceea6dc929d5'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:53.166818 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-8abcef4f-dc07-42e8-809b-aa8df152d57c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a7722bb931ae4c55a046ceea6dc929d5'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:53.170692 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-8abcef4f-dc07-42e8-809b-aa8df152d57c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a7722bb931ae4c55a046ceea6dc929d5'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:53.189704 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1054/2104] 10.222.0.26 () {58 vars in 1224 bytes} [Wed Aug 24 05:46:52 2022] DELETE /identity/v3/users/a7722bb931ae4c55a046ceea6dc929d5 => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:46:53.195256 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59b7ce8-5768-4265-b23c-70f1b1b20623 None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:53.195861 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59b7ce8-5768-4265-b23c-70f1b1b20623 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:53.196536 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59b7ce8-5768-4265-b23c-70f1b1b20623 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:53.235598 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-b59b7ce8-5768-4265-b23c-70f1b1b20623 None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:46:53.237301 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-b59b7ce8-5768-4265-b23c-70f1b1b20623 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:53.328997 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1051/2105] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:46:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:46:53.423558 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abcef4f-dc07-42e8-809b-aa8df152d57c admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:53.425214 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-8abcef4f-dc07-42e8-809b-aa8df152d57c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:53.435828 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59b7ce8-5768-4265-b23c-70f1b1b20623 None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:53.437576 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-b59b7ce8-5768-4265-b23c-70f1b1b20623 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:53.465319 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59b7ce8-5768-4265-b23c-70f1b1b20623 None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:53.485897 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cc9280-6eae-48fe-b853-c84ebe147e66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:53.485897 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cc9280-6eae-48fe-b853-c84ebe147e66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:53.485897 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cc9280-6eae-48fe-b853-c84ebe147e66 admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:53.485897 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cc9280-6eae-48fe-b853-c84ebe147e66 admin admin] PATH_INFO: `/v3/projects/c5999d7813c44ad78ccca66d96f8e75b` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:53.487324 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cc9280-6eae-48fe-b853-c84ebe147e66 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c5999d7813c44ad78ccca66d96f8e75b)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:53.489388 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cc9280-6eae-48fe-b853-c84ebe147e66 admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:53.585001 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abcef4f-dc07-42e8-809b-aa8df152d57c admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:53.593097 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:46:53.615427 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-a7cc9280-6eae-48fe-b853-c84ebe147e66 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c5999d7813c44ad78ccca66d96f8e75b', 'request_id': 'req-a7cc9280-6eae-48fe-b853-c84ebe147e66'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:53.632159 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-a7cc9280-6eae-48fe-b853-c84ebe147e66 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c5999d7813c44ad78ccca66d96f8e75b', 'request_id': 'req-a7cc9280-6eae-48fe-b853-c84ebe147e66'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:53.645819 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-a7cc9280-6eae-48fe-b853-c84ebe147e66 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c5999d7813c44ad78ccca66d96f8e75b', 'request_id': 'req-a7cc9280-6eae-48fe-b853-c84ebe147e66'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:53.667891 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-a7cc9280-6eae-48fe-b853-c84ebe147e66 admin admin] The token cache is being invalidate because project c5999d7813c44ad78ccca66d96f8e75b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:46:53.668291 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-a7cc9280-6eae-48fe-b853-c84ebe147e66 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:53.669259 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-a7cc9280-6eae-48fe-b853-c84ebe147e66 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:53.673126 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1052/2106] 10.222.0.26 () {58 vars in 1233 bytes} [Wed Aug 24 05:46:53 2022] DELETE /identity/v3/projects/c5999d7813c44ad78ccca66d96f8e75b => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:46:53.677246 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cc9280-6eae-48fe-b853-c84ebe147e66 admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:53.681589 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-a7cc9280-6eae-48fe-b853-c84ebe147e66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:53.737830 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26abbca8-2c91-4e03-b2b2-c84141714531 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '874348b647194ac2b5ecbf12c33bf59e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:53.741058 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26abbca8-2c91-4e03-b2b2-c84141714531 service neutron] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:53.742384 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26abbca8-2c91-4e03-b2b2-c84141714531 service neutron] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:53.750836 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26abbca8-2c91-4e03-b2b2-c84141714531 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:53.755639 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-26abbca8-2c91-4e03-b2b2-c84141714531 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:53.833416 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cc9280-6eae-48fe-b853-c84ebe147e66 admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:53.845530 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85971799-6962-435b-b24e-b55225384f34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:53.846208 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85971799-6962-435b-b24e-b55225384f34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:53.846492 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85971799-6962-435b-b24e-b55225384f34 admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:53.846761 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85971799-6962-435b-b24e-b55225384f34 admin admin] PATH_INFO: `/v3/users/eee266692f834303adfe97207302bb79` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:53.848796 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85971799-6962-435b-b24e-b55225384f34 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eee266692f834303adfe97207302bb79)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:53.850780 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85971799-6962-435b-b24e-b55225384f34 admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:53.893767 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26abbca8-2c91-4e03-b2b2-c84141714531 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:53.897460 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26abbca8-2c91-4e03-b2b2-c84141714531 service neutron] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:53.912461 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1055/2107] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 24 05:46:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 490 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:46:53.914295 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decd7fe3-2996-4bf3-9b19-153c3eb2f461 None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:53.914783 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decd7fe3-2996-4bf3-9b19-153c3eb2f461 None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:53.915302 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decd7fe3-2996-4bf3-9b19-153c3eb2f461 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:53.938674 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-decd7fe3-2996-4bf3-9b19-153c3eb2f461 None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:46:53.940194 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-decd7fe3-2996-4bf3-9b19-153c3eb2f461 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:53.946500 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-85971799-6962-435b-b24e-b55225384f34 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eee266692f834303adfe97207302bb79'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:53.951559 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1056/2108] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:46:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:46:53.961268 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4bdd0d-a48a-4b25-9f34-68dadc4c2fb7 None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:53.961559 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4bdd0d-a48a-4b25-9f34-68dadc4c2fb7 None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:53.961838 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4bdd0d-a48a-4b25-9f34-68dadc4c2fb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:53.974291 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-85971799-6962-435b-b24e-b55225384f34 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eee266692f834303adfe97207302bb79'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:53.974291 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-85971799-6962-435b-b24e-b55225384f34 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eee266692f834303adfe97207302bb79'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:53.981846 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-85971799-6962-435b-b24e-b55225384f34 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eee266692f834303adfe97207302bb79'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:53.985574 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-4d4bdd0d-a48a-4b25-9f34-68dadc4c2fb7 None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:46:53.987717 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-4d4bdd0d-a48a-4b25-9f34-68dadc4c2fb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:53.991268 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-85971799-6962-435b-b24e-b55225384f34 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eee266692f834303adfe97207302bb79'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:54.000546 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1053/2109] 10.222.0.26 () {58 vars in 1224 bytes} [Wed Aug 24 05:46:53 2022] DELETE /identity/v3/users/eee266692f834303adfe97207302bb79 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:46:54.001046 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1057/2110] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:46:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:46:54.008044 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356803ef-9932-4c55-b0d6-d49f74ac7b07 None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:54.008333 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356803ef-9932-4c55-b0d6-d49f74ac7b07 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:54.008702 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356803ef-9932-4c55-b0d6-d49f74ac7b07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:54.009613 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4bdd0d-a48a-4b25-9f34-68dadc4c2fb7 None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:54.029305 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4bdd0d-a48a-4b25-9f34-68dadc4c2fb7 None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:54.041126 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-356803ef-9932-4c55-b0d6-d49f74ac7b07 None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:46:54.042921 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-356803ef-9932-4c55-b0d6-d49f74ac7b07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:54.078905 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:DELETE=3,keystone:SELECT=96,keystone:INSERT=1 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:46:54.106928 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:46:54.122587 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f08332-1863-4087-9467-25b54eabb765 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:54.123532 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f08332-1863-4087-9467-25b54eabb765 admin admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:54.123814 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f08332-1863-4087-9467-25b54eabb765 admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:54.124282 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f08332-1863-4087-9467-25b54eabb765 admin admin] PATH_INFO: `/v3/domains` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:54.125379 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f08332-1863-4087-9467-25b54eabb765 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:46:54.125379 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f08332-1863-4087-9467-25b54eabb765 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:54.127623 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f08332-1863-4087-9467-25b54eabb765 admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:54.141414 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1054/2111] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:46:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:46:54.155492 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1058/2112] 10.222.0.26 () {58 vars in 1153 bytes} [Wed Aug 24 05:46:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:46:54.160095 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356803ef-9932-4c55-b0d6-d49f74ac7b07 None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:54.161616 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f08332-1863-4087-9467-25b54eabb765 admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:54.162138 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-356803ef-9932-4c55-b0d6-d49f74ac7b07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:54.175155 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f08332-1863-4087-9467-25b54eabb765 admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:54.181685 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418d7d13-0a4b-48db-b90d-cbe442cf4ff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:54.182539 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418d7d13-0a4b-48db-b90d-cbe442cf4ff1 admin admin] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:54.183200 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418d7d13-0a4b-48db-b90d-cbe442cf4ff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:54.183480 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418d7d13-0a4b-48db-b90d-cbe442cf4ff1 admin admin] PATH_INFO: `/v3/projects` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:54.184716 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418d7d13-0a4b-48db-b90d-cbe442cf4ff1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:54.186726 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418d7d13-0a4b-48db-b90d-cbe442cf4ff1 admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:54.232334 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1059/2113] 10.222.0.26 () {60 vars in 1153 bytes} [Wed Aug 24 05:46:54 2022] POST /identity/v3/projects => generated 373 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:46:54.234126 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418d7d13-0a4b-48db-b90d-cbe442cf4ff1 admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:54.252695 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356803ef-9932-4c55-b0d6-d49f74ac7b07 None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:54.321509 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0bcaa4-08bf-4d07-b89e-705d74033ee7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '874348b647194ac2b5ecbf12c33bf59e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:54.322583 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0bcaa4-08bf-4d07-b89e-705d74033ee7 service neutron] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:54.322997 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0bcaa4-08bf-4d07-b89e-705d74033ee7 service neutron] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:54.323342 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0bcaa4-08bf-4d07-b89e-705d74033ee7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:54.325248 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418d7d13-0a4b-48db-b90d-cbe442cf4ff1 admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:54.331595 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafbc57d-5e2b-406f-aaec-9a9e7e4311fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:54.332217 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafbc57d-5e2b-406f-aaec-9a9e7e4311fb admin admin] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:54.332860 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafbc57d-5e2b-406f-aaec-9a9e7e4311fb admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:54.332860 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafbc57d-5e2b-406f-aaec-9a9e7e4311fb admin admin] PATH_INFO: `/v3/users` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:54.334167 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafbc57d-5e2b-406f-aaec-9a9e7e4311fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:54.335284 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0bcaa4-08bf-4d07-b89e-705d74033ee7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:54.336805 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0bcaa4-08bf-4d07-b89e-705d74033ee7 service neutron] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:54.337052 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafbc57d-5e2b-406f-aaec-9a9e7e4311fb admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:54.347978 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1055/2114] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 24 05:46:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 05:46:54.375097 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1060/2115] 10.222.0.26 () {60 vars in 1144 bytes} [Wed Aug 24 05:46:54 2022] POST /identity/v3/users => generated 287 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:46:54.375304 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0bcaa4-08bf-4d07-b89e-705d74033ee7 service neutron] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:54.392811 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0bcaa4-08bf-4d07-b89e-705d74033ee7 service neutron] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:54.398929 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f9105f-2193-4376-aed2-328c0da4ab5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:54.399855 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f9105f-2193-4376-aed2-328c0da4ab5b admin admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:54.400361 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f9105f-2193-4376-aed2-328c0da4ab5b admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:54.400666 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f9105f-2193-4376-aed2-328c0da4ab5b admin admin] PATH_INFO: `/v3/roles` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:54.401633 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f9105f-2193-4376-aed2-328c0da4ab5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:54.408285 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f9105f-2193-4376-aed2-328c0da4ab5b admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:54.413192 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafbc57d-5e2b-406f-aaec-9a9e7e4311fb admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:54.414920 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-eafbc57d-5e2b-406f-aaec-9a9e7e4311fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:54.445788 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafbc57d-5e2b-406f-aaec-9a9e7e4311fb admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:54.453483 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1056/2116] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Aug 24 05:46:54 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 05:46:54.455471 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f9105f-2193-4376-aed2-328c0da4ab5b admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:54.464705 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97b9c49-dc2a-4f1e-be36-e5022801b92b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:54.465896 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97b9c49-dc2a-4f1e-be36-e5022801b92b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:54.466199 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97b9c49-dc2a-4f1e-be36-e5022801b92b admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:54.466467 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97b9c49-dc2a-4f1e-be36-e5022801b92b admin admin] PATH_INFO: `/v3/projects/180676460d164b4a9c6c4b733349c2b9` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:54.469241 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97b9c49-dc2a-4f1e-be36-e5022801b92b admin admin] RBAC: Authorizing `identity:delete_project(project_id=180676460d164b4a9c6c4b733349c2b9)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:54.471205 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97b9c49-dc2a-4f1e-be36-e5022801b92b admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:54.476682 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f9105f-2193-4376-aed2-328c0da4ab5b admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:54.484127 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38a909e-2878-4e05-bbb4-469ca10d84af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:54.484743 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38a909e-2878-4e05-bbb4-469ca10d84af admin admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:54.485024 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38a909e-2878-4e05-bbb4-469ca10d84af admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:54.485298 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38a909e-2878-4e05-bbb4-469ca10d84af admin admin] PATH_INFO: `/v3/roles` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:54.486008 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38a909e-2878-4e05-bbb4-469ca10d84af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:54.487625 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38a909e-2878-4e05-bbb4-469ca10d84af admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:54.507140 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1057/2117] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Aug 24 05:46:54 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:46:54.513838 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38a909e-2878-4e05-bbb4-469ca10d84af admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:54.531219 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38a909e-2878-4e05-bbb4-469ca10d84af admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:54.548407 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5440b446-e326-493c-bff2-436e68aadead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:54.549339 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5440b446-e326-493c-bff2-436e68aadead admin admin] REQUEST_METHOD: `PUT` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:54.550248 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5440b446-e326-493c-bff2-436e68aadead admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:54.551780 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5440b446-e326-493c-bff2-436e68aadead admin admin] PATH_INFO: `/v3/projects/24eeedd3eba24ca6884cea6eb27a060b/users/b0126aa8d30a4cb3b8a790679ef7391b/roles/f7aa4a2c74c94c1b9ca8ecdcccccda5c` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:54.600757 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5440b446-e326-493c-bff2-436e68aadead admin admin] RBAC: Authorizing `identity:create_grant(project_id=24eeedd3eba24ca6884cea6eb27a060b, user_id=b0126aa8d30a4cb3b8a790679ef7391b, role_id=f7aa4a2c74c94c1b9ca8ecdcccccda5c)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:54.603114 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-e97b9c49-dc2a-4f1e-be36-e5022801b92b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '180676460d164b4a9c6c4b733349c2b9', 'request_id': 'req-e97b9c49-dc2a-4f1e-be36-e5022801b92b'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:54.605942 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5440b446-e326-493c-bff2-436e68aadead admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:54.617805 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-e97b9c49-dc2a-4f1e-be36-e5022801b92b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '180676460d164b4a9c6c4b733349c2b9', 'request_id': 'req-e97b9c49-dc2a-4f1e-be36-e5022801b92b'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:54.631199 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-e97b9c49-dc2a-4f1e-be36-e5022801b92b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '180676460d164b4a9c6c4b733349c2b9', 'request_id': 'req-e97b9c49-dc2a-4f1e-be36-e5022801b92b'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:54.640776 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1058/2118] 10.222.0.26 () {60 vars in 1483 bytes} [Wed Aug 24 05:46:54 2022] PUT /identity/v3/projects/24eeedd3eba24ca6884cea6eb27a060b/users/b0126aa8d30a4cb3b8a790679ef7391b/roles/f7aa4a2c74c94c1b9ca8ecdcccccda5c => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:46:54.643915 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfb7c12-94b0-4447-a966-f2ba315e3818 None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:54.645406 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfb7c12-94b0-4447-a966-f2ba315e3818 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:54.645406 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfb7c12-94b0-4447-a966-f2ba315e3818 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:54.663461 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-e97b9c49-dc2a-4f1e-be36-e5022801b92b admin admin] The token cache is being invalidate because project 180676460d164b4a9c6c4b733349c2b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88112) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:46:54.664671 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-e97b9c49-dc2a-4f1e-be36-e5022801b92b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:54.667992 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-e97b9c49-dc2a-4f1e-be36-e5022801b92b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:54.676819 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1061/2119] 10.222.0.26 () {58 vars in 1233 bytes} [Wed Aug 24 05:46:54 2022] DELETE /identity/v3/projects/180676460d164b4a9c6c4b733349c2b9 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 05:46:54.678231 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97b9c49-dc2a-4f1e-be36-e5022801b92b admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:54.680161 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-e97b9c49-dc2a-4f1e-be36-e5022801b92b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:54.691818 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-7cfb7c12-94b0-4447-a966-f2ba315e3818 None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:46:54.694171 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-7cfb7c12-94b0-4447-a966-f2ba315e3818 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:54.725831 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:46:54.783047 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:46:54.803012 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1059/2120] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:46:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:46:54.807920 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfb7c12-94b0-4447-a966-f2ba315e3818 None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:54.807920 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-7cfb7c12-94b0-4447-a966-f2ba315e3818 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:54.823278 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfb7c12-94b0-4447-a966-f2ba315e3818 None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:54.823595 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97b9c49-dc2a-4f1e-be36-e5022801b92b admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:54.829621 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a651e5fb-fae3-446a-b85e-0f6c38c9ce78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:54.830286 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a6ebb8-a6bc-484f-a8a3-b0a2a6167c9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:54.830424 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a651e5fb-fae3-446a-b85e-0f6c38c9ce78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:54.830605 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a651e5fb-fae3-446a-b85e-0f6c38c9ce78 admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:54.830828 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a651e5fb-fae3-446a-b85e-0f6c38c9ce78 admin admin] PATH_INFO: `/v3/projects/655689cda36947f0a6c769eb2d053127` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:54.831012 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a6ebb8-a6bc-484f-a8a3-b0a2a6167c9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:54.831337 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a6ebb8-a6bc-484f-a8a3-b0a2a6167c9d admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:54.831732 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a6ebb8-a6bc-484f-a8a3-b0a2a6167c9d admin admin] PATH_INFO: `/v3/users/47419b5c2155422c83774ea7411c3f11` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:54.832357 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a651e5fb-fae3-446a-b85e-0f6c38c9ce78 admin admin] RBAC: Authorizing `identity:delete_project(project_id=655689cda36947f0a6c769eb2d053127)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:54.833085 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a6ebb8-a6bc-484f-a8a3-b0a2a6167c9d admin admin] RBAC: Authorizing `identity:delete_user(user_id=47419b5c2155422c83774ea7411c3f11)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:54.834890 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a651e5fb-fae3-446a-b85e-0f6c38c9ce78 admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:54.838270 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a6ebb8-a6bc-484f-a8a3-b0a2a6167c9d admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:54.899486 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-a651e5fb-fae3-446a-b85e-0f6c38c9ce78 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '655689cda36947f0a6c769eb2d053127', 'request_id': 'req-a651e5fb-fae3-446a-b85e-0f6c38c9ce78'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:54.902344 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-e1a6ebb8-a6bc-484f-a8a3-b0a2a6167c9d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '47419b5c2155422c83774ea7411c3f11'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:54.910568 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-a651e5fb-fae3-446a-b85e-0f6c38c9ce78 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '655689cda36947f0a6c769eb2d053127', 'request_id': 'req-a651e5fb-fae3-446a-b85e-0f6c38c9ce78'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:54.911635 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-e1a6ebb8-a6bc-484f-a8a3-b0a2a6167c9d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '47419b5c2155422c83774ea7411c3f11'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:54.926398 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-e1a6ebb8-a6bc-484f-a8a3-b0a2a6167c9d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '47419b5c2155422c83774ea7411c3f11'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:54.931936 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-a651e5fb-fae3-446a-b85e-0f6c38c9ce78 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '655689cda36947f0a6c769eb2d053127', 'request_id': 'req-a651e5fb-fae3-446a-b85e-0f6c38c9ce78'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:54.937464 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-e1a6ebb8-a6bc-484f-a8a3-b0a2a6167c9d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '47419b5c2155422c83774ea7411c3f11'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:54.938581 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-e1a6ebb8-a6bc-484f-a8a3-b0a2a6167c9d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '47419b5c2155422c83774ea7411c3f11'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:54.958952 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1062/2121] 10.222.0.26 () {58 vars in 1224 bytes} [Wed Aug 24 05:46:54 2022] DELETE /identity/v3/users/47419b5c2155422c83774ea7411c3f11 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 05:46:54.958952 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a6ebb8-a6bc-484f-a8a3-b0a2a6167c9d admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:54.958952 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-e1a6ebb8-a6bc-484f-a8a3-b0a2a6167c9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:54.959178 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-a651e5fb-fae3-446a-b85e-0f6c38c9ce78 admin admin] The token cache is being invalidate because project 655689cda36947f0a6c769eb2d053127 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:46:54.959178 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-a651e5fb-fae3-446a-b85e-0f6c38c9ce78 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:54.959178 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-a651e5fb-fae3-446a-b85e-0f6c38c9ce78 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:54.962880 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1060/2122] 10.222.0.26 () {58 vars in 1233 bytes} [Wed Aug 24 05:46:54 2022] DELETE /identity/v3/projects/655689cda36947f0a6c769eb2d053127 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:46:54.964442 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a651e5fb-fae3-446a-b85e-0f6c38c9ce78 admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:54.966167 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-a651e5fb-fae3-446a-b85e-0f6c38c9ce78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:55.058212 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a6ebb8-a6bc-484f-a8a3-b0a2a6167c9d admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:55.068300 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad464cf-c581-46e0-8324-78699e24929a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '874348b647194ac2b5ecbf12c33bf59e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:55.069914 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad464cf-c581-46e0-8324-78699e24929a service neutron] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:55.070324 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad464cf-c581-46e0-8324-78699e24929a service neutron] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:55.070604 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad464cf-c581-46e0-8324-78699e24929a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:55.076677 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-9ad464cf-c581-46e0-8324-78699e24929a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:55.122740 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a651e5fb-fae3-446a-b85e-0f6c38c9ce78 admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:55.186435 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:46:55.224522 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad464cf-c581-46e0-8324-78699e24929a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:55.230318 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad464cf-c581-46e0-8324-78699e24929a service neutron] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:55.262870 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1063/2123] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 24 05:46:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:46:55.276641 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687df537-ec42-4809-aa35-ccd99500eaea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:55.277389 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687df537-ec42-4809-aa35-ccd99500eaea admin admin] REQUEST_METHOD: `DELETE` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:55.277780 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687df537-ec42-4809-aa35-ccd99500eaea admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:55.278152 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687df537-ec42-4809-aa35-ccd99500eaea admin admin] PATH_INFO: `/v3/users/a1dd0f6c57fb4a4e9142188f83c1c640` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:55.280115 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687df537-ec42-4809-aa35-ccd99500eaea admin admin] RBAC: Authorizing `identity:delete_user(user_id=a1dd0f6c57fb4a4e9142188f83c1c640)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:55.282726 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687df537-ec42-4809-aa35-ccd99500eaea admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:55.334608 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:46:55.358682 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-687df537-ec42-4809-aa35-ccd99500eaea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a1dd0f6c57fb4a4e9142188f83c1c640'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:55.369228 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-687df537-ec42-4809-aa35-ccd99500eaea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a1dd0f6c57fb4a4e9142188f83c1c640'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:55.370136 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-687df537-ec42-4809-aa35-ccd99500eaea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a1dd0f6c57fb4a4e9142188f83c1c640'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:55.389816 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-687df537-ec42-4809-aa35-ccd99500eaea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a1dd0f6c57fb4a4e9142188f83c1c640'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:55.401858 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-687df537-ec42-4809-aa35-ccd99500eaea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a1dd0f6c57fb4a4e9142188f83c1c640'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:55.412222 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1061/2124] 10.222.0.26 () {58 vars in 1224 bytes} [Wed Aug 24 05:46:54 2022] DELETE /identity/v3/users/a1dd0f6c57fb4a4e9142188f83c1c640 => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:46:55.925380 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad464cf-c581-46e0-8324-78699e24929a service neutron] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:55.927254 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-9ad464cf-c581-46e0-8324-78699e24929a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:55.940155 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad464cf-c581-46e0-8324-78699e24929a service neutron] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:56.019351 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe748293-ba27-475a-9263-180a9acba4ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:56.020637 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe748293-ba27-475a-9263-180a9acba4ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:56.021379 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe748293-ba27-475a-9263-180a9acba4ee admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:56.021515 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe748293-ba27-475a-9263-180a9acba4ee admin admin] PATH_INFO: `/v3/projects/c22f686345bb43df81a956ab26f5d778` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:56.023265 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe748293-ba27-475a-9263-180a9acba4ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=c22f686345bb43df81a956ab26f5d778)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:56.025912 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe748293-ba27-475a-9263-180a9acba4ee admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:56.095858 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-fe748293-ba27-475a-9263-180a9acba4ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c22f686345bb43df81a956ab26f5d778', 'request_id': 'req-fe748293-ba27-475a-9263-180a9acba4ee'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:56.105738 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-fe748293-ba27-475a-9263-180a9acba4ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c22f686345bb43df81a956ab26f5d778', 'request_id': 'req-fe748293-ba27-475a-9263-180a9acba4ee'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:56.114016 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-fe748293-ba27-475a-9263-180a9acba4ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c22f686345bb43df81a956ab26f5d778', 'request_id': 'req-fe748293-ba27-475a-9263-180a9acba4ee'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:56.125484 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-fe748293-ba27-475a-9263-180a9acba4ee admin admin] The token cache is being invalidate because project c22f686345bb43df81a956ab26f5d778 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88112) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:46:56.125774 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-fe748293-ba27-475a-9263-180a9acba4ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:56.126462 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-fe748293-ba27-475a-9263-180a9acba4ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:56.128015 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1064/2125] 10.222.0.26 () {58 vars in 1233 bytes} [Wed Aug 24 05:46:55 2022] DELETE /identity/v3/projects/c22f686345bb43df81a956ab26f5d778 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:46:56.135379 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cdc270-85af-408d-86e8-9f080e3f0a3f None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:56.135756 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cdc270-85af-408d-86e8-9f080e3f0a3f None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:56.136188 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cdc270-85af-408d-86e8-9f080e3f0a3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:56.159615 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-93cdc270-85af-408d-86e8-9f080e3f0a3f None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:46:56.160959 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-93cdc270-85af-408d-86e8-9f080e3f0a3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:56.252984 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1062/2126] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:46:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:46:56.264260 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3438c31b-4b12-496a-8c21-3ed737560187 None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:56.264782 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3438c31b-4b12-496a-8c21-3ed737560187 None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:56.266214 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3438c31b-4b12-496a-8c21-3ed737560187 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:56.287410 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-3438c31b-4b12-496a-8c21-3ed737560187 None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:46:56.288677 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-3438c31b-4b12-496a-8c21-3ed737560187 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:56.299643 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1065/2127] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:46:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:46:56.303113 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cdc270-85af-408d-86e8-9f080e3f0a3f None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:56.315295 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cdc270-85af-408d-86e8-9f080e3f0a3f None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:56.317449 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3438c31b-4b12-496a-8c21-3ed737560187 None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:56.319606 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-3438c31b-4b12-496a-8c21-3ed737560187 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:56.321666 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39147959-f8e1-4af6-9199-d50d16afe614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:56.322571 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39147959-f8e1-4af6-9199-d50d16afe614 admin admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:56.322847 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39147959-f8e1-4af6-9199-d50d16afe614 admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:56.323112 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39147959-f8e1-4af6-9199-d50d16afe614 admin admin] PATH_INFO: `/v3/domains` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:56.323767 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39147959-f8e1-4af6-9199-d50d16afe614 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:46:56.324066 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39147959-f8e1-4af6-9199-d50d16afe614 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:56.326208 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39147959-f8e1-4af6-9199-d50d16afe614 admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:56.348056 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1063/2128] 10.222.0.26 () {58 vars in 1153 bytes} [Wed Aug 24 05:46:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:46:56.349635 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39147959-f8e1-4af6-9199-d50d16afe614 admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:56.349877 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3438c31b-4b12-496a-8c21-3ed737560187 None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:56.368583 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f18170-a1c4-4860-b171-79ee197986b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:56.370252 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f18170-a1c4-4860-b171-79ee197986b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:56.370952 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f18170-a1c4-4860-b171-79ee197986b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:56.371961 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f18170-a1c4-4860-b171-79ee197986b2 admin admin] PATH_INFO: `/v3/projects/e3708973e87448bebb2c7f6d47512478` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:56.374467 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f18170-a1c4-4860-b171-79ee197986b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e3708973e87448bebb2c7f6d47512478)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:56.378470 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39147959-f8e1-4af6-9199-d50d16afe614 admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:56.378751 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f18170-a1c4-4860-b171-79ee197986b2 admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:56.384419 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9395c897-6047-408d-bdcb-49ba73bf6568 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:56.385143 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9395c897-6047-408d-bdcb-49ba73bf6568 admin admin] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:56.385570 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9395c897-6047-408d-bdcb-49ba73bf6568 admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:56.385908 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9395c897-6047-408d-bdcb-49ba73bf6568 admin admin] PATH_INFO: `/v3/projects` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:56.386837 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9395c897-6047-408d-bdcb-49ba73bf6568 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:56.390373 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9395c897-6047-408d-bdcb-49ba73bf6568 admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:56.437974 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1064/2129] 10.222.0.26 () {60 vars in 1153 bytes} [Wed Aug 24 05:46:56 2022] POST /identity/v3/projects => generated 369 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 05:46:56.444054 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9395c897-6047-408d-bdcb-49ba73bf6568 admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:56.502711 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-96f18170-a1c4-4860-b171-79ee197986b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e3708973e87448bebb2c7f6d47512478', 'request_id': 'req-96f18170-a1c4-4860-b171-79ee197986b2'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:56.521762 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-96f18170-a1c4-4860-b171-79ee197986b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e3708973e87448bebb2c7f6d47512478', 'request_id': 'req-96f18170-a1c4-4860-b171-79ee197986b2'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:56.536819 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9395c897-6047-408d-bdcb-49ba73bf6568 admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:56.545242 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-96f18170-a1c4-4860-b171-79ee197986b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e3708973e87448bebb2c7f6d47512478', 'request_id': 'req-96f18170-a1c4-4860-b171-79ee197986b2'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:56.547900 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:46:56.562643 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-96f18170-a1c4-4860-b171-79ee197986b2 admin admin] The token cache is being invalidate because project e3708973e87448bebb2c7f6d47512478 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88112) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:46:56.563100 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-96f18170-a1c4-4860-b171-79ee197986b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:56.564604 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-96f18170-a1c4-4860-b171-79ee197986b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:56.570097 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1066/2130] 10.222.0.26 () {58 vars in 1233 bytes} [Wed Aug 24 05:46:56 2022] DELETE /identity/v3/projects/e3708973e87448bebb2c7f6d47512478 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 05:46:56.571332 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:46:56.575448 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4a56b6-3af6-42a7-ac69-1d857d830c1c None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:56.576038 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4a56b6-3af6-42a7-ac69-1d857d830c1c None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:56.576038 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4a56b6-3af6-42a7-ac69-1d857d830c1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:56.614700 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-5d4a56b6-3af6-42a7-ac69-1d857d830c1c None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:46:56.616626 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-5d4a56b6-3af6-42a7-ac69-1d857d830c1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:56.645301 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0feaaadf-1c4e-4ee5-b1a5-d84bb629f0ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:56.646418 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0feaaadf-1c4e-4ee5-b1a5-d84bb629f0ad admin admin] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:56.646801 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0feaaadf-1c4e-4ee5-b1a5-d84bb629f0ad admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:56.647359 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0feaaadf-1c4e-4ee5-b1a5-d84bb629f0ad admin admin] PATH_INFO: `/v3/users` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:56.648519 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0feaaadf-1c4e-4ee5-b1a5-d84bb629f0ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:56.657432 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0feaaadf-1c4e-4ee5-b1a5-d84bb629f0ad admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:56.681776 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1065/2131] 10.222.0.26 () {60 vars in 1144 bytes} [Wed Aug 24 05:46:56 2022] POST /identity/v3/users => generated 285 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:46:56.684615 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2301850-b85a-4185-a077-ba94ca383c11 None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:56.685912 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2301850-b85a-4185-a077-ba94ca383c11 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:56.686868 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2301850-b85a-4185-a077-ba94ca383c11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:56.713997 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1067/2132] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:46:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:46:56.713997 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4a56b6-3af6-42a7-ac69-1d857d830c1c None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:56.713997 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-5d4a56b6-3af6-42a7-ac69-1d857d830c1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:56.718373 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-a2301850-b85a-4185-a077-ba94ca383c11 None None] MFA Rules not processed for user `b0126aa8d30a4cb3b8a790679ef7391b`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:46:56.719689 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-a2301850-b85a-4185-a077-ba94ca383c11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:56.732249 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4a56b6-3af6-42a7-ac69-1d857d830c1c None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:56.741623 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e5798b-353d-4f0a-b90c-50b41ee050fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:56.742343 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e5798b-353d-4f0a-b90c-50b41ee050fe admin admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:56.742690 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e5798b-353d-4f0a-b90c-50b41ee050fe admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:56.743030 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e5798b-353d-4f0a-b90c-50b41ee050fe admin admin] PATH_INFO: `/v3/roles` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:56.743776 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e5798b-353d-4f0a-b90c-50b41ee050fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:56.747945 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e5798b-353d-4f0a-b90c-50b41ee050fe admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:56.759612 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1068/2133] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Aug 24 05:46:56 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:46:56.760972 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf5181b-6422-4b77-a9b7-9fa0c75145bc None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:56.761252 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf5181b-6422-4b77-a9b7-9fa0c75145bc None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:56.761994 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf5181b-6422-4b77-a9b7-9fa0c75145bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:56.785410 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-4cf5181b-6422-4b77-a9b7-9fa0c75145bc None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:46:56.787683 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-4cf5181b-6422-4b77-a9b7-9fa0c75145bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:56.790044 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1066/2134] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:46:56 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:46:56.790881 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2301850-b85a-4185-a077-ba94ca383c11 None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:56.800835 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1069/2135] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:46:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:46:56.801915 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf5181b-6422-4b77-a9b7-9fa0c75145bc None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:56.802102 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2301850-b85a-4185-a077-ba94ca383c11 None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:56.803584 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-4cf5181b-6422-4b77-a9b7-9fa0c75145bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:56.807813 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c9abf9-be73-4174-803e-9da40d6b3039 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:56.808541 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c9abf9-be73-4174-803e-9da40d6b3039 admin admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:56.810522 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c9abf9-be73-4174-803e-9da40d6b3039 admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:56.810889 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c9abf9-be73-4174-803e-9da40d6b3039 admin admin] PATH_INFO: `/v3/roles` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:56.811874 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c9abf9-be73-4174-803e-9da40d6b3039 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:56.813580 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c9abf9-be73-4174-803e-9da40d6b3039 admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:56.821273 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf5181b-6422-4b77-a9b7-9fa0c75145bc None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:56.828057 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1067/2136] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Aug 24 05:46:56 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:46:56.828057 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c9abf9-be73-4174-803e-9da40d6b3039 admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:56.830972 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b2f399-5e78-4bfb-9a13-25ff47fbb883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:56.832225 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b2f399-5e78-4bfb-9a13-25ff47fbb883 admin admin] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:56.832601 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b2f399-5e78-4bfb-9a13-25ff47fbb883 admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:56.832964 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b2f399-5e78-4bfb-9a13-25ff47fbb883 admin admin] PATH_INFO: `/v3/projects` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:56.833919 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b2f399-5e78-4bfb-9a13-25ff47fbb883 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:56.835622 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c9abf9-be73-4174-803e-9da40d6b3039 admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:56.835861 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b2f399-5e78-4bfb-9a13-25ff47fbb883 admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:56.842718 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f31445-b38b-4ceb-a00b-bb2460621ce3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:56.843317 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f31445-b38b-4ceb-a00b-bb2460621ce3 admin admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:56.843594 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f31445-b38b-4ceb-a00b-bb2460621ce3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:56.843864 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f31445-b38b-4ceb-a00b-bb2460621ce3 admin admin] PATH_INFO: `/v3/domains` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:56.844507 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f31445-b38b-4ceb-a00b-bb2460621ce3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:46:56.844811 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f31445-b38b-4ceb-a00b-bb2460621ce3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:56.846608 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f31445-b38b-4ceb-a00b-bb2460621ce3 admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:56.859668 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1068/2137] 10.222.0.26 () {58 vars in 1153 bytes} [Wed Aug 24 05:46:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:46:56.860316 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f31445-b38b-4ceb-a00b-bb2460621ce3 admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:56.870402 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1070/2138] 10.222.0.26 () {60 vars in 1153 bytes} [Wed Aug 24 05:46:56 2022] POST /identity/v3/projects => generated 373 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:46:56.871355 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b2f399-5e78-4bfb-9a13-25ff47fbb883 admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:56.874876 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f31445-b38b-4ceb-a00b-bb2460621ce3 admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:56.947294 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc553582-a77e-40d0-8209-e5640d0d765c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:56.947946 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc553582-a77e-40d0-8209-e5640d0d765c admin admin] REQUEST_METHOD: `PUT` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:56.948253 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc553582-a77e-40d0-8209-e5640d0d765c admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:56.948525 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc553582-a77e-40d0-8209-e5640d0d765c admin admin] PATH_INFO: `/v3/projects/b1ec8861d1f4440085238e6e145971c8/users/9f192769928546a889537ee1fa3230e9/roles/f7aa4a2c74c94c1b9ca8ecdcccccda5c` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:56.951642 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b2f399-5e78-4bfb-9a13-25ff47fbb883 admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:56.956680 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbe04e0-1a03-4d49-87ed-1c72b4a81b63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:56.957549 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbe04e0-1a03-4d49-87ed-1c72b4a81b63 admin admin] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:56.957764 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbe04e0-1a03-4d49-87ed-1c72b4a81b63 admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:56.958080 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbe04e0-1a03-4d49-87ed-1c72b4a81b63 admin admin] PATH_INFO: `/v3/projects` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:56.958806 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbe04e0-1a03-4d49-87ed-1c72b4a81b63 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:56.961058 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbe04e0-1a03-4d49-87ed-1c72b4a81b63 admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:56.969787 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc553582-a77e-40d0-8209-e5640d0d765c admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1ec8861d1f4440085238e6e145971c8, user_id=9f192769928546a889537ee1fa3230e9, role_id=f7aa4a2c74c94c1b9ca8ecdcccccda5c)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:56.973748 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc553582-a77e-40d0-8209-e5640d0d765c admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:56.979657 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:46:56.993124 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1071/2139] 10.222.0.26 () {60 vars in 1153 bytes} [Wed Aug 24 05:46:56 2022] POST /identity/v3/projects => generated 357 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:46:56.994110 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbe04e0-1a03-4d49-87ed-1c72b4a81b63 admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:57.001410 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1069/2140] 10.222.0.26 () {60 vars in 1483 bytes} [Wed Aug 24 05:46:56 2022] PUT /identity/v3/projects/b1ec8861d1f4440085238e6e145971c8/users/9f192769928546a889537ee1fa3230e9/roles/f7aa4a2c74c94c1b9ca8ecdcccccda5c => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:46:57.002255 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc553582-a77e-40d0-8209-e5640d0d765c admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:57.046690 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=97,keystone:DELETE=1,keystone:INSERT=2 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:46:57.069869 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbe04e0-1a03-4d49-87ed-1c72b4a81b63 admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:57.075495 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1594561-0ad3-404f-8a31-e4a71b6db275 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:57.076108 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1594561-0ad3-404f-8a31-e4a71b6db275 admin admin] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:57.076393 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1594561-0ad3-404f-8a31-e4a71b6db275 admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:57.076666 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1594561-0ad3-404f-8a31-e4a71b6db275 admin admin] PATH_INFO: `/v3/users` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:57.077298 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1594561-0ad3-404f-8a31-e4a71b6db275 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:57.077517 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc553582-a77e-40d0-8209-e5640d0d765c admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:57.079261 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1594561-0ad3-404f-8a31-e4a71b6db275 admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:57.082368 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea41f0b-a381-4705-8607-21b8edf4464c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:57.083030 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea41f0b-a381-4705-8607-21b8edf4464c admin admin] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:57.083313 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea41f0b-a381-4705-8607-21b8edf4464c admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:57.083582 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea41f0b-a381-4705-8607-21b8edf4464c admin admin] PATH_INFO: `/v3/users` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:57.084206 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea41f0b-a381-4705-8607-21b8edf4464c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:57.086248 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea41f0b-a381-4705-8607-21b8edf4464c admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:57.118768 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1072/2141] 10.222.0.26 () {60 vars in 1144 bytes} [Wed Aug 24 05:46:56 2022] POST /identity/v3/users => generated 293 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:46:57.118768 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1b24dc-3624-4e4c-bf21-34ad71f44464 None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:57.118768 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1b24dc-3624-4e4c-bf21-34ad71f44464 None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:57.118768 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1b24dc-3624-4e4c-bf21-34ad71f44464 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:57.119753 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1070/2142] 10.222.0.26 () {60 vars in 1144 bytes} [Wed Aug 24 05:46:57 2022] POST /identity/v3/users => generated 279 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:46:57.123263 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea41f0b-a381-4705-8607-21b8edf4464c admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:57.133219 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea41f0b-a381-4705-8607-21b8edf4464c admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:57.138261 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4db28da-2ef7-4fbb-adf8-7d96544a2fa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:57.138861 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4db28da-2ef7-4fbb-adf8-7d96544a2fa3 admin admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:57.139822 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4db28da-2ef7-4fbb-adf8-7d96544a2fa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:57.139822 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4db28da-2ef7-4fbb-adf8-7d96544a2fa3 admin admin] PATH_INFO: `/v3/roles` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:57.140056 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4db28da-2ef7-4fbb-adf8-7d96544a2fa3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:57.141656 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4db28da-2ef7-4fbb-adf8-7d96544a2fa3 admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:57.146584 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-2d1b24dc-3624-4e4c-bf21-34ad71f44464 None None] MFA Rules not processed for user `9f192769928546a889537ee1fa3230e9`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:46:57.147792 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-2d1b24dc-3624-4e4c-bf21-34ad71f44464 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:57.152034 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1071/2143] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Aug 24 05:46:57 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:46:57.152866 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4db28da-2ef7-4fbb-adf8-7d96544a2fa3 admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:57.162360 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4db28da-2ef7-4fbb-adf8-7d96544a2fa3 admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:57.166868 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ffcbbf-95d6-461e-8a6a-56adcf417ee2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:57.167436 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ffcbbf-95d6-461e-8a6a-56adcf417ee2 admin admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:57.167712 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ffcbbf-95d6-461e-8a6a-56adcf417ee2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:57.167979 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ffcbbf-95d6-461e-8a6a-56adcf417ee2 admin admin] PATH_INFO: `/v3/roles` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:57.169134 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ffcbbf-95d6-461e-8a6a-56adcf417ee2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:57.170730 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ffcbbf-95d6-461e-8a6a-56adcf417ee2 admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:57.181650 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1072/2144] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Aug 24 05:46:57 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:46:57.182444 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ffcbbf-95d6-461e-8a6a-56adcf417ee2 admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:57.192429 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ffcbbf-95d6-461e-8a6a-56adcf417ee2 admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:57.197287 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ff2e54-af23-4cd5-bee8-ac3dba73bc4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:57.197900 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ff2e54-af23-4cd5-bee8-ac3dba73bc4a admin admin] REQUEST_METHOD: `PUT` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:57.198204 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ff2e54-af23-4cd5-bee8-ac3dba73bc4a admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:57.198467 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ff2e54-af23-4cd5-bee8-ac3dba73bc4a admin admin] PATH_INFO: `/v3/projects/406f1a7e25254dca9626de39969f0943/users/f71fa47acf0149099797f4b5d3281f6d/roles/640bda0879494e60b72680ee505285f0` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:57.213012 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ff2e54-af23-4cd5-bee8-ac3dba73bc4a admin admin] RBAC: Authorizing `identity:create_grant(project_id=406f1a7e25254dca9626de39969f0943, user_id=f71fa47acf0149099797f4b5d3281f6d, role_id=640bda0879494e60b72680ee505285f0)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:57.216256 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ff2e54-af23-4cd5-bee8-ac3dba73bc4a admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:57.220079 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1073/2145] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:46:57 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:46:57.220891 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1b24dc-3624-4e4c-bf21-34ad71f44464 None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:57.230766 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1073/2146] 10.222.0.26 () {60 vars in 1483 bytes} [Wed Aug 24 05:46:57 2022] PUT /identity/v3/projects/406f1a7e25254dca9626de39969f0943/users/f71fa47acf0149099797f4b5d3281f6d/roles/640bda0879494e60b72680ee505285f0 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:46:57.233190 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ff2e54-af23-4cd5-bee8-ac3dba73bc4a admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:57.233320 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1b24dc-3624-4e4c-bf21-34ad71f44464 None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:57.236056 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-46ff2e54-af23-4cd5-bee8-ac3dba73bc4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:57.289087 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e175be6-1bb5-4f83-9860-587a64bf9f4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:57.289694 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e175be6-1bb5-4f83-9860-587a64bf9f4f admin admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:57.290000 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e175be6-1bb5-4f83-9860-587a64bf9f4f admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:57.290284 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e175be6-1bb5-4f83-9860-587a64bf9f4f admin admin] PATH_INFO: `/v3/roles` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:57.290922 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e175be6-1bb5-4f83-9860-587a64bf9f4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:57.292515 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e175be6-1bb5-4f83-9860-587a64bf9f4f admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:57.302692 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1074/2147] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Aug 24 05:46:57 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:46:57.303483 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e175be6-1bb5-4f83-9860-587a64bf9f4f admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:57.312971 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e175be6-1bb5-4f83-9860-587a64bf9f4f admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:57.317451 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c9847d-d1d1-476d-841a-674efd2fe483 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:57.318020 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ff2e54-af23-4cd5-bee8-ac3dba73bc4a admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:57.318452 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c9847d-d1d1-476d-841a-674efd2fe483 admin admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:57.318452 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c9847d-d1d1-476d-841a-674efd2fe483 admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:57.318655 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c9847d-d1d1-476d-841a-674efd2fe483 admin admin] PATH_INFO: `/v3/roles` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:57.319190 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c9847d-d1d1-476d-841a-674efd2fe483 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:57.320830 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c9847d-d1d1-476d-841a-674efd2fe483 admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:57.322380 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcbea46-71d8-4704-b0ee-22b9f59f9422 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f856958add7474a989325cea7b1b224', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:57.322981 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcbea46-71d8-4704-b0ee-22b9f59f9422 service glance] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:57.323259 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcbea46-71d8-4704-b0ee-22b9f59f9422 service glance] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:57.323531 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcbea46-71d8-4704-b0ee-22b9f59f9422 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:57.333976 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1075/2148] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Aug 24 05:46:57 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:46:57.334791 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c9847d-d1d1-476d-841a-674efd2fe483 admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:57.345180 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c9847d-d1d1-476d-841a-674efd2fe483 admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:57.349856 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fae92ab-82f0-41eb-bd4c-be8d265efd8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:57.350525 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fae92ab-82f0-41eb-bd4c-be8d265efd8c admin admin] REQUEST_METHOD: `PUT` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:57.350808 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fae92ab-82f0-41eb-bd4c-be8d265efd8c admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:57.351080 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fae92ab-82f0-41eb-bd4c-be8d265efd8c admin admin] PATH_INFO: `/v3/projects/e351dcaef9ed4c54a53d49dbb53dadc1/users/4fc964277b8046b79bdf6c3dd0a70ca2/roles/f7aa4a2c74c94c1b9ca8ecdcccccda5c` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:57.366440 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fae92ab-82f0-41eb-bd4c-be8d265efd8c admin admin] RBAC: Authorizing `identity:create_grant(project_id=e351dcaef9ed4c54a53d49dbb53dadc1, user_id=4fc964277b8046b79bdf6c3dd0a70ca2, role_id=f7aa4a2c74c94c1b9ca8ecdcccccda5c)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:57.367284 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:46:57.369143 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fae92ab-82f0-41eb-bd4c-be8d265efd8c admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:57.381696 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1076/2149] 10.222.0.26 () {60 vars in 1483 bytes} [Wed Aug 24 05:46:57 2022] PUT /identity/v3/projects/e351dcaef9ed4c54a53d49dbb53dadc1/users/4fc964277b8046b79bdf6c3dd0a70ca2/roles/f7aa4a2c74c94c1b9ca8ecdcccccda5c => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:46:57.382496 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fae92ab-82f0-41eb-bd4c-be8d265efd8c admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:57.397593 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcbea46-71d8-4704-b0ee-22b9f59f9422 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:57.399130 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcbea46-71d8-4704-b0ee-22b9f59f9422 service glance] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:57.407015 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:46:57.409085 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1074/2150] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 24 05:46:57 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:46:57.410402 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15753f74-04ca-4306-afe2-a36a25ffb003 None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:57.410689 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15753f74-04ca-4306-afe2-a36a25ffb003 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:57.411082 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15753f74-04ca-4306-afe2-a36a25ffb003 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:57.443798 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-15753f74-04ca-4306-afe2-a36a25ffb003 None None] MFA Rules not processed for user `4fc964277b8046b79bdf6c3dd0a70ca2`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:46:57.445157 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-15753f74-04ca-4306-afe2-a36a25ffb003 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:57.453323 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fae92ab-82f0-41eb-bd4c-be8d265efd8c admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:57.458501 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d38a4b0-84e2-4dcc-abdd-34411366c6f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:57.459169 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d38a4b0-84e2-4dcc-abdd-34411366c6f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:57.459482 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d38a4b0-84e2-4dcc-abdd-34411366c6f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:57.460211 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d38a4b0-84e2-4dcc-abdd-34411366c6f2 admin admin] PATH_INFO: `/v3/projects/406f1a7e25254dca9626de39969f0943/users/f71fa47acf0149099797f4b5d3281f6d/roles/640bda0879494e60b72680ee505285f0` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:57.461884 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d38a4b0-84e2-4dcc-abdd-34411366c6f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=406f1a7e25254dca9626de39969f0943, user_id=f71fa47acf0149099797f4b5d3281f6d, role_id=640bda0879494e60b72680ee505285f0)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:57.464569 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d38a4b0-84e2-4dcc-abdd-34411366c6f2 admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:57.477761 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1077/2151] 10.222.0.26 () {60 vars in 1483 bytes} [Wed Aug 24 05:46:57 2022] PUT /identity/v3/projects/406f1a7e25254dca9626de39969f0943/users/f71fa47acf0149099797f4b5d3281f6d/roles/640bda0879494e60b72680ee505285f0 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:46:57.531546 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1075/2152] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:46:57 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:46:57.628019 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d38a4b0-84e2-4dcc-abdd-34411366c6f2 admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:57.630532 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-1d38a4b0-84e2-4dcc-abdd-34411366c6f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:57.710711 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d38a4b0-84e2-4dcc-abdd-34411366c6f2 admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:57.714816 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4b081d-8cf6-42b0-ada4-03030680bca1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17b450afe795495680fc70f522c83750', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:57.716082 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4b081d-8cf6-42b0-ada4-03030680bca1 service cinder] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:57.716419 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4b081d-8cf6-42b0-ada4-03030680bca1 service cinder] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:57.716655 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4b081d-8cf6-42b0-ada4-03030680bca1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:57.802707 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4b081d-8cf6-42b0-ada4-03030680bca1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:57.805385 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4b081d-8cf6-42b0-ada4-03030680bca1 service cinder] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:57.819470 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1078/2153] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 24 05:46:57 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:46:57.838492 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15753f74-04ca-4306-afe2-a36a25ffb003 None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:57.858568 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15753f74-04ca-4306-afe2-a36a25ffb003 None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:58.000417 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165aeb66-d892-4724-bad1-c376dd019b69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:58.001355 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165aeb66-d892-4724-bad1-c376dd019b69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:58.002533 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165aeb66-d892-4724-bad1-c376dd019b69 admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:58.003280 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165aeb66-d892-4724-bad1-c376dd019b69 admin admin] PATH_INFO: `/v3/users/4fc964277b8046b79bdf6c3dd0a70ca2` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:58.008226 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165aeb66-d892-4724-bad1-c376dd019b69 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4fc964277b8046b79bdf6c3dd0a70ca2)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:58.013816 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165aeb66-d892-4724-bad1-c376dd019b69 admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:58.120129 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-165aeb66-d892-4724-bad1-c376dd019b69 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4fc964277b8046b79bdf6c3dd0a70ca2'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:58.129942 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-165aeb66-d892-4724-bad1-c376dd019b69 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4fc964277b8046b79bdf6c3dd0a70ca2'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:58.131458 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-165aeb66-d892-4724-bad1-c376dd019b69 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4fc964277b8046b79bdf6c3dd0a70ca2'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:58.142948 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:46:58.154144 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-165aeb66-d892-4724-bad1-c376dd019b69 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4fc964277b8046b79bdf6c3dd0a70ca2'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:58.171670 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-165aeb66-d892-4724-bad1-c376dd019b69 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4fc964277b8046b79bdf6c3dd0a70ca2'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:58.187038 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1076/2154] 10.222.0.26 () {58 vars in 1224 bytes} [Wed Aug 24 05:46:57 2022] DELETE /identity/v3/users/4fc964277b8046b79bdf6c3dd0a70ca2 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:46:58.192066 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2875a60f-25b7-4616-9cd2-c95e10973c39 None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:58.192420 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2875a60f-25b7-4616-9cd2-c95e10973c39 None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:58.192762 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2875a60f-25b7-4616-9cd2-c95e10973c39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:58.221503 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-2875a60f-25b7-4616-9cd2-c95e10973c39 None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:46:58.223801 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-2875a60f-25b7-4616-9cd2-c95e10973c39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:58.341424 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1079/2155] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:46:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:46:58.350894 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165aeb66-d892-4724-bad1-c376dd019b69 admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:58.352535 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-165aeb66-d892-4724-bad1-c376dd019b69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:58.459043 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165aeb66-d892-4724-bad1-c376dd019b69 admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:58.473904 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78539c14-6c67-4e95-b673-579ca8381730 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '874348b647194ac2b5ecbf12c33bf59e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:58.477209 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78539c14-6c67-4e95-b673-579ca8381730 service neutron] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:58.477456 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78539c14-6c67-4e95-b673-579ca8381730 service neutron] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:58.477717 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78539c14-6c67-4e95-b673-579ca8381730 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:58.529703 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78539c14-6c67-4e95-b673-579ca8381730 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:58.532506 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78539c14-6c67-4e95-b673-579ca8381730 service neutron] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:58.556863 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1077/2156] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 24 05:46:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:46:58.924734 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2875a60f-25b7-4616-9cd2-c95e10973c39 None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:58.926408 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-2875a60f-25b7-4616-9cd2-c95e10973c39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:58.940781 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2875a60f-25b7-4616-9cd2-c95e10973c39 None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:58.945408 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a124cb-d3b4-4aa6-bd2c-ba0fd5633c28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:58.946105 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a124cb-d3b4-4aa6-bd2c-ba0fd5633c28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:58.946395 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a124cb-d3b4-4aa6-bd2c-ba0fd5633c28 admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:58.946672 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a124cb-d3b4-4aa6-bd2c-ba0fd5633c28 admin admin] PATH_INFO: `/v3/projects/e351dcaef9ed4c54a53d49dbb53dadc1` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:58.948249 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a124cb-d3b4-4aa6-bd2c-ba0fd5633c28 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e351dcaef9ed4c54a53d49dbb53dadc1)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:58.950436 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a124cb-d3b4-4aa6-bd2c-ba0fd5633c28 admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:58.952156 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:46:59.037935 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-45a124cb-d3b4-4aa6-bd2c-ba0fd5633c28 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e351dcaef9ed4c54a53d49dbb53dadc1', 'request_id': 'req-45a124cb-d3b4-4aa6-bd2c-ba0fd5633c28'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:59.051805 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-45a124cb-d3b4-4aa6-bd2c-ba0fd5633c28 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e351dcaef9ed4c54a53d49dbb53dadc1', 'request_id': 'req-45a124cb-d3b4-4aa6-bd2c-ba0fd5633c28'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:59.063189 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-45a124cb-d3b4-4aa6-bd2c-ba0fd5633c28 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e351dcaef9ed4c54a53d49dbb53dadc1', 'request_id': 'req-45a124cb-d3b4-4aa6-bd2c-ba0fd5633c28'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:59.082520 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-45a124cb-d3b4-4aa6-bd2c-ba0fd5633c28 admin admin] The token cache is being invalidate because project e351dcaef9ed4c54a53d49dbb53dadc1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88112) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:46:59.083191 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-45a124cb-d3b4-4aa6-bd2c-ba0fd5633c28 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:59.083688 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-45a124cb-d3b4-4aa6-bd2c-ba0fd5633c28 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:46:59.089391 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1080/2157] 10.222.0.26 () {58 vars in 1233 bytes} [Wed Aug 24 05:46:58 2022] DELETE /identity/v3/projects/e351dcaef9ed4c54a53d49dbb53dadc1 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:46:59.091043 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c399f256-6f1a-42f1-b60d-46a96b88c0c3 None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:59.091293 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c399f256-6f1a-42f1-b60d-46a96b88c0c3 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:59.091586 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c399f256-6f1a-42f1-b60d-46a96b88c0c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:59.122299 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-c399f256-6f1a-42f1-b60d-46a96b88c0c3 None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:46:59.124256 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-c399f256-6f1a-42f1-b60d-46a96b88c0c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:59.125984 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a25175-3070-4301-8799-a3e40ce84697 None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:59.126334 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a25175-3070-4301-8799-a3e40ce84697 None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:59.126622 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a25175-3070-4301-8799-a3e40ce84697 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:59.166960 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-94a25175-3070-4301-8799-a3e40ce84697 None None] MFA Rules not processed for user `f71fa47acf0149099797f4b5d3281f6d`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:46:59.168714 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-94a25175-3070-4301-8799-a3e40ce84697 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:59.286591 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1078/2158] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:46:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:46:59.294839 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61f4b89-e706-4639-b4c3-8e0f2836b845 None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:59.295145 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61f4b89-e706-4639-b4c3-8e0f2836b845 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:59.295429 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61f4b89-e706-4639-b4c3-8e0f2836b845 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:59.337913 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1081/2159] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:46:59 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:46:59.338167 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-e61f4b89-e706-4639-b4c3-8e0f2836b845 None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:46:59.338167 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-e61f4b89-e706-4639-b4c3-8e0f2836b845 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:59.339549 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c3c35d-52d8-4b99-9bf2-7e3f880d28f2 None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:59.339842 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c3c35d-52d8-4b99-9bf2-7e3f880d28f2 None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:59.340183 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c3c35d-52d8-4b99-9bf2-7e3f880d28f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:59.364114 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1079/2160] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:46:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:46:59.369855 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61f4b89-e706-4639-b4c3-8e0f2836b845 None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:59.375813 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-c2c3c35d-52d8-4b99-9bf2-7e3f880d28f2 None None] MFA Rules not processed for user `b0126aa8d30a4cb3b8a790679ef7391b`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:46:59.377989 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-c2c3c35d-52d8-4b99-9bf2-7e3f880d28f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:59.386208 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61f4b89-e706-4639-b4c3-8e0f2836b845 None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:59.391556 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb50995-6581-4cb4-9dc6-039ac1637ce6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:59.392173 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb50995-6581-4cb4-9dc6-039ac1637ce6 admin admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:59.392457 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb50995-6581-4cb4-9dc6-039ac1637ce6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:59.392734 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb50995-6581-4cb4-9dc6-039ac1637ce6 admin admin] PATH_INFO: `/v3/domains` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:59.393415 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb50995-6581-4cb4-9dc6-039ac1637ce6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:46:59.393725 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb50995-6581-4cb4-9dc6-039ac1637ce6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:59.395575 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb50995-6581-4cb4-9dc6-039ac1637ce6 admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:59.417079 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1080/2161] 10.222.0.26 () {58 vars in 1153 bytes} [Wed Aug 24 05:46:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:46:59.418723 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb50995-6581-4cb4-9dc6-039ac1637ce6 admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:59.434420 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb50995-6581-4cb4-9dc6-039ac1637ce6 admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:59.441337 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8cb15f-8822-4197-a6e3-da96ead60f9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:59.442510 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8cb15f-8822-4197-a6e3-da96ead60f9c admin admin] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:59.442694 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8cb15f-8822-4197-a6e3-da96ead60f9c admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:59.442976 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8cb15f-8822-4197-a6e3-da96ead60f9c admin admin] PATH_INFO: `/v3/projects` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:59.443661 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8cb15f-8822-4197-a6e3-da96ead60f9c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:59.445969 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8cb15f-8822-4197-a6e3-da96ead60f9c admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:59.481811 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1082/2162] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:46:59 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 05:46:59.494485 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c3c35d-52d8-4b99-9bf2-7e3f880d28f2 None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:59.497079 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-c2c3c35d-52d8-4b99-9bf2-7e3f880d28f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:59.523446 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1081/2163] 10.222.0.26 () {60 vars in 1153 bytes} [Wed Aug 24 05:46:59 2022] POST /identity/v3/projects => generated 377 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 05:46:59.524608 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8cb15f-8822-4197-a6e3-da96ead60f9c admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:59.549637 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:46:59.608046 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:46:59.634047 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8cb15f-8822-4197-a6e3-da96ead60f9c admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:59.646917 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0c0f13-7594-4b35-bf60-43b1f639f18d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:59.647689 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0c0f13-7594-4b35-bf60-43b1f639f18d admin admin] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:59.648101 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0c0f13-7594-4b35-bf60-43b1f639f18d admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:59.648789 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0c0f13-7594-4b35-bf60-43b1f639f18d admin admin] PATH_INFO: `/v3/users` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:59.650451 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0c0f13-7594-4b35-bf60-43b1f639f18d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:59.655349 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0c0f13-7594-4b35-bf60-43b1f639f18d admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:59.690180 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1082/2164] 10.222.0.26 () {60 vars in 1144 bytes} [Wed Aug 24 05:46:59 2022] POST /identity/v3/users => generated 289 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:46:59.691286 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0c0f13-7594-4b35-bf60-43b1f639f18d admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:59.708489 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0c0f13-7594-4b35-bf60-43b1f639f18d admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:59.724801 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929c023d-a9b3-4e3d-b715-68227405a43d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:59.725434 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929c023d-a9b3-4e3d-b715-68227405a43d admin admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:59.725862 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929c023d-a9b3-4e3d-b715-68227405a43d admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:59.726181 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929c023d-a9b3-4e3d-b715-68227405a43d admin admin] PATH_INFO: `/v3/roles` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:59.726913 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929c023d-a9b3-4e3d-b715-68227405a43d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:59.728459 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929c023d-a9b3-4e3d-b715-68227405a43d admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:59.740547 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c3c35d-52d8-4b99-9bf2-7e3f880d28f2 None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:59.745767 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1083/2165] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Aug 24 05:46:59 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:46:59.747634 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929c023d-a9b3-4e3d-b715-68227405a43d admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:59.759838 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929c023d-a9b3-4e3d-b715-68227405a43d admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:59.776886 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a98013a-0a8a-4aa2-b090-8d397fac4a25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:59.777512 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a98013a-0a8a-4aa2-b090-8d397fac4a25 admin admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:59.778360 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a98013a-0a8a-4aa2-b090-8d397fac4a25 admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:59.778636 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a98013a-0a8a-4aa2-b090-8d397fac4a25 admin admin] PATH_INFO: `/v3/roles` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:59.779293 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a98013a-0a8a-4aa2-b090-8d397fac4a25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:59.781106 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a98013a-0a8a-4aa2-b090-8d397fac4a25 admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:59.810617 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1084/2166] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Aug 24 05:46:59 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:46:59.814835 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a98013a-0a8a-4aa2-b090-8d397fac4a25 admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:46:59.840799 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a98013a-0a8a-4aa2-b090-8d397fac4a25 admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:46:59.848473 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb2a87c-82de-4394-846d-3ea6f7ba1dba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:59.849719 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb2a87c-82de-4394-846d-3ea6f7ba1dba admin admin] REQUEST_METHOD: `PUT` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:59.850035 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb2a87c-82de-4394-846d-3ea6f7ba1dba admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:59.850319 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb2a87c-82de-4394-846d-3ea6f7ba1dba admin admin] PATH_INFO: `/v3/projects/85377e31b858446798e8825289412dbb/users/21347722a70d48c497a77e9d9073ef70/roles/f7aa4a2c74c94c1b9ca8ecdcccccda5c` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:59.911907 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb2a87c-82de-4394-846d-3ea6f7ba1dba admin admin] RBAC: Authorizing `identity:create_grant(project_id=85377e31b858446798e8825289412dbb, user_id=21347722a70d48c497a77e9d9073ef70, role_id=f7aa4a2c74c94c1b9ca8ecdcccccda5c)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:46:59.914641 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb2a87c-82de-4394-846d-3ea6f7ba1dba admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:46:59.924478 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c9db2d-bb94-46c7-8443-584164b9e1a9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b633e1aec6c4269bce13aa9c89e911a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:46:59.927087 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c9db2d-bb94-46c7-8443-584164b9e1a9 service nova] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:59.928992 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c9db2d-bb94-46c7-8443-584164b9e1a9 service nova] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:59.930269 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c9db2d-bb94-46c7-8443-584164b9e1a9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:46:59.942926 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-59c9db2d-bb94-46c7-8443-584164b9e1a9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:46:59.958240 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1085/2167] 10.222.0.26 () {60 vars in 1483 bytes} [Wed Aug 24 05:46:59 2022] PUT /identity/v3/projects/85377e31b858446798e8825289412dbb/users/21347722a70d48c497a77e9d9073ef70/roles/f7aa4a2c74c94c1b9ca8ecdcccccda5c => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:46:59.972380 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01205410-0cf5-4d61-bfdb-f3d604d231ea None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:46:59.974641 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01205410-0cf5-4d61-bfdb-f3d604d231ea None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:46:59.975121 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01205410-0cf5-4d61-bfdb-f3d604d231ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:00.059364 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-01205410-0cf5-4d61-bfdb-f3d604d231ea None None] MFA Rules not processed for user `21347722a70d48c497a77e9d9073ef70`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:47:00.060654 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-01205410-0cf5-4d61-bfdb-f3d604d231ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:47:00.076559 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c9db2d-bb94-46c7-8443-584164b9e1a9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:00.078545 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c9db2d-bb94-46c7-8443-584164b9e1a9 service nova] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:00.102081 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1083/2168] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 24 05:46:59 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 608 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:47:00.234185 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c9db2d-bb94-46c7-8443-584164b9e1a9 service nova] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:00.235395 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1086/2169] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:46:59 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:47:00.258253 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c9db2d-bb94-46c7-8443-584164b9e1a9 service nova] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:00.330334 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:47:00.343027 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bde243-6232-44ee-b682-a4555637ff71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:00.343770 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bde243-6232-44ee-b682-a4555637ff71 admin admin] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:00.344120 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bde243-6232-44ee-b682-a4555637ff71 admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:00.344478 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bde243-6232-44ee-b682-a4555637ff71 admin admin] PATH_INFO: `/v3/projects` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:00.345181 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bde243-6232-44ee-b682-a4555637ff71 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:00.347396 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bde243-6232-44ee-b682-a4555637ff71 admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:00.391358 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1084/2170] 10.222.0.26 () {60 vars in 1153 bytes} [Wed Aug 24 05:47:00 2022] POST /identity/v3/projects => generated 377 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 05:47:00.395120 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01205410-0cf5-4d61-bfdb-f3d604d231ea None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:00.424832 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01205410-0cf5-4d61-bfdb-f3d604d231ea None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:00.518035 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fdef90-f6bc-4cd2-aedb-9b06dca5dcb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:00.518742 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fdef90-f6bc-4cd2-aedb-9b06dca5dcb3 admin admin] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:00.519020 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fdef90-f6bc-4cd2-aedb-9b06dca5dcb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:00.519289 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fdef90-f6bc-4cd2-aedb-9b06dca5dcb3 admin admin] PATH_INFO: `/v3/users` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:00.519929 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fdef90-f6bc-4cd2-aedb-9b06dca5dcb3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:00.522017 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fdef90-f6bc-4cd2-aedb-9b06dca5dcb3 admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:00.555850 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1087/2171] 10.222.0.26 () {60 vars in 1144 bytes} [Wed Aug 24 05:47:00 2022] POST /identity/v3/users => generated 289 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:47:00.557326 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bde243-6232-44ee-b682-a4555637ff71 admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:00.569302 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bde243-6232-44ee-b682-a4555637ff71 admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:00.575705 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884ecf20-14b8-443a-b363-409d22f33138 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:00.576477 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884ecf20-14b8-443a-b363-409d22f33138 admin admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:00.576874 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884ecf20-14b8-443a-b363-409d22f33138 admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:00.577244 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884ecf20-14b8-443a-b363-409d22f33138 admin admin] PATH_INFO: `/v3/roles` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:00.578018 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884ecf20-14b8-443a-b363-409d22f33138 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:00.579745 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884ecf20-14b8-443a-b363-409d22f33138 admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:00.591959 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1085/2172] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Aug 24 05:47:00 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:47:00.596141 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fdef90-f6bc-4cd2-aedb-9b06dca5dcb3 admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:00.606834 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fdef90-f6bc-4cd2-aedb-9b06dca5dcb3 admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:00.613607 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6b2bd9-47c9-4b55-ac10-f36ac5500664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:00.614275 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6b2bd9-47c9-4b55-ac10-f36ac5500664 admin admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:00.614552 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6b2bd9-47c9-4b55-ac10-f36ac5500664 admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:00.614824 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6b2bd9-47c9-4b55-ac10-f36ac5500664 admin admin] PATH_INFO: `/v3/roles` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:00.615482 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6b2bd9-47c9-4b55-ac10-f36ac5500664 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:00.617548 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6b2bd9-47c9-4b55-ac10-f36ac5500664 admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:00.620264 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:47:00.629534 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1088/2173] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Aug 24 05:47:00 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:47:00.633753 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884ecf20-14b8-443a-b363-409d22f33138 admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:00.644842 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884ecf20-14b8-443a-b363-409d22f33138 admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:00.649552 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c199865a-b72b-4439-b0e9-df55444f7279 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:00.650317 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c199865a-b72b-4439-b0e9-df55444f7279 admin admin] REQUEST_METHOD: `PUT` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:00.650664 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c199865a-b72b-4439-b0e9-df55444f7279 admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:00.651003 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c199865a-b72b-4439-b0e9-df55444f7279 admin admin] PATH_INFO: `/v3/projects/eb8f51e63f69489e8444c75f3a64643e/users/119ec4e07ca84b63b7aa1ee2186d46c3/roles/f7aa4a2c74c94c1b9ca8ecdcccccda5c` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:00.667525 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c199865a-b72b-4439-b0e9-df55444f7279 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb8f51e63f69489e8444c75f3a64643e, user_id=119ec4e07ca84b63b7aa1ee2186d46c3, role_id=f7aa4a2c74c94c1b9ca8ecdcccccda5c)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:00.670647 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c199865a-b72b-4439-b0e9-df55444f7279 admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:00.687054 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1086/2174] 10.222.0.26 () {60 vars in 1483 bytes} [Wed Aug 24 05:47:00 2022] PUT /identity/v3/projects/eb8f51e63f69489e8444c75f3a64643e/users/119ec4e07ca84b63b7aa1ee2186d46c3/roles/f7aa4a2c74c94c1b9ca8ecdcccccda5c => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:47:00.698588 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709cd53b-3ec9-4abc-bdc3-56b51b524533 None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:00.698958 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709cd53b-3ec9-4abc-bdc3-56b51b524533 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:00.699300 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709cd53b-3ec9-4abc-bdc3-56b51b524533 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:00.729620 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-709cd53b-3ec9-4abc-bdc3-56b51b524533 None None] MFA Rules not processed for user `119ec4e07ca84b63b7aa1ee2186d46c3`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:47:00.730896 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-709cd53b-3ec9-4abc-bdc3-56b51b524533 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:47:00.804877 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1089/2175] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:47:00 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:47:00.809735 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c199865a-b72b-4439-b0e9-df55444f7279 admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:00.897466 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c199865a-b72b-4439-b0e9-df55444f7279 admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:00.903840 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2585a7-b050-4168-987b-a21c208881d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:00.904720 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2585a7-b050-4168-987b-a21c208881d3 admin admin] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:00.905096 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2585a7-b050-4168-987b-a21c208881d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:00.905589 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2585a7-b050-4168-987b-a21c208881d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:00.906533 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2585a7-b050-4168-987b-a21c208881d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:00.909825 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2585a7-b050-4168-987b-a21c208881d3 admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:00.945720 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1087/2176] 10.222.0.26 () {60 vars in 1153 bytes} [Wed Aug 24 05:47:00 2022] POST /identity/v3/projects => generated 377 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:47:00.947256 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709cd53b-3ec9-4abc-bdc3-56b51b524533 None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:00.961868 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709cd53b-3ec9-4abc-bdc3-56b51b524533 None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:01.034691 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96aaf5e0-b900-4bd5-91e7-07d3c2535be2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:01.035262 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96aaf5e0-b900-4bd5-91e7-07d3c2535be2 admin admin] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:01.035545 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96aaf5e0-b900-4bd5-91e7-07d3c2535be2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:01.035827 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96aaf5e0-b900-4bd5-91e7-07d3c2535be2 admin admin] PATH_INFO: `/v3/users` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:01.036642 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96aaf5e0-b900-4bd5-91e7-07d3c2535be2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:01.038614 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96aaf5e0-b900-4bd5-91e7-07d3c2535be2 admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:01.070117 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1090/2177] 10.222.0.26 () {60 vars in 1144 bytes} [Wed Aug 24 05:47:00 2022] POST /identity/v3/users => generated 295 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:47:01.073168 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2585a7-b050-4168-987b-a21c208881d3 admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:01.084573 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2585a7-b050-4168-987b-a21c208881d3 admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:01.099212 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d630bdf-0791-4439-9a3b-4c3a01bb501e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:01.099212 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d630bdf-0791-4439-9a3b-4c3a01bb501e admin admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:01.099212 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d630bdf-0791-4439-9a3b-4c3a01bb501e admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:01.099212 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d630bdf-0791-4439-9a3b-4c3a01bb501e admin admin] PATH_INFO: `/v3/roles` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:01.100046 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d630bdf-0791-4439-9a3b-4c3a01bb501e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:01.100046 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d630bdf-0791-4439-9a3b-4c3a01bb501e admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:01.116919 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1088/2178] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Aug 24 05:47:01 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 05:47:01.124088 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96aaf5e0-b900-4bd5-91e7-07d3c2535be2 admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:01.134912 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96aaf5e0-b900-4bd5-91e7-07d3c2535be2 admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:01.143409 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e970ea0-277b-41c6-bd64-af1bd5d69694 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:01.144597 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e970ea0-277b-41c6-bd64-af1bd5d69694 admin admin] REQUEST_METHOD: `PUT` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:01.145003 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e970ea0-277b-41c6-bd64-af1bd5d69694 admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:01.145432 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e970ea0-277b-41c6-bd64-af1bd5d69694 admin admin] PATH_INFO: `/v3/projects/10ef258948214879a666e7f7f2aa0ad0/users/2d2cb3c02bac4e639f64555b0c138c16/roles/640bda0879494e60b72680ee505285f0` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:01.165183 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e970ea0-277b-41c6-bd64-af1bd5d69694 admin admin] RBAC: Authorizing `identity:create_grant(project_id=10ef258948214879a666e7f7f2aa0ad0, user_id=2d2cb3c02bac4e639f64555b0c138c16, role_id=640bda0879494e60b72680ee505285f0)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:01.168271 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e970ea0-277b-41c6-bd64-af1bd5d69694 admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:01.193008 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1091/2179] 10.222.0.26 () {60 vars in 1483 bytes} [Wed Aug 24 05:47:01 2022] PUT /identity/v3/projects/10ef258948214879a666e7f7f2aa0ad0/users/2d2cb3c02bac4e639f64555b0c138c16/roles/640bda0879494e60b72680ee505285f0 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:47:01.194004 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d630bdf-0791-4439-9a3b-4c3a01bb501e admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:01.215725 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d630bdf-0791-4439-9a3b-4c3a01bb501e admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:01.283291 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc27717-cd33-4747-87be-493285b56213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:01.284005 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc27717-cd33-4747-87be-493285b56213 admin admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:01.284494 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc27717-cd33-4747-87be-493285b56213 admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:01.284494 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc27717-cd33-4747-87be-493285b56213 admin admin] PATH_INFO: `/v3/roles` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:01.285089 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc27717-cd33-4747-87be-493285b56213 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:01.287350 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc27717-cd33-4747-87be-493285b56213 admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:01.302548 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1089/2180] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Aug 24 05:47:01 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:47:01.306433 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e970ea0-277b-41c6-bd64-af1bd5d69694 admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:01.320966 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e970ea0-277b-41c6-bd64-af1bd5d69694 admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:01.336724 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a20bb26-0f86-4d90-bc63-9d5cdaa0c72f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:01.337741 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a20bb26-0f86-4d90-bc63-9d5cdaa0c72f admin admin] REQUEST_METHOD: `PUT` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:01.338734 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a20bb26-0f86-4d90-bc63-9d5cdaa0c72f admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:01.338841 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a20bb26-0f86-4d90-bc63-9d5cdaa0c72f admin admin] PATH_INFO: `/v3/projects/10ef258948214879a666e7f7f2aa0ad0/users/2d2cb3c02bac4e639f64555b0c138c16/roles/640bda0879494e60b72680ee505285f0` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:01.341678 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a20bb26-0f86-4d90-bc63-9d5cdaa0c72f admin admin] RBAC: Authorizing `identity:create_grant(project_id=10ef258948214879a666e7f7f2aa0ad0, user_id=2d2cb3c02bac4e639f64555b0c138c16, role_id=640bda0879494e60b72680ee505285f0)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:01.345897 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a20bb26-0f86-4d90-bc63-9d5cdaa0c72f admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:01.374474 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1092/2181] 10.222.0.26 () {60 vars in 1483 bytes} [Wed Aug 24 05:47:01 2022] PUT /identity/v3/projects/10ef258948214879a666e7f7f2aa0ad0/users/2d2cb3c02bac4e639f64555b0c138c16/roles/640bda0879494e60b72680ee505285f0 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 05:47:01.379328 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb10e64-d494-4145-a81b-873641408743 None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:01.379648 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb10e64-d494-4145-a81b-873641408743 None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:01.379928 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb10e64-d494-4145-a81b-873641408743 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:01.420070 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-afb10e64-d494-4145-a81b-873641408743 None None] MFA Rules not processed for user `2d2cb3c02bac4e639f64555b0c138c16`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:47:01.421572 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-afb10e64-d494-4145-a81b-873641408743 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:47:01.431256 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:47:01.451466 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a20bb26-0f86-4d90-bc63-9d5cdaa0c72f admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:01.456080 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-8a20bb26-0f86-4d90-bc63-9d5cdaa0c72f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:47:01.556415 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:47:01.579771 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1090/2182] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:47:01 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:47:01.596015 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb10e64-d494-4145-a81b-873641408743 None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:01.598440 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-afb10e64-d494-4145-a81b-873641408743 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:47:01.606723 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a20bb26-0f86-4d90-bc63-9d5cdaa0c72f admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:01.614896 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4df5588-8d37-4194-af53-c2c92ba55d22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:01.615670 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4df5588-8d37-4194-af53-c2c92ba55d22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:01.615968 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4df5588-8d37-4194-af53-c2c92ba55d22 admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:01.616307 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4df5588-8d37-4194-af53-c2c92ba55d22 admin admin] PATH_INFO: `/v3/users/94b2007139a14dbc81aebf93382e2818` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:01.617594 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4df5588-8d37-4194-af53-c2c92ba55d22 admin admin] RBAC: Authorizing `identity:delete_user(user_id=94b2007139a14dbc81aebf93382e2818)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:01.619857 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4df5588-8d37-4194-af53-c2c92ba55d22 admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:01.692072 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb10e64-d494-4145-a81b-873641408743 None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:01.696568 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907b64d6-9ae6-470a-93b1-514b6c390844 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17b450afe795495680fc70f522c83750', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:01.697994 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907b64d6-9ae6-470a-93b1-514b6c390844 service cinder] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:01.698565 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907b64d6-9ae6-470a-93b1-514b6c390844 service cinder] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:01.698932 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907b64d6-9ae6-470a-93b1-514b6c390844 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:01.735387 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-c4df5588-8d37-4194-af53-c2c92ba55d22 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '94b2007139a14dbc81aebf93382e2818'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:01.754405 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-c4df5588-8d37-4194-af53-c2c92ba55d22 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '94b2007139a14dbc81aebf93382e2818'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:01.755155 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-c4df5588-8d37-4194-af53-c2c92ba55d22 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '94b2007139a14dbc81aebf93382e2818'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:01.779066 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-c4df5588-8d37-4194-af53-c2c92ba55d22 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '94b2007139a14dbc81aebf93382e2818'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:01.791276 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-c4df5588-8d37-4194-af53-c2c92ba55d22 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '94b2007139a14dbc81aebf93382e2818'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:01.805625 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1093/2183] 10.222.0.26 () {58 vars in 1224 bytes} [Wed Aug 24 05:47:01 2022] DELETE /identity/v3/users/94b2007139a14dbc81aebf93382e2818 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:47:01.816765 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97f3099-b41e-49a5-aa76-6278c628420c None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:01.817325 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97f3099-b41e-49a5-aa76-6278c628420c None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:01.817996 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97f3099-b41e-49a5-aa76-6278c628420c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:01.822098 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907b64d6-9ae6-470a-93b1-514b6c390844 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:01.824814 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907b64d6-9ae6-470a-93b1-514b6c390844 service cinder] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:01.836829 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1091/2184] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 24 05:47:01 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 05:47:01.850965 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-d97f3099-b41e-49a5-aa76-6278c628420c None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:47:01.852212 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-d97f3099-b41e-49a5-aa76-6278c628420c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:47:01.919648 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1094/2185] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:47:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 05:47:01.931673 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907b64d6-9ae6-470a-93b1-514b6c390844 service cinder] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:01.933093 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-907b64d6-9ae6-470a-93b1-514b6c390844 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:47:02.007215 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907b64d6-9ae6-470a-93b1-514b6c390844 service cinder] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:02.018482 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:47:02.064110 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7c2ba8-a21a-49c6-a87b-d6cbfa7394a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '874348b647194ac2b5ecbf12c33bf59e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:02.064761 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7c2ba8-a21a-49c6-a87b-d6cbfa7394a8 service neutron] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:02.065043 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7c2ba8-a21a-49c6-a87b-d6cbfa7394a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:02.065318 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7c2ba8-a21a-49c6-a87b-d6cbfa7394a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:02.076886 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7c2ba8-a21a-49c6-a87b-d6cbfa7394a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:02.078570 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7c2ba8-a21a-49c6-a87b-d6cbfa7394a8 service neutron] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:02.088990 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1092/2186] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 24 05:47:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:47:02.463734 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97f3099-b41e-49a5-aa76-6278c628420c None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:02.465189 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-d97f3099-b41e-49a5-aa76-6278c628420c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:47:02.478929 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97f3099-b41e-49a5-aa76-6278c628420c None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:02.484985 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9181777a-611f-4c91-8fdf-74adf5c894b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:02.485621 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9181777a-611f-4c91-8fdf-74adf5c894b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:02.485900 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9181777a-611f-4c91-8fdf-74adf5c894b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:02.486231 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9181777a-611f-4c91-8fdf-74adf5c894b8 admin admin] PATH_INFO: `/v3/projects/29411794870d4ec6b31ee7fb4ec707de` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:02.487322 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9181777a-611f-4c91-8fdf-74adf5c894b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=29411794870d4ec6b31ee7fb4ec707de)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:02.489247 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9181777a-611f-4c91-8fdf-74adf5c894b8 admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:02.552016 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-9181777a-611f-4c91-8fdf-74adf5c894b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '29411794870d4ec6b31ee7fb4ec707de', 'request_id': 'req-9181777a-611f-4c91-8fdf-74adf5c894b8'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:02.556217 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:47:02.565694 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-9181777a-611f-4c91-8fdf-74adf5c894b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '29411794870d4ec6b31ee7fb4ec707de', 'request_id': 'req-9181777a-611f-4c91-8fdf-74adf5c894b8'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:02.578872 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-9181777a-611f-4c91-8fdf-74adf5c894b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '29411794870d4ec6b31ee7fb4ec707de', 'request_id': 'req-9181777a-611f-4c91-8fdf-74adf5c894b8'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:02.594500 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-9181777a-611f-4c91-8fdf-74adf5c894b8 admin admin] The token cache is being invalidate because project 29411794870d4ec6b31ee7fb4ec707de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:47:02.594817 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-9181777a-611f-4c91-8fdf-74adf5c894b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:02.595744 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-9181777a-611f-4c91-8fdf-74adf5c894b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:02.597355 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1095/2187] 10.222.0.26 () {58 vars in 1233 bytes} [Wed Aug 24 05:47:02 2022] DELETE /identity/v3/projects/29411794870d4ec6b31ee7fb4ec707de => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:47:02.601357 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7c2ba8-a21a-49c6-a87b-d6cbfa7394a8 service neutron] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:02.611996 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7c2ba8-a21a-49c6-a87b-d6cbfa7394a8 service neutron] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:02.677161 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4523ee2-1508-4213-8ff5-fdd3cb7a80cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:02.677817 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4523ee2-1508-4213-8ff5-fdd3cb7a80cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:02.678546 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4523ee2-1508-4213-8ff5-fdd3cb7a80cf admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:02.678546 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4523ee2-1508-4213-8ff5-fdd3cb7a80cf admin admin] PATH_INFO: `/v3/users/832c626515394400a80e451024d7e96a` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:02.679515 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4523ee2-1508-4213-8ff5-fdd3cb7a80cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=832c626515394400a80e451024d7e96a)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:02.681457 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4523ee2-1508-4213-8ff5-fdd3cb7a80cf admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:02.730668 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-c4523ee2-1508-4213-8ff5-fdd3cb7a80cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '832c626515394400a80e451024d7e96a'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:02.737666 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-c4523ee2-1508-4213-8ff5-fdd3cb7a80cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '832c626515394400a80e451024d7e96a'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:02.757458 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-c4523ee2-1508-4213-8ff5-fdd3cb7a80cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '832c626515394400a80e451024d7e96a'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:02.765709 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-c4523ee2-1508-4213-8ff5-fdd3cb7a80cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '832c626515394400a80e451024d7e96a'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:02.766375 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-c4523ee2-1508-4213-8ff5-fdd3cb7a80cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '832c626515394400a80e451024d7e96a'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:02.773074 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1093/2188] 10.222.0.26 () {58 vars in 1224 bytes} [Wed Aug 24 05:47:02 2022] DELETE /identity/v3/users/832c626515394400a80e451024d7e96a => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:47:03.147020 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9181777a-611f-4c91-8fdf-74adf5c894b8 admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:03.151275 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-9181777a-611f-4c91-8fdf-74adf5c894b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:47:03.171038 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9181777a-611f-4c91-8fdf-74adf5c894b8 admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:03.244847 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dae59f-a5a8-4b34-b991-a80804a95ee7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:03.245514 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dae59f-a5a8-4b34-b991-a80804a95ee7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:03.245793 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dae59f-a5a8-4b34-b991-a80804a95ee7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:03.246198 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dae59f-a5a8-4b34-b991-a80804a95ee7 admin admin] PATH_INFO: `/v3/projects/1d724bc895a94267b0b9046bc82d7892` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:03.247323 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28dae59f-a5a8-4b34-b991-a80804a95ee7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d724bc895a94267b0b9046bc82d7892)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:03.249411 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28dae59f-a5a8-4b34-b991-a80804a95ee7 admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:03.325544 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-28dae59f-a5a8-4b34-b991-a80804a95ee7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d724bc895a94267b0b9046bc82d7892', 'request_id': 'req-28dae59f-a5a8-4b34-b991-a80804a95ee7'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:03.334689 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-28dae59f-a5a8-4b34-b991-a80804a95ee7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d724bc895a94267b0b9046bc82d7892', 'request_id': 'req-28dae59f-a5a8-4b34-b991-a80804a95ee7'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:03.345043 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-28dae59f-a5a8-4b34-b991-a80804a95ee7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d724bc895a94267b0b9046bc82d7892', 'request_id': 'req-28dae59f-a5a8-4b34-b991-a80804a95ee7'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:03.365666 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-28dae59f-a5a8-4b34-b991-a80804a95ee7 admin admin] The token cache is being invalidate because project 1d724bc895a94267b0b9046bc82d7892 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:47:03.366136 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-28dae59f-a5a8-4b34-b991-a80804a95ee7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:03.366941 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-28dae59f-a5a8-4b34-b991-a80804a95ee7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:03.369856 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1096/2189] 10.222.0.26 () {58 vars in 1233 bytes} [Wed Aug 24 05:47:03 2022] DELETE /identity/v3/projects/1d724bc895a94267b0b9046bc82d7892 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:47:03.374882 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7e0438-9f71-435f-84c7-370e8c4e366d None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:03.375396 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7e0438-9f71-435f-84c7-370e8c4e366d None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:03.375826 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7e0438-9f71-435f-84c7-370e8c4e366d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:03.400702 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-fe7e0438-9f71-435f-84c7-370e8c4e366d None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:47:03.402047 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-fe7e0438-9f71-435f-84c7-370e8c4e366d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:47:03.441461 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:47:03.486911 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1094/2190] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:47:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:47:03.495316 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf5c787-2d99-4ec5-8f34-cc053da53d3e None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:03.496363 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf5c787-2d99-4ec5-8f34-cc053da53d3e None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:03.496912 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf5c787-2d99-4ec5-8f34-cc053da53d3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:03.535685 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-ddf5c787-2d99-4ec5-8f34-cc053da53d3e None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:47:03.537674 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-ddf5c787-2d99-4ec5-8f34-cc053da53d3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:47:03.557992 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1097/2191] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:47:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 05:47:03.560928 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7e0438-9f71-435f-84c7-370e8c4e366d None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:03.568353 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf5c787-2d99-4ec5-8f34-cc053da53d3e None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:03.570306 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-ddf5c787-2d99-4ec5-8f34-cc053da53d3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:47:03.574957 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7e0438-9f71-435f-84c7-370e8c4e366d None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:03.580265 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dab20b-7d9a-444b-ad75-c2de9a26a629 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:03.581118 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dab20b-7d9a-444b-ad75-c2de9a26a629 admin admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:03.581600 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dab20b-7d9a-444b-ad75-c2de9a26a629 admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:03.582200 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dab20b-7d9a-444b-ad75-c2de9a26a629 admin admin] PATH_INFO: `/v3/domains` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:03.583043 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39dab20b-7d9a-444b-ad75-c2de9a26a629 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:47:03.583559 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39dab20b-7d9a-444b-ad75-c2de9a26a629 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:03.585348 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39dab20b-7d9a-444b-ad75-c2de9a26a629 admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:03.599531 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1095/2192] 10.222.0.26 () {58 vars in 1153 bytes} [Wed Aug 24 05:47:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:47:03.604093 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dab20b-7d9a-444b-ad75-c2de9a26a629 admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:03.615595 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dab20b-7d9a-444b-ad75-c2de9a26a629 admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:03.623552 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81ec11c-125c-4846-847d-3e5307880ce7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:03.624427 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81ec11c-125c-4846-847d-3e5307880ce7 admin admin] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:03.624713 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81ec11c-125c-4846-847d-3e5307880ce7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:03.625064 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81ec11c-125c-4846-847d-3e5307880ce7 admin admin] PATH_INFO: `/v3/projects` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:03.625789 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81ec11c-125c-4846-847d-3e5307880ce7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:03.627667 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81ec11c-125c-4846-847d-3e5307880ce7 admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:03.639418 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf5c787-2d99-4ec5-8f34-cc053da53d3e None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:03.645481 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c2f1ae-091c-4e63-b462-a30d55dc58e6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17b450afe795495680fc70f522c83750', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:03.646281 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c2f1ae-091c-4e63-b462-a30d55dc58e6 service cinder] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:03.646560 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c2f1ae-091c-4e63-b462-a30d55dc58e6 service cinder] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:03.647247 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c2f1ae-091c-4e63-b462-a30d55dc58e6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:03.649270 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-12c2f1ae-091c-4e63-b462-a30d55dc58e6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:47:03.665991 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1096/2193] 10.222.0.26 () {60 vars in 1153 bytes} [Wed Aug 24 05:47:03 2022] POST /identity/v3/projects => generated 357 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:47:03.669886 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81ec11c-125c-4846-847d-3e5307880ce7 admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:03.677779 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:47:03.739164 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c2f1ae-091c-4e63-b462-a30d55dc58e6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:03.740624 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c2f1ae-091c-4e63-b462-a30d55dc58e6 service cinder] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:03.750588 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81ec11c-125c-4846-847d-3e5307880ce7 admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:03.753187 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1098/2194] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 24 05:47:03 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 05:47:03.756182 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee8097c-e214-41c8-a615-4cb1d6efde62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:03.756927 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee8097c-e214-41c8-a615-4cb1d6efde62 admin admin] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:03.757212 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee8097c-e214-41c8-a615-4cb1d6efde62 admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:03.757484 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee8097c-e214-41c8-a615-4cb1d6efde62 admin admin] PATH_INFO: `/v3/users` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:03.758150 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee8097c-e214-41c8-a615-4cb1d6efde62 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:03.760207 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee8097c-e214-41c8-a615-4cb1d6efde62 admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:03.791042 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1097/2195] 10.222.0.26 () {60 vars in 1144 bytes} [Wed Aug 24 05:47:03 2022] POST /identity/v3/users => generated 279 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 05:47:03.792431 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c2f1ae-091c-4e63-b462-a30d55dc58e6 service cinder] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:03.805644 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c2f1ae-091c-4e63-b462-a30d55dc58e6 service cinder] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:03.810596 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abf7fe1-32e8-4d97-a2ce-587b8f090069 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:03.811203 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abf7fe1-32e8-4d97-a2ce-587b8f090069 admin admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:03.811481 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abf7fe1-32e8-4d97-a2ce-587b8f090069 admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:03.811753 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abf7fe1-32e8-4d97-a2ce-587b8f090069 admin admin] PATH_INFO: `/v3/roles` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:03.812398 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abf7fe1-32e8-4d97-a2ce-587b8f090069 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:03.814029 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abf7fe1-32e8-4d97-a2ce-587b8f090069 admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:03.832139 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1099/2196] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Aug 24 05:47:03 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:47:03.836111 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee8097c-e214-41c8-a615-4cb1d6efde62 admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:03.853033 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee8097c-e214-41c8-a615-4cb1d6efde62 admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:03.859615 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b133c2b-8bf9-4d32-a3a3-17d2f1b3c8fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:03.860238 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b133c2b-8bf9-4d32-a3a3-17d2f1b3c8fa admin admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:03.860526 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b133c2b-8bf9-4d32-a3a3-17d2f1b3c8fa admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:03.860815 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b133c2b-8bf9-4d32-a3a3-17d2f1b3c8fa admin admin] PATH_INFO: `/v3/roles` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:03.861473 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b133c2b-8bf9-4d32-a3a3-17d2f1b3c8fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:03.863736 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b133c2b-8bf9-4d32-a3a3-17d2f1b3c8fa admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:03.877644 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1098/2197] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Aug 24 05:47:03 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:47:03.882385 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abf7fe1-32e8-4d97-a2ce-587b8f090069 admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:03.897981 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abf7fe1-32e8-4d97-a2ce-587b8f090069 admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:03.905590 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73795cb-6876-41da-897d-fa0ed1e8131d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:03.906348 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73795cb-6876-41da-897d-fa0ed1e8131d admin admin] REQUEST_METHOD: `PUT` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:03.906635 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73795cb-6876-41da-897d-fa0ed1e8131d admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:03.907051 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73795cb-6876-41da-897d-fa0ed1e8131d admin admin] PATH_INFO: `/v3/projects/0604d1bb1f22453b8b5e657c1acc7428/users/f0d0a0e6e0c44e0cbff370ee92916f76/roles/f7aa4a2c74c94c1b9ca8ecdcccccda5c` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:03.927780 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73795cb-6876-41da-897d-fa0ed1e8131d admin admin] RBAC: Authorizing `identity:create_grant(project_id=0604d1bb1f22453b8b5e657c1acc7428, user_id=f0d0a0e6e0c44e0cbff370ee92916f76, role_id=f7aa4a2c74c94c1b9ca8ecdcccccda5c)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:03.930614 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73795cb-6876-41da-897d-fa0ed1e8131d admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:03.946017 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1100/2198] 10.222.0.26 () {60 vars in 1483 bytes} [Wed Aug 24 05:47:03 2022] PUT /identity/v3/projects/0604d1bb1f22453b8b5e657c1acc7428/users/f0d0a0e6e0c44e0cbff370ee92916f76/roles/f7aa4a2c74c94c1b9ca8ecdcccccda5c => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:47:03.956809 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e9a87a-2c18-42d3-9c5e-3182ad7d20e0 None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:03.957098 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e9a87a-2c18-42d3-9c5e-3182ad7d20e0 None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:03.957374 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e9a87a-2c18-42d3-9c5e-3182ad7d20e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:03.986358 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-37e9a87a-2c18-42d3-9c5e-3182ad7d20e0 None None] MFA Rules not processed for user `f0d0a0e6e0c44e0cbff370ee92916f76`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:47:03.987639 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-37e9a87a-2c18-42d3-9c5e-3182ad7d20e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:47:04.079249 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1099/2199] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:47:03 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:47:04.084036 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73795cb-6876-41da-897d-fa0ed1e8131d admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:04.169201 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73795cb-6876-41da-897d-fa0ed1e8131d admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:04.176343 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5c9a29-7367-4509-beca-17cd10023205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:04.177038 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5c9a29-7367-4509-beca-17cd10023205 admin admin] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:04.177388 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5c9a29-7367-4509-beca-17cd10023205 admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:04.177664 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5c9a29-7367-4509-beca-17cd10023205 admin admin] PATH_INFO: `/v3/projects` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:04.178507 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5c9a29-7367-4509-beca-17cd10023205 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:04.184199 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5c9a29-7367-4509-beca-17cd10023205 admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:04.227470 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1101/2200] 10.222.0.26 () {60 vars in 1153 bytes} [Wed Aug 24 05:47:04 2022] POST /identity/v3/projects => generated 355 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 05:47:04.232911 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e9a87a-2c18-42d3-9c5e-3182ad7d20e0 None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:04.247738 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e9a87a-2c18-42d3-9c5e-3182ad7d20e0 None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:04.252745 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:47:04.403518 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3041ce11-85b1-4479-a1dc-1139d4b20a67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:04.404139 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3041ce11-85b1-4479-a1dc-1139d4b20a67 admin admin] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:04.404420 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3041ce11-85b1-4479-a1dc-1139d4b20a67 admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:04.404688 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3041ce11-85b1-4479-a1dc-1139d4b20a67 admin admin] PATH_INFO: `/v3/users` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:04.405339 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3041ce11-85b1-4479-a1dc-1139d4b20a67 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:04.407616 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3041ce11-85b1-4479-a1dc-1139d4b20a67 admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:04.435749 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1100/2201] 10.222.0.26 () {60 vars in 1144 bytes} [Wed Aug 24 05:47:04 2022] POST /identity/v3/users => generated 284 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:47:04.441120 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5c9a29-7367-4509-beca-17cd10023205 admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:04.457928 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5c9a29-7367-4509-beca-17cd10023205 admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:04.465933 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb3881f-7093-4f1f-a968-ac34b79eee7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:04.467343 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb3881f-7093-4f1f-a968-ac34b79eee7f admin admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:04.467629 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb3881f-7093-4f1f-a968-ac34b79eee7f admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:04.467904 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb3881f-7093-4f1f-a968-ac34b79eee7f admin admin] PATH_INFO: `/v3/roles` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:04.468567 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb3881f-7093-4f1f-a968-ac34b79eee7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:04.470234 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb3881f-7093-4f1f-a968-ac34b79eee7f admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:04.479269 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3041ce11-85b1-4479-a1dc-1139d4b20a67 admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:04.495482 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1102/2202] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Aug 24 05:47:04 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:47:04.506341 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb3881f-7093-4f1f-a968-ac34b79eee7f admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:04.524207 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb3881f-7093-4f1f-a968-ac34b79eee7f admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:04.530280 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96400a91-6187-42e4-9751-7c0988e1cae1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:04.531010 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96400a91-6187-42e4-9751-7c0988e1cae1 admin admin] REQUEST_METHOD: `PUT` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:04.531291 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96400a91-6187-42e4-9751-7c0988e1cae1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:04.531564 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96400a91-6187-42e4-9751-7c0988e1cae1 admin admin] PATH_INFO: `/v3/projects/01c152a092f94d1f90f7f3bc0cbc31f8/users/94fa268f3d6549bbad967ce74dd93101/roles/640bda0879494e60b72680ee505285f0` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:04.551160 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96400a91-6187-42e4-9751-7c0988e1cae1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=01c152a092f94d1f90f7f3bc0cbc31f8, user_id=94fa268f3d6549bbad967ce74dd93101, role_id=640bda0879494e60b72680ee505285f0)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:04.554455 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96400a91-6187-42e4-9751-7c0988e1cae1 admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:04.581198 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1103/2203] 10.222.0.26 () {60 vars in 1483 bytes} [Wed Aug 24 05:47:04 2022] PUT /identity/v3/projects/01c152a092f94d1f90f7f3bc0cbc31f8/users/94fa268f3d6549bbad967ce74dd93101/roles/640bda0879494e60b72680ee505285f0 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:47:04.585334 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96400a91-6187-42e4-9751-7c0988e1cae1 admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:04.622238 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3041ce11-85b1-4479-a1dc-1139d4b20a67 admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:04.658722 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:47:04.699128 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46e53a6-35fc-41a7-b6ed-ff54efcd1410 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17b450afe795495680fc70f522c83750', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:04.700903 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46e53a6-35fc-41a7-b6ed-ff54efcd1410 service cinder] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:04.702097 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46e53a6-35fc-41a7-b6ed-ff54efcd1410 service cinder] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:04.702558 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46e53a6-35fc-41a7-b6ed-ff54efcd1410 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:04.705439 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-e46e53a6-35fc-41a7-b6ed-ff54efcd1410 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:47:04.705883 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96400a91-6187-42e4-9751-7c0988e1cae1 admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:04.717326 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e48acf3-a7e9-446c-81ef-f33531141baf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:04.718204 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e48acf3-a7e9-446c-81ef-f33531141baf admin admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:04.718556 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e48acf3-a7e9-446c-81ef-f33531141baf admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:04.718905 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e48acf3-a7e9-446c-81ef-f33531141baf admin admin] PATH_INFO: `/v3/roles` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:04.719695 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e48acf3-a7e9-446c-81ef-f33531141baf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:04.721448 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e48acf3-a7e9-446c-81ef-f33531141baf admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:04.744388 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1104/2204] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Aug 24 05:47:04 2022] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 05:47:04.745768 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e48acf3-a7e9-446c-81ef-f33531141baf admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:04.758328 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e48acf3-a7e9-446c-81ef-f33531141baf admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:04.773517 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354e4b4d-cbed-4a76-82d5-adc9773c7073 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:04.774192 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354e4b4d-cbed-4a76-82d5-adc9773c7073 admin admin] REQUEST_METHOD: `PUT` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:04.774631 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354e4b4d-cbed-4a76-82d5-adc9773c7073 admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:04.775367 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354e4b4d-cbed-4a76-82d5-adc9773c7073 admin admin] PATH_INFO: `/v3/projects/01c152a092f94d1f90f7f3bc0cbc31f8/users/94fa268f3d6549bbad967ce74dd93101/roles/640bda0879494e60b72680ee505285f0` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:04.777433 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354e4b4d-cbed-4a76-82d5-adc9773c7073 admin admin] RBAC: Authorizing `identity:create_grant(project_id=01c152a092f94d1f90f7f3bc0cbc31f8, user_id=94fa268f3d6549bbad967ce74dd93101, role_id=640bda0879494e60b72680ee505285f0)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:04.780216 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354e4b4d-cbed-4a76-82d5-adc9773c7073 admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:04.793800 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1105/2205] 10.222.0.26 () {60 vars in 1483 bytes} [Wed Aug 24 05:47:04 2022] PUT /identity/v3/projects/01c152a092f94d1f90f7f3bc0cbc31f8/users/94fa268f3d6549bbad967ce74dd93101/roles/640bda0879494e60b72680ee505285f0 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 05:47:04.803924 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46e53a6-35fc-41a7-b6ed-ff54efcd1410 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:04.805243 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57b06d1-96a3-4de5-a8ab-4caee90080f4 None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:04.805630 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57b06d1-96a3-4de5-a8ab-4caee90080f4 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:04.805913 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57b06d1-96a3-4de5-a8ab-4caee90080f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:04.806143 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46e53a6-35fc-41a7-b6ed-ff54efcd1410 service cinder] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:04.836024 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1101/2206] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 24 05:47:04 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 05:47:04.859828 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-a57b06d1-96a3-4de5-a8ab-4caee90080f4 None None] MFA Rules not processed for user `94fa268f3d6549bbad967ce74dd93101`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:47:04.862035 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-a57b06d1-96a3-4de5-a8ab-4caee90080f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:47:04.956047 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1106/2207] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:47:04 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:47:04.968047 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46e53a6-35fc-41a7-b6ed-ff54efcd1410 service cinder] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:04.972210 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:47:04.978450 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46e53a6-35fc-41a7-b6ed-ff54efcd1410 service cinder] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:05.032288 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac1085a-7fb8-46b1-95f0-525b47ffb497 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17b450afe795495680fc70f522c83750', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:05.032831 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac1085a-7fb8-46b1-95f0-525b47ffb497 service cinder] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:05.033114 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac1085a-7fb8-46b1-95f0-525b47ffb497 service cinder] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:05.033387 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac1085a-7fb8-46b1-95f0-525b47ffb497 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:05.045888 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac1085a-7fb8-46b1-95f0-525b47ffb497 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:05.047358 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac1085a-7fb8-46b1-95f0-525b47ffb497 service cinder] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:05.059228 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1102/2208] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 24 05:47:04 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:47:05.145173 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57b06d1-96a3-4de5-a8ab-4caee90080f4 None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:05.155223 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57b06d1-96a3-4de5-a8ab-4caee90080f4 None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:05.158907 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5b5cfc-bac1-430c-b0b8-3c2450b9298d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17b450afe795495680fc70f522c83750', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:05.159525 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5b5cfc-bac1-430c-b0b8-3c2450b9298d service cinder] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:05.159804 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5b5cfc-bac1-430c-b0b8-3c2450b9298d service cinder] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:05.160075 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5b5cfc-bac1-430c-b0b8-3c2450b9298d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:05.226834 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5b5cfc-bac1-430c-b0b8-3c2450b9298d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:05.228431 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5b5cfc-bac1-430c-b0b8-3c2450b9298d service cinder] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:05.239609 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1107/2209] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 24 05:47:05 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:47:08.254842 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac1085a-7fb8-46b1-95f0-525b47ffb497 service cinder] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:08.256315 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-0ac1085a-7fb8-46b1-95f0-525b47ffb497 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:47:08.323072 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac1085a-7fb8-46b1-95f0-525b47ffb497 service cinder] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:08.328057 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c525c020-1aae-484a-9594-6894d863e852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:08.328675 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c525c020-1aae-484a-9594-6894d863e852 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:08.328951 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c525c020-1aae-484a-9594-6894d863e852 admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:08.329217 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c525c020-1aae-484a-9594-6894d863e852 admin admin] PATH_INFO: `/v3/users/73d475856548486db6fa9277475c80fe` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:08.330348 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c525c020-1aae-484a-9594-6894d863e852 admin admin] RBAC: Authorizing `identity:delete_user(user_id=73d475856548486db6fa9277475c80fe)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:08.332253 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c525c020-1aae-484a-9594-6894d863e852 admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:08.380258 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-c525c020-1aae-484a-9594-6894d863e852 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '73d475856548486db6fa9277475c80fe'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:08.387894 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-c525c020-1aae-484a-9594-6894d863e852 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '73d475856548486db6fa9277475c80fe'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:08.399955 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-c525c020-1aae-484a-9594-6894d863e852 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '73d475856548486db6fa9277475c80fe'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:08.409605 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-c525c020-1aae-484a-9594-6894d863e852 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '73d475856548486db6fa9277475c80fe'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:08.410265 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-c525c020-1aae-484a-9594-6894d863e852 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '73d475856548486db6fa9277475c80fe'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:08.416176 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1103/2210] 10.222.0.26 () {58 vars in 1224 bytes} [Wed Aug 24 05:47:08 2022] DELETE /identity/v3/users/73d475856548486db6fa9277475c80fe => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:47:08.594353 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5b5cfc-bac1-430c-b0b8-3c2450b9298d service cinder] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:08.607888 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5b5cfc-bac1-430c-b0b8-3c2450b9298d service cinder] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:08.663593 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:47:08.686513 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6fe235-ed50-4432-88e7-6cc74bd69ede admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:08.687148 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6fe235-ed50-4432-88e7-6cc74bd69ede admin admin] REQUEST_METHOD: `DELETE` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:08.687426 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6fe235-ed50-4432-88e7-6cc74bd69ede admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:08.687705 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6fe235-ed50-4432-88e7-6cc74bd69ede admin admin] PATH_INFO: `/v3/projects/9d16aa67bef1460d8bfeaaf93abe4204` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:08.688828 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6fe235-ed50-4432-88e7-6cc74bd69ede admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d16aa67bef1460d8bfeaaf93abe4204)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:08.690793 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6fe235-ed50-4432-88e7-6cc74bd69ede admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:08.740274 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-de6fe235-ed50-4432-88e7-6cc74bd69ede admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d16aa67bef1460d8bfeaaf93abe4204', 'request_id': 'req-de6fe235-ed50-4432-88e7-6cc74bd69ede'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:08.749776 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-de6fe235-ed50-4432-88e7-6cc74bd69ede admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d16aa67bef1460d8bfeaaf93abe4204', 'request_id': 'req-de6fe235-ed50-4432-88e7-6cc74bd69ede'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:08.765488 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-de6fe235-ed50-4432-88e7-6cc74bd69ede admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d16aa67bef1460d8bfeaaf93abe4204', 'request_id': 'req-de6fe235-ed50-4432-88e7-6cc74bd69ede'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:08.777460 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-de6fe235-ed50-4432-88e7-6cc74bd69ede admin admin] The token cache is being invalidate because project 9d16aa67bef1460d8bfeaaf93abe4204 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:47:08.777890 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-de6fe235-ed50-4432-88e7-6cc74bd69ede admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:08.778580 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-de6fe235-ed50-4432-88e7-6cc74bd69ede admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:08.780090 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1108/2211] 10.222.0.26 () {58 vars in 1233 bytes} [Wed Aug 24 05:47:08 2022] DELETE /identity/v3/projects/9d16aa67bef1460d8bfeaaf93abe4204 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:47:08.785053 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5596075a-9ff9-436c-8e8f-ca20bf6b801e None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:08.785330 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5596075a-9ff9-436c-8e8f-ca20bf6b801e None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:08.785596 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5596075a-9ff9-436c-8e8f-ca20bf6b801e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:08.806733 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-5596075a-9ff9-436c-8e8f-ca20bf6b801e None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:47:08.808335 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-5596075a-9ff9-436c-8e8f-ca20bf6b801e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:47:08.832307 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:47:08.881071 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1104/2212] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:47:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 05:47:08.890066 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a79d2e9-3e7e-4207-9330-693909848274 None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:08.890352 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a79d2e9-3e7e-4207-9330-693909848274 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:08.890626 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a79d2e9-3e7e-4207-9330-693909848274 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:08.914565 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-3a79d2e9-3e7e-4207-9330-693909848274 None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:47:08.915727 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-3a79d2e9-3e7e-4207-9330-693909848274 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:47:08.925724 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1109/2213] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:47:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:47:08.930212 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5596075a-9ff9-436c-8e8f-ca20bf6b801e None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:08.940529 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5596075a-9ff9-436c-8e8f-ca20bf6b801e None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:08.945771 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5aa105b-02b0-4e57-abd0-91be4e26af99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:08.946439 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5aa105b-02b0-4e57-abd0-91be4e26af99 admin admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:08.946754 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5aa105b-02b0-4e57-abd0-91be4e26af99 admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:08.947239 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5aa105b-02b0-4e57-abd0-91be4e26af99 admin admin] PATH_INFO: `/v3/domains` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:08.947904 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5aa105b-02b0-4e57-abd0-91be4e26af99 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:47:08.948187 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5aa105b-02b0-4e57-abd0-91be4e26af99 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:08.949863 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5aa105b-02b0-4e57-abd0-91be4e26af99 admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:08.961444 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1105/2214] 10.222.0.26 () {58 vars in 1153 bytes} [Wed Aug 24 05:47:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:47:08.966515 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a79d2e9-3e7e-4207-9330-693909848274 None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:08.975994 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a79d2e9-3e7e-4207-9330-693909848274 None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:08.981147 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1afcdf-0bb9-4acc-9271-4166c907efce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:08.981735 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1afcdf-0bb9-4acc-9271-4166c907efce admin admin] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:08.982043 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1afcdf-0bb9-4acc-9271-4166c907efce admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:08.982315 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1afcdf-0bb9-4acc-9271-4166c907efce admin admin] PATH_INFO: `/v3/projects` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:08.983033 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1afcdf-0bb9-4acc-9271-4166c907efce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:08.985014 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1afcdf-0bb9-4acc-9271-4166c907efce admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:09.012946 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1110/2215] 10.222.0.26 () {60 vars in 1153 bytes} [Wed Aug 24 05:47:08 2022] POST /identity/v3/projects => generated 393 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:47:09.017529 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5aa105b-02b0-4e57-abd0-91be4e26af99 admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:09.028085 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5aa105b-02b0-4e57-abd0-91be4e26af99 admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:09.087895 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb047668-dd50-4de9-8b1b-5ff9c8b4be4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:09.088513 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb047668-dd50-4de9-8b1b-5ff9c8b4be4e admin admin] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:09.088791 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb047668-dd50-4de9-8b1b-5ff9c8b4be4e admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:09.089061 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb047668-dd50-4de9-8b1b-5ff9c8b4be4e admin admin] PATH_INFO: `/v3/users` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:09.089729 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb047668-dd50-4de9-8b1b-5ff9c8b4be4e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:09.091714 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb047668-dd50-4de9-8b1b-5ff9c8b4be4e admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:09.116836 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1106/2216] 10.222.0.26 () {60 vars in 1144 bytes} [Wed Aug 24 05:47:09 2022] POST /identity/v3/users => generated 297 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:47:09.120692 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1afcdf-0bb9-4acc-9271-4166c907efce admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:09.132128 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1afcdf-0bb9-4acc-9271-4166c907efce admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:09.135960 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb047668-dd50-4de9-8b1b-5ff9c8b4be4e admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:09.137635 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-cb047668-dd50-4de9-8b1b-5ff9c8b4be4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:47:09.138231 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95b8031-2b97-40f5-8fa7-c26a6ec94535 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:09.138958 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95b8031-2b97-40f5-8fa7-c26a6ec94535 admin admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:09.139297 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95b8031-2b97-40f5-8fa7-c26a6ec94535 admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:09.139630 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95b8031-2b97-40f5-8fa7-c26a6ec94535 admin admin] PATH_INFO: `/v3/roles` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:09.140346 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95b8031-2b97-40f5-8fa7-c26a6ec94535 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:09.142049 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95b8031-2b97-40f5-8fa7-c26a6ec94535 admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:09.151652 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb047668-dd50-4de9-8b1b-5ff9c8b4be4e admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:09.157166 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1111/2217] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Aug 24 05:47:09 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:47:09.157327 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503bdb81-20f2-41b2-9fc9-83b7b56b69f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:09.157327 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503bdb81-20f2-41b2-9fc9-83b7b56b69f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:09.157327 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503bdb81-20f2-41b2-9fc9-83b7b56b69f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:09.157580 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503bdb81-20f2-41b2-9fc9-83b7b56b69f5 admin admin] PATH_INFO: `/v3/users/21347722a70d48c497a77e9d9073ef70` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:09.158595 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95b8031-2b97-40f5-8fa7-c26a6ec94535 admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:09.158722 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503bdb81-20f2-41b2-9fc9-83b7b56b69f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=21347722a70d48c497a77e9d9073ef70)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:09.161263 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503bdb81-20f2-41b2-9fc9-83b7b56b69f5 admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:09.169763 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95b8031-2b97-40f5-8fa7-c26a6ec94535 admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:09.174395 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6751201-e1af-4fa3-8daa-85f5a418a55c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:09.175244 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6751201-e1af-4fa3-8daa-85f5a418a55c admin admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:09.175528 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6751201-e1af-4fa3-8daa-85f5a418a55c admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:09.175862 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6751201-e1af-4fa3-8daa-85f5a418a55c admin admin] PATH_INFO: `/v3/roles` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:09.176627 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6751201-e1af-4fa3-8daa-85f5a418a55c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:09.178268 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6751201-e1af-4fa3-8daa-85f5a418a55c admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:09.190092 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1112/2218] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Aug 24 05:47:09 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:47:09.194456 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6751201-e1af-4fa3-8daa-85f5a418a55c admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:09.205874 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6751201-e1af-4fa3-8daa-85f5a418a55c admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:09.211075 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f72f5b-bea1-4d80-bf9f-904f246b32f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:09.213001 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f72f5b-bea1-4d80-bf9f-904f246b32f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:09.213001 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f72f5b-bea1-4d80-bf9f-904f246b32f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:09.213217 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f72f5b-bea1-4d80-bf9f-904f246b32f0 admin admin] PATH_INFO: `/v3/projects/f6dc9d99a1d54abeb3cc09d985bd2768/users/d2bf5c5fc7a44e9ebcbd48aa4c9ba549/roles/f7aa4a2c74c94c1b9ca8ecdcccccda5c` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:09.220817 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-503bdb81-20f2-41b2-9fc9-83b7b56b69f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '21347722a70d48c497a77e9d9073ef70'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:09.234635 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-503bdb81-20f2-41b2-9fc9-83b7b56b69f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '21347722a70d48c497a77e9d9073ef70'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:09.243033 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f72f5b-bea1-4d80-bf9f-904f246b32f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6dc9d99a1d54abeb3cc09d985bd2768, user_id=d2bf5c5fc7a44e9ebcbd48aa4c9ba549, role_id=f7aa4a2c74c94c1b9ca8ecdcccccda5c)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:09.243800 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f72f5b-bea1-4d80-bf9f-904f246b32f0 admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:09.258841 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-503bdb81-20f2-41b2-9fc9-83b7b56b69f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '21347722a70d48c497a77e9d9073ef70'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:09.262309 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1113/2219] 10.222.0.26 () {60 vars in 1483 bytes} [Wed Aug 24 05:47:09 2022] PUT /identity/v3/projects/f6dc9d99a1d54abeb3cc09d985bd2768/users/d2bf5c5fc7a44e9ebcbd48aa4c9ba549/roles/f7aa4a2c74c94c1b9ca8ecdcccccda5c => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 05:47:09.267931 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da66ab42-943e-45db-aafb-96aac56f1dc1 None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:09.268217 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da66ab42-943e-45db-aafb-96aac56f1dc1 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:09.268491 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da66ab42-943e-45db-aafb-96aac56f1dc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:09.268833 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-503bdb81-20f2-41b2-9fc9-83b7b56b69f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '21347722a70d48c497a77e9d9073ef70'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:09.269661 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-503bdb81-20f2-41b2-9fc9-83b7b56b69f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '21347722a70d48c497a77e9d9073ef70'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:09.277712 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1107/2220] 10.222.0.26 () {58 vars in 1224 bytes} [Wed Aug 24 05:47:09 2022] DELETE /identity/v3/users/21347722a70d48c497a77e9d9073ef70 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 05:47:09.291755 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c92cedd-e6c7-46a9-b78b-cdaee5cbb8b7 None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:09.294738 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c92cedd-e6c7-46a9-b78b-cdaee5cbb8b7 None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:09.295041 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c92cedd-e6c7-46a9-b78b-cdaee5cbb8b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:09.295852 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-da66ab42-943e-45db-aafb-96aac56f1dc1 None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:47:09.297282 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-da66ab42-943e-45db-aafb-96aac56f1dc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:47:09.327008 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-8c92cedd-e6c7-46a9-b78b-cdaee5cbb8b7 None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:47:09.330864 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-8c92cedd-e6c7-46a9-b78b-cdaee5cbb8b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:47:09.352654 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:47:09.381372 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:47:09.408547 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1114/2221] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:47:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 05:47:09.420722 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1108/2222] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:47:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:47:09.425501 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da66ab42-943e-45db-aafb-96aac56f1dc1 None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:09.429026 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-da66ab42-943e-45db-aafb-96aac56f1dc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:47:09.429920 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c92cedd-e6c7-46a9-b78b-cdaee5cbb8b7 None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:09.431411 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-8c92cedd-e6c7-46a9-b78b-cdaee5cbb8b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:47:09.505145 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c92cedd-e6c7-46a9-b78b-cdaee5cbb8b7 None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:09.510381 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27367f48-0fba-4331-858a-a9ca3c0a75d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '874348b647194ac2b5ecbf12c33bf59e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:09.511079 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27367f48-0fba-4331-858a-a9ca3c0a75d8 service neutron] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:09.511455 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27367f48-0fba-4331-858a-a9ca3c0a75d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:09.511769 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27367f48-0fba-4331-858a-a9ca3c0a75d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:09.512136 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da66ab42-943e-45db-aafb-96aac56f1dc1 None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:09.520524 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041a86ff-8b65-4cec-8962-2ab140656e9e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '874348b647194ac2b5ecbf12c33bf59e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:09.521385 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041a86ff-8b65-4cec-8962-2ab140656e9e service neutron] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:09.521727 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041a86ff-8b65-4cec-8962-2ab140656e9e service neutron] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:09.522088 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041a86ff-8b65-4cec-8962-2ab140656e9e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:09.524208 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27367f48-0fba-4331-858a-a9ca3c0a75d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:09.525658 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27367f48-0fba-4331-858a-a9ca3c0a75d8 service neutron] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:09.533607 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041a86ff-8b65-4cec-8962-2ab140656e9e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:09.535123 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041a86ff-8b65-4cec-8962-2ab140656e9e service neutron] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:09.536779 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1109/2223] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 24 05:47:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:47:09.546966 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1115/2224] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 24 05:47:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:47:09.959586 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27367f48-0fba-4331-858a-a9ca3c0a75d8 service neutron] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:09.962069 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-27367f48-0fba-4331-858a-a9ca3c0a75d8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:47:09.983416 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27367f48-0fba-4331-858a-a9ca3c0a75d8 service neutron] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:09.988620 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860df8b7-b149-49eb-906d-1aba85134cb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:09.989259 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860df8b7-b149-49eb-906d-1aba85134cb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:09.989539 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860df8b7-b149-49eb-906d-1aba85134cb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:09.989811 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860df8b7-b149-49eb-906d-1aba85134cb2 admin admin] PATH_INFO: `/v3/projects/85377e31b858446798e8825289412dbb` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:09.990973 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860df8b7-b149-49eb-906d-1aba85134cb2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=85377e31b858446798e8825289412dbb)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:09.992919 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860df8b7-b149-49eb-906d-1aba85134cb2 admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:10.073974 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-860df8b7-b149-49eb-906d-1aba85134cb2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '85377e31b858446798e8825289412dbb', 'request_id': 'req-860df8b7-b149-49eb-906d-1aba85134cb2'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:10.080672 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-860df8b7-b149-49eb-906d-1aba85134cb2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '85377e31b858446798e8825289412dbb', 'request_id': 'req-860df8b7-b149-49eb-906d-1aba85134cb2'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:10.088928 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-860df8b7-b149-49eb-906d-1aba85134cb2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '85377e31b858446798e8825289412dbb', 'request_id': 'req-860df8b7-b149-49eb-906d-1aba85134cb2'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:10.103134 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-860df8b7-b149-49eb-906d-1aba85134cb2 admin admin] The token cache is being invalidate because project 85377e31b858446798e8825289412dbb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88112) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:47:10.103333 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-860df8b7-b149-49eb-906d-1aba85134cb2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:10.104290 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-860df8b7-b149-49eb-906d-1aba85134cb2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:10.106843 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1110/2225] 10.222.0.26 () {58 vars in 1233 bytes} [Wed Aug 24 05:47:09 2022] DELETE /identity/v3/projects/85377e31b858446798e8825289412dbb => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:47:10.112502 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041a86ff-8b65-4cec-8962-2ab140656e9e service neutron] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:10.127277 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041a86ff-8b65-4cec-8962-2ab140656e9e service neutron] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:10.215807 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f2ed98-b565-4bb1-9c90-378955baed47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:10.216494 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f2ed98-b565-4bb1-9c90-378955baed47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:10.216779 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f2ed98-b565-4bb1-9c90-378955baed47 admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:10.217053 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f2ed98-b565-4bb1-9c90-378955baed47 admin admin] PATH_INFO: `/v3/users/119ec4e07ca84b63b7aa1ee2186d46c3` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:10.218279 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f2ed98-b565-4bb1-9c90-378955baed47 admin admin] RBAC: Authorizing `identity:delete_user(user_id=119ec4e07ca84b63b7aa1ee2186d46c3)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:10.220254 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f2ed98-b565-4bb1-9c90-378955baed47 admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:10.272361 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-f4f2ed98-b565-4bb1-9c90-378955baed47 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '119ec4e07ca84b63b7aa1ee2186d46c3'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:10.280158 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-f4f2ed98-b565-4bb1-9c90-378955baed47 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '119ec4e07ca84b63b7aa1ee2186d46c3'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:10.280861 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-f4f2ed98-b565-4bb1-9c90-378955baed47 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '119ec4e07ca84b63b7aa1ee2186d46c3'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:10.294366 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-f4f2ed98-b565-4bb1-9c90-378955baed47 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '119ec4e07ca84b63b7aa1ee2186d46c3'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:10.302417 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-f4f2ed98-b565-4bb1-9c90-378955baed47 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '119ec4e07ca84b63b7aa1ee2186d46c3'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:10.309616 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1116/2226] 10.222.0.26 () {58 vars in 1224 bytes} [Wed Aug 24 05:47:10 2022] DELETE /identity/v3/users/119ec4e07ca84b63b7aa1ee2186d46c3 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:47:10.899816 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860df8b7-b149-49eb-906d-1aba85134cb2 admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:10.902336 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-860df8b7-b149-49eb-906d-1aba85134cb2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:47:10.930115 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860df8b7-b149-49eb-906d-1aba85134cb2 admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:10.974875 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:47:10.999764 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b69157-a2ba-4ab9-8ad7-c8d36e0cea39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:11.000594 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b69157-a2ba-4ab9-8ad7-c8d36e0cea39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:11.000981 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b69157-a2ba-4ab9-8ad7-c8d36e0cea39 admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:11.001791 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b69157-a2ba-4ab9-8ad7-c8d36e0cea39 admin admin] PATH_INFO: `/v3/projects/eb8f51e63f69489e8444c75f3a64643e` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:11.003322 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b69157-a2ba-4ab9-8ad7-c8d36e0cea39 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb8f51e63f69489e8444c75f3a64643e)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:11.005462 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b69157-a2ba-4ab9-8ad7-c8d36e0cea39 admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:11.125291 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-b5b69157-a2ba-4ab9-8ad7-c8d36e0cea39 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb8f51e63f69489e8444c75f3a64643e', 'request_id': 'req-b5b69157-a2ba-4ab9-8ad7-c8d36e0cea39'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:11.135559 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-b5b69157-a2ba-4ab9-8ad7-c8d36e0cea39 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb8f51e63f69489e8444c75f3a64643e', 'request_id': 'req-b5b69157-a2ba-4ab9-8ad7-c8d36e0cea39'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:11.146244 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-b5b69157-a2ba-4ab9-8ad7-c8d36e0cea39 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb8f51e63f69489e8444c75f3a64643e', 'request_id': 'req-b5b69157-a2ba-4ab9-8ad7-c8d36e0cea39'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:11.160025 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-b5b69157-a2ba-4ab9-8ad7-c8d36e0cea39 admin admin] The token cache is being invalidate because project eb8f51e63f69489e8444c75f3a64643e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88112) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:47:11.160467 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-b5b69157-a2ba-4ab9-8ad7-c8d36e0cea39 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:11.161183 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-b5b69157-a2ba-4ab9-8ad7-c8d36e0cea39 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:11.163110 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1111/2227] 10.222.0.26 () {58 vars in 1233 bytes} [Wed Aug 24 05:47:10 2022] DELETE /identity/v3/projects/eb8f51e63f69489e8444c75f3a64643e => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:47:11.166916 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f2ed98-b565-4bb1-9c90-378955baed47 admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:11.169567 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-f4f2ed98-b565-4bb1-9c90-378955baed47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:47:11.185020 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f2ed98-b565-4bb1-9c90-378955baed47 admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:11.199574 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:47:11.278236 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acedfb21-756f-4212-96b9-69f4439d6a5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:11.278910 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acedfb21-756f-4212-96b9-69f4439d6a5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:11.279284 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acedfb21-756f-4212-96b9-69f4439d6a5a admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:11.279536 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acedfb21-756f-4212-96b9-69f4439d6a5a admin admin] PATH_INFO: `/v3/users/2d2cb3c02bac4e639f64555b0c138c16` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:11.281578 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acedfb21-756f-4212-96b9-69f4439d6a5a admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d2cb3c02bac4e639f64555b0c138c16)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:11.285974 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acedfb21-756f-4212-96b9-69f4439d6a5a admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:11.386841 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-acedfb21-756f-4212-96b9-69f4439d6a5a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d2cb3c02bac4e639f64555b0c138c16'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:11.394499 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-acedfb21-756f-4212-96b9-69f4439d6a5a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d2cb3c02bac4e639f64555b0c138c16'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:11.395212 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-acedfb21-756f-4212-96b9-69f4439d6a5a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d2cb3c02bac4e639f64555b0c138c16'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:11.408992 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-acedfb21-756f-4212-96b9-69f4439d6a5a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d2cb3c02bac4e639f64555b0c138c16'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:11.418921 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-acedfb21-756f-4212-96b9-69f4439d6a5a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d2cb3c02bac4e639f64555b0c138c16'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:11.427681 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1117/2228] 10.222.0.26 () {58 vars in 1224 bytes} [Wed Aug 24 05:47:11 2022] DELETE /identity/v3/users/2d2cb3c02bac4e639f64555b0c138c16 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:47:11.852522 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b69157-a2ba-4ab9-8ad7-c8d36e0cea39 admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:11.854092 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-b5b69157-a2ba-4ab9-8ad7-c8d36e0cea39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:47:11.876646 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b69157-a2ba-4ab9-8ad7-c8d36e0cea39 admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:12.038389 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca60e6d1-7b42-4685-8c8f-1bcb615b3efe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:12.039132 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca60e6d1-7b42-4685-8c8f-1bcb615b3efe admin admin] REQUEST_METHOD: `DELETE` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:12.039357 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca60e6d1-7b42-4685-8c8f-1bcb615b3efe admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:12.039629 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca60e6d1-7b42-4685-8c8f-1bcb615b3efe admin admin] PATH_INFO: `/v3/projects/10ef258948214879a666e7f7f2aa0ad0` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:12.041518 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca60e6d1-7b42-4685-8c8f-1bcb615b3efe admin admin] RBAC: Authorizing `identity:delete_project(project_id=10ef258948214879a666e7f7f2aa0ad0)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:12.044418 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca60e6d1-7b42-4685-8c8f-1bcb615b3efe admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:12.140360 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-ca60e6d1-7b42-4685-8c8f-1bcb615b3efe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '10ef258948214879a666e7f7f2aa0ad0', 'request_id': 'req-ca60e6d1-7b42-4685-8c8f-1bcb615b3efe'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:12.149678 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-ca60e6d1-7b42-4685-8c8f-1bcb615b3efe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '10ef258948214879a666e7f7f2aa0ad0', 'request_id': 'req-ca60e6d1-7b42-4685-8c8f-1bcb615b3efe'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:12.159050 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-ca60e6d1-7b42-4685-8c8f-1bcb615b3efe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '10ef258948214879a666e7f7f2aa0ad0', 'request_id': 'req-ca60e6d1-7b42-4685-8c8f-1bcb615b3efe'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:12.167943 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:47:12.172295 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-ca60e6d1-7b42-4685-8c8f-1bcb615b3efe admin admin] The token cache is being invalidate because project 10ef258948214879a666e7f7f2aa0ad0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88112) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:47:12.172608 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-ca60e6d1-7b42-4685-8c8f-1bcb615b3efe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:12.173430 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-ca60e6d1-7b42-4685-8c8f-1bcb615b3efe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:12.177571 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1112/2229] 10.222.0.26 () {58 vars in 1233 bytes} [Wed Aug 24 05:47:11 2022] DELETE /identity/v3/projects/10ef258948214879a666e7f7f2aa0ad0 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:47:15.159661 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44be5efe-e973-4dc0-bc59-2af623520fcd None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:15.160537 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44be5efe-e973-4dc0-bc59-2af623520fcd None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:15.160875 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44be5efe-e973-4dc0-bc59-2af623520fcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:15.182788 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-44be5efe-e973-4dc0-bc59-2af623520fcd None None] MFA Rules not processed for user `246cc4e07c754c62bb5337197867e8ce`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:47:15.184831 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-44be5efe-e973-4dc0-bc59-2af623520fcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:47:15.274055 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1118/2230] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:47:15 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:47:16.184424 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63e459f-fb04-47c0-94d1-f204b4682f57 None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:16.184926 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63e459f-fb04-47c0-94d1-f204b4682f57 None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:16.185013 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63e459f-fb04-47c0-94d1-f204b4682f57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:16.238763 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-e63e459f-fb04-47c0-94d1-f204b4682f57 None None] MFA Rules not processed for user `d2bf5c5fc7a44e9ebcbd48aa4c9ba549`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:47:16.240073 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-e63e459f-fb04-47c0-94d1-f204b4682f57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:47:16.335683 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1113/2231] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:47:16 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:47:16.350881 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5866fc8-a705-4728-a6ac-8357b4a613c2 None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:16.351355 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5866fc8-a705-4728-a6ac-8357b4a613c2 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:16.351865 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5866fc8-a705-4728-a6ac-8357b4a613c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:16.379893 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-a5866fc8-a705-4728-a6ac-8357b4a613c2 None None] MFA Rules not processed for user `d2bf5c5fc7a44e9ebcbd48aa4c9ba549`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:47:16.381322 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-a5866fc8-a705-4728-a6ac-8357b4a613c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:47:16.389891 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1119/2232] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:47:16 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:47:16.400609 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63e459f-fb04-47c0-94d1-f204b4682f57 None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:16.403004 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-e63e459f-fb04-47c0-94d1-f204b4682f57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:47:16.559648 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63e459f-fb04-47c0-94d1-f204b4682f57 None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:16.576592 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a20d16-c403-4d00-a112-09e3a5aa2020 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b633e1aec6c4269bce13aa9c89e911a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:16.577727 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a20d16-c403-4d00-a112-09e3a5aa2020 service nova] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:16.578165 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a20d16-c403-4d00-a112-09e3a5aa2020 service nova] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:16.578443 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a20d16-c403-4d00-a112-09e3a5aa2020 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:16.588277 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a20d16-c403-4d00-a112-09e3a5aa2020 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:16.590757 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a20d16-c403-4d00-a112-09e3a5aa2020 service nova] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:16.610167 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1114/2233] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 24 05:47:16 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:47:17.344345 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef8599f-8b0f-476e-a2bd-bf5518560e22 None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:17.344636 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef8599f-8b0f-476e-a2bd-bf5518560e22 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:17.344937 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef8599f-8b0f-476e-a2bd-bf5518560e22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:17.375492 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-3ef8599f-8b0f-476e-a2bd-bf5518560e22 None None] MFA Rules not processed for user `d2bf5c5fc7a44e9ebcbd48aa4c9ba549`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:47:17.378108 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-3ef8599f-8b0f-476e-a2bd-bf5518560e22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:47:17.385261 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1120/2234] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:47:17 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:47:20.603076 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a20d16-c403-4d00-a112-09e3a5aa2020 service nova] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:20.604754 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-d7a20d16-c403-4d00-a112-09e3a5aa2020 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:47:20.695152 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a20d16-c403-4d00-a112-09e3a5aa2020 service nova] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:20.700283 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1d5fc9-72cc-4b6a-89ac-e26eebc8a0f5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17b450afe795495680fc70f522c83750', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:20.701147 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1d5fc9-72cc-4b6a-89ac-e26eebc8a0f5 service cinder] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:20.701521 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1d5fc9-72cc-4b6a-89ac-e26eebc8a0f5 service cinder] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:20.701886 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1d5fc9-72cc-4b6a-89ac-e26eebc8a0f5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:20.703894 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-ab1d5fc9-72cc-4b6a-89ac-e26eebc8a0f5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:47:20.741408 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:47:20.795052 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1d5fc9-72cc-4b6a-89ac-e26eebc8a0f5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:20.810852 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1d5fc9-72cc-4b6a-89ac-e26eebc8a0f5 service cinder] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:20.838034 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1115/2235] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 24 05:47:20 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:47:21.443286 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef8599f-8b0f-476e-a2bd-bf5518560e22 None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:21.444842 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-3ef8599f-8b0f-476e-a2bd-bf5518560e22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:47:21.481202 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:47:21.544487 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef8599f-8b0f-476e-a2bd-bf5518560e22 None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:21.551831 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45832132-379c-4387-ba74-ce7880f8e223 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:21.552666 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45832132-379c-4387-ba74-ce7880f8e223 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:21.553632 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45832132-379c-4387-ba74-ce7880f8e223 admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:21.553984 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45832132-379c-4387-ba74-ce7880f8e223 admin admin] PATH_INFO: `/v3/users/f0d0a0e6e0c44e0cbff370ee92916f76` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:21.555502 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45832132-379c-4387-ba74-ce7880f8e223 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f0d0a0e6e0c44e0cbff370ee92916f76)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:21.557718 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45832132-379c-4387-ba74-ce7880f8e223 admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:21.624486 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-45832132-379c-4387-ba74-ce7880f8e223 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f0d0a0e6e0c44e0cbff370ee92916f76'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:21.636981 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-45832132-379c-4387-ba74-ce7880f8e223 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f0d0a0e6e0c44e0cbff370ee92916f76'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:21.638520 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-45832132-379c-4387-ba74-ce7880f8e223 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f0d0a0e6e0c44e0cbff370ee92916f76'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:21.653472 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-45832132-379c-4387-ba74-ce7880f8e223 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f0d0a0e6e0c44e0cbff370ee92916f76'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:21.664802 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-45832132-379c-4387-ba74-ce7880f8e223 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f0d0a0e6e0c44e0cbff370ee92916f76'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:21.677288 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1121/2236] 10.222.0.26 () {58 vars in 1224 bytes} [Wed Aug 24 05:47:21 2022] DELETE /identity/v3/users/f0d0a0e6e0c44e0cbff370ee92916f76 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:47:21.683668 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3ec1bb-3882-4b15-90e4-138d1d0ce1d7 None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:21.684506 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3ec1bb-3882-4b15-90e4-138d1d0ce1d7 None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:21.684921 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3ec1bb-3882-4b15-90e4-138d1d0ce1d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:21.721638 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-dd3ec1bb-3882-4b15-90e4-138d1d0ce1d7 None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:47:21.725100 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-dd3ec1bb-3882-4b15-90e4-138d1d0ce1d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:47:21.806518 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1116/2237] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:47:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 05:47:21.818498 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45832132-379c-4387-ba74-ce7880f8e223 admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:21.826373 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-45832132-379c-4387-ba74-ce7880f8e223 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:47:21.966868 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45832132-379c-4387-ba74-ce7880f8e223 admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:21.974496 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa0eb9c-8871-48e6-b64f-f152943e01ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '874348b647194ac2b5ecbf12c33bf59e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:21.975273 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa0eb9c-8871-48e6-b64f-f152943e01ea service neutron] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:21.975709 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa0eb9c-8871-48e6-b64f-f152943e01ea service neutron] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:21.975980 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa0eb9c-8871-48e6-b64f-f152943e01ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:21.992094 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa0eb9c-8871-48e6-b64f-f152943e01ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:21.993704 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa0eb9c-8871-48e6-b64f-f152943e01ea service neutron] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:22.018186 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1122/2238] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 24 05:47:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:47:22.567113 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3ec1bb-3882-4b15-90e4-138d1d0ce1d7 None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:22.568703 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-dd3ec1bb-3882-4b15-90e4-138d1d0ce1d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:47:22.581638 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3ec1bb-3882-4b15-90e4-138d1d0ce1d7 None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:22.586536 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce55f729-69a5-4b1a-afd8-acbfc95e01f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:22.587195 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce55f729-69a5-4b1a-afd8-acbfc95e01f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:22.587477 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce55f729-69a5-4b1a-afd8-acbfc95e01f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:22.587779 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce55f729-69a5-4b1a-afd8-acbfc95e01f3 admin admin] PATH_INFO: `/v3/projects/0604d1bb1f22453b8b5e657c1acc7428` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:22.588892 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce55f729-69a5-4b1a-afd8-acbfc95e01f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0604d1bb1f22453b8b5e657c1acc7428)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:22.591459 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce55f729-69a5-4b1a-afd8-acbfc95e01f3 admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:22.641039 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-ce55f729-69a5-4b1a-afd8-acbfc95e01f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0604d1bb1f22453b8b5e657c1acc7428', 'request_id': 'req-ce55f729-69a5-4b1a-afd8-acbfc95e01f3'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:22.648747 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-ce55f729-69a5-4b1a-afd8-acbfc95e01f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0604d1bb1f22453b8b5e657c1acc7428', 'request_id': 'req-ce55f729-69a5-4b1a-afd8-acbfc95e01f3'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:22.655581 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-ce55f729-69a5-4b1a-afd8-acbfc95e01f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0604d1bb1f22453b8b5e657c1acc7428', 'request_id': 'req-ce55f729-69a5-4b1a-afd8-acbfc95e01f3'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:22.665889 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-ce55f729-69a5-4b1a-afd8-acbfc95e01f3 admin admin] The token cache is being invalidate because project 0604d1bb1f22453b8b5e657c1acc7428 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88112) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:47:22.666207 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-ce55f729-69a5-4b1a-afd8-acbfc95e01f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:22.666829 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-ce55f729-69a5-4b1a-afd8-acbfc95e01f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:22.668329 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1117/2239] 10.222.0.26 () {58 vars in 1233 bytes} [Wed Aug 24 05:47:22 2022] DELETE /identity/v3/projects/0604d1bb1f22453b8b5e657c1acc7428 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:47:22.672340 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa0eb9c-8871-48e6-b64f-f152943e01ea service neutron] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:22.682109 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa0eb9c-8871-48e6-b64f-f152943e01ea service neutron] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:22.730305 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:47:22.742336 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc9f436-0743-4397-957f-48465b58762a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:22.742973 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc9f436-0743-4397-957f-48465b58762a admin admin] REQUEST_METHOD: `DELETE` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:22.743258 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc9f436-0743-4397-957f-48465b58762a admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:22.743531 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc9f436-0743-4397-957f-48465b58762a admin admin] PATH_INFO: `/v3/users/94fa268f3d6549bbad967ce74dd93101` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:22.744649 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc9f436-0743-4397-957f-48465b58762a admin admin] RBAC: Authorizing `identity:delete_user(user_id=94fa268f3d6549bbad967ce74dd93101)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:22.747151 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc9f436-0743-4397-957f-48465b58762a admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:22.795270 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-cfc9f436-0743-4397-957f-48465b58762a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '94fa268f3d6549bbad967ce74dd93101'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:22.803442 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-cfc9f436-0743-4397-957f-48465b58762a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '94fa268f3d6549bbad967ce74dd93101'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:22.804107 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-cfc9f436-0743-4397-957f-48465b58762a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '94fa268f3d6549bbad967ce74dd93101'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:22.818251 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-cfc9f436-0743-4397-957f-48465b58762a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '94fa268f3d6549bbad967ce74dd93101'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:22.828134 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-cfc9f436-0743-4397-957f-48465b58762a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '94fa268f3d6549bbad967ce74dd93101'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:22.835005 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1123/2240] 10.222.0.26 () {58 vars in 1224 bytes} [Wed Aug 24 05:47:22 2022] DELETE /identity/v3/users/94fa268f3d6549bbad967ce74dd93101 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:47:23.202019 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce55f729-69a5-4b1a-afd8-acbfc95e01f3 admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:23.203544 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-ce55f729-69a5-4b1a-afd8-acbfc95e01f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:47:23.217804 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce55f729-69a5-4b1a-afd8-acbfc95e01f3 admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:23.269009 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:47:23.284299 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b100997a-566d-4097-bfd4-717bb0a24f25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:23.285787 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b100997a-566d-4097-bfd4-717bb0a24f25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:23.285920 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b100997a-566d-4097-bfd4-717bb0a24f25 admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:23.286178 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b100997a-566d-4097-bfd4-717bb0a24f25 admin admin] PATH_INFO: `/v3/projects/01c152a092f94d1f90f7f3bc0cbc31f8` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:23.287436 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b100997a-566d-4097-bfd4-717bb0a24f25 admin admin] RBAC: Authorizing `identity:delete_project(project_id=01c152a092f94d1f90f7f3bc0cbc31f8)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:23.289491 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b100997a-566d-4097-bfd4-717bb0a24f25 admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:23.343371 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-b100997a-566d-4097-bfd4-717bb0a24f25 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01c152a092f94d1f90f7f3bc0cbc31f8', 'request_id': 'req-b100997a-566d-4097-bfd4-717bb0a24f25'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:23.352892 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-b100997a-566d-4097-bfd4-717bb0a24f25 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01c152a092f94d1f90f7f3bc0cbc31f8', 'request_id': 'req-b100997a-566d-4097-bfd4-717bb0a24f25'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:23.359949 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-b100997a-566d-4097-bfd4-717bb0a24f25 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01c152a092f94d1f90f7f3bc0cbc31f8', 'request_id': 'req-b100997a-566d-4097-bfd4-717bb0a24f25'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:23.370307 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-b100997a-566d-4097-bfd4-717bb0a24f25 admin admin] The token cache is being invalidate because project 01c152a092f94d1f90f7f3bc0cbc31f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88112) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:47:23.371158 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-b100997a-566d-4097-bfd4-717bb0a24f25 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:23.371807 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-b100997a-566d-4097-bfd4-717bb0a24f25 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:23.373289 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1118/2241] 10.222.0.26 () {58 vars in 1233 bytes} [Wed Aug 24 05:47:23 2022] DELETE /identity/v3/projects/01c152a092f94d1f90f7f3bc0cbc31f8 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:47:23.377981 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f52ec5c-a2d2-4409-afd1-b8d7265005a7 None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:23.378277 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f52ec5c-a2d2-4409-afd1-b8d7265005a7 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:23.378554 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f52ec5c-a2d2-4409-afd1-b8d7265005a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:23.402087 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-5f52ec5c-a2d2-4409-afd1-b8d7265005a7 None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:47:23.403297 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-5f52ec5c-a2d2-4409-afd1-b8d7265005a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:47:23.501913 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1124/2242] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:47:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:47:23.509850 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cee47e9-63f9-4f96-b365-5235ce316fe0 None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:23.510024 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cee47e9-63f9-4f96-b365-5235ce316fe0 None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:23.510343 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cee47e9-63f9-4f96-b365-5235ce316fe0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:23.532341 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-8cee47e9-63f9-4f96-b365-5235ce316fe0 None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:47:23.533564 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-8cee47e9-63f9-4f96-b365-5235ce316fe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:47:23.546104 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1119/2243] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:47:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:47:23.550622 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f52ec5c-a2d2-4409-afd1-b8d7265005a7 None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:23.560681 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f52ec5c-a2d2-4409-afd1-b8d7265005a7 None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:23.565483 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3de011-28e8-461f-8e19-39921629b88c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:23.566127 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3de011-28e8-461f-8e19-39921629b88c admin admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:23.566410 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3de011-28e8-461f-8e19-39921629b88c admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:23.566681 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3de011-28e8-461f-8e19-39921629b88c admin admin] PATH_INFO: `/v3/domains` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:23.567359 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3de011-28e8-461f-8e19-39921629b88c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:47:23.567662 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3de011-28e8-461f-8e19-39921629b88c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:23.569274 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3de011-28e8-461f-8e19-39921629b88c admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:23.581731 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1125/2244] 10.222.0.26 () {58 vars in 1153 bytes} [Wed Aug 24 05:47:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:47:23.586041 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cee47e9-63f9-4f96-b365-5235ce316fe0 None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:23.596173 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cee47e9-63f9-4f96-b365-5235ce316fe0 None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:23.600821 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d1390c-e8e7-4d50-99ff-6826664d1312 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:23.601418 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d1390c-e8e7-4d50-99ff-6826664d1312 admin admin] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:23.601700 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d1390c-e8e7-4d50-99ff-6826664d1312 admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:23.601999 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d1390c-e8e7-4d50-99ff-6826664d1312 admin admin] PATH_INFO: `/v3/projects` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:23.602663 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d1390c-e8e7-4d50-99ff-6826664d1312 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:23.604595 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d1390c-e8e7-4d50-99ff-6826664d1312 admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:23.638718 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1120/2245] 10.222.0.26 () {60 vars in 1153 bytes} [Wed Aug 24 05:47:23 2022] POST /identity/v3/projects => generated 391 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:47:23.642800 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3de011-28e8-461f-8e19-39921629b88c admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:23.660731 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3de011-28e8-461f-8e19-39921629b88c admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:23.725167 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:47:23.735903 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d06f07-4b1c-4310-805e-16e00a74a6d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:23.736664 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d06f07-4b1c-4310-805e-16e00a74a6d4 admin admin] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:23.736943 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d06f07-4b1c-4310-805e-16e00a74a6d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:23.737290 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d06f07-4b1c-4310-805e-16e00a74a6d4 admin admin] PATH_INFO: `/v3/users` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:23.738036 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d06f07-4b1c-4310-805e-16e00a74a6d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:23.740075 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d06f07-4b1c-4310-805e-16e00a74a6d4 admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:23.766556 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1126/2246] 10.222.0.26 () {60 vars in 1144 bytes} [Wed Aug 24 05:47:23 2022] POST /identity/v3/users => generated 296 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:47:23.770418 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d1390c-e8e7-4d50-99ff-6826664d1312 admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:23.782662 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d1390c-e8e7-4d50-99ff-6826664d1312 admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:23.787735 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19171b2c-c6ef-4ad6-ba4d-6075e88a2b91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:23.788457 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19171b2c-c6ef-4ad6-ba4d-6075e88a2b91 admin admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:23.788832 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19171b2c-c6ef-4ad6-ba4d-6075e88a2b91 admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:23.789204 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19171b2c-c6ef-4ad6-ba4d-6075e88a2b91 admin admin] PATH_INFO: `/v3/roles` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:23.789869 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19171b2c-c6ef-4ad6-ba4d-6075e88a2b91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:23.791486 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19171b2c-c6ef-4ad6-ba4d-6075e88a2b91 admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:23.802605 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1121/2247] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Aug 24 05:47:23 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:47:23.807802 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d06f07-4b1c-4310-805e-16e00a74a6d4 admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:23.819572 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d06f07-4b1c-4310-805e-16e00a74a6d4 admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:23.824571 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02b3b45-b4fe-4f3f-9afa-cbdb625181f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:23.825175 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02b3b45-b4fe-4f3f-9afa-cbdb625181f7 admin admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:23.825455 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02b3b45-b4fe-4f3f-9afa-cbdb625181f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:23.825729 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02b3b45-b4fe-4f3f-9afa-cbdb625181f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:23.826418 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02b3b45-b4fe-4f3f-9afa-cbdb625181f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:23.828062 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02b3b45-b4fe-4f3f-9afa-cbdb625181f7 admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:23.841886 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1127/2248] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Aug 24 05:47:23 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:47:23.846500 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19171b2c-c6ef-4ad6-ba4d-6075e88a2b91 admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:23.857901 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19171b2c-c6ef-4ad6-ba4d-6075e88a2b91 admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:23.862861 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ae241d-da79-438b-b365-65179daa73e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:23.863642 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ae241d-da79-438b-b365-65179daa73e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:23.863991 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ae241d-da79-438b-b365-65179daa73e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:23.864346 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ae241d-da79-438b-b365-65179daa73e7 admin admin] PATH_INFO: `/v3/projects/61d6816f9aad4c868210bebb2c28822e/users/3f5c485d10b94f29a9219ca8cfbea297/roles/f7aa4a2c74c94c1b9ca8ecdcccccda5c` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:23.879326 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ae241d-da79-438b-b365-65179daa73e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=61d6816f9aad4c868210bebb2c28822e, user_id=3f5c485d10b94f29a9219ca8cfbea297, role_id=f7aa4a2c74c94c1b9ca8ecdcccccda5c)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:23.882111 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ae241d-da79-438b-b365-65179daa73e7 admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:23.896226 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1122/2249] 10.222.0.26 () {60 vars in 1483 bytes} [Wed Aug 24 05:47:23 2022] PUT /identity/v3/projects/61d6816f9aad4c868210bebb2c28822e/users/3f5c485d10b94f29a9219ca8cfbea297/roles/f7aa4a2c74c94c1b9ca8ecdcccccda5c => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:47:23.908791 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f90bb0-e126-49ba-bc91-4cbedee52fb2 None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:23.908930 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f90bb0-e126-49ba-bc91-4cbedee52fb2 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:23.909130 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f90bb0-e126-49ba-bc91-4cbedee52fb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:23.936189 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-d6f90bb0-e126-49ba-bc91-4cbedee52fb2 None None] MFA Rules not processed for user `3f5c485d10b94f29a9219ca8cfbea297`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:47:23.937405 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-d6f90bb0-e126-49ba-bc91-4cbedee52fb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:47:24.003337 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1128/2250] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:47:23 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:47:24.007965 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ae241d-da79-438b-b365-65179daa73e7 admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:24.079102 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ae241d-da79-438b-b365-65179daa73e7 admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:24.088596 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979c797d-6c0d-4465-ab21-b814c247ddb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:24.090073 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979c797d-6c0d-4465-ab21-b814c247ddb3 admin admin] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:24.090428 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979c797d-6c0d-4465-ab21-b814c247ddb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:24.090701 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979c797d-6c0d-4465-ab21-b814c247ddb3 admin admin] PATH_INFO: `/v3/projects` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:24.091347 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979c797d-6c0d-4465-ab21-b814c247ddb3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:24.093274 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979c797d-6c0d-4465-ab21-b814c247ddb3 admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:24.118992 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:47:24.130170 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1123/2251] 10.222.0.26 () {60 vars in 1153 bytes} [Wed Aug 24 05:47:24 2022] POST /identity/v3/projects => generated 393 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:47:24.132419 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f90bb0-e126-49ba-bc91-4cbedee52fb2 None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:24.145024 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f90bb0-e126-49ba-bc91-4cbedee52fb2 None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:24.206588 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e051206-bf9e-4af2-821a-cc5fb4120b07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:24.207198 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e051206-bf9e-4af2-821a-cc5fb4120b07 admin admin] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:24.207505 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e051206-bf9e-4af2-821a-cc5fb4120b07 admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:24.207766 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e051206-bf9e-4af2-821a-cc5fb4120b07 admin admin] PATH_INFO: `/v3/users` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:24.208398 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e051206-bf9e-4af2-821a-cc5fb4120b07 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:24.210401 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e051206-bf9e-4af2-821a-cc5fb4120b07 admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:24.231096 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1129/2252] 10.222.0.26 () {60 vars in 1144 bytes} [Wed Aug 24 05:47:24 2022] POST /identity/v3/users => generated 303 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 05:47:24.235214 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979c797d-6c0d-4465-ab21-b814c247ddb3 admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:24.245287 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979c797d-6c0d-4465-ab21-b814c247ddb3 admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:24.250433 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d861951f-79b3-42fb-8b48-55d3423c09e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:24.251022 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d861951f-79b3-42fb-8b48-55d3423c09e8 admin admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:24.251299 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d861951f-79b3-42fb-8b48-55d3423c09e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:24.251568 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d861951f-79b3-42fb-8b48-55d3423c09e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:24.252200 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d861951f-79b3-42fb-8b48-55d3423c09e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:24.253914 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d861951f-79b3-42fb-8b48-55d3423c09e8 admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:24.264968 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1124/2253] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Aug 24 05:47:24 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:47:24.269061 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e051206-bf9e-4af2-821a-cc5fb4120b07 admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:24.278887 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e051206-bf9e-4af2-821a-cc5fb4120b07 admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:24.283557 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e709046-0341-4a27-97a7-a9ba7db63063 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:24.284335 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e709046-0341-4a27-97a7-a9ba7db63063 admin admin] REQUEST_METHOD: `PUT` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:24.284614 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e709046-0341-4a27-97a7-a9ba7db63063 admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:24.284882 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e709046-0341-4a27-97a7-a9ba7db63063 admin admin] PATH_INFO: `/v3/projects/29454440aac64e3eb1625b97e4b7ebae/users/ddb689465e3a4a4180914f71bb02154b/roles/640bda0879494e60b72680ee505285f0` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:24.299238 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e709046-0341-4a27-97a7-a9ba7db63063 admin admin] RBAC: Authorizing `identity:create_grant(project_id=29454440aac64e3eb1625b97e4b7ebae, user_id=ddb689465e3a4a4180914f71bb02154b, role_id=640bda0879494e60b72680ee505285f0)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:24.301871 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e709046-0341-4a27-97a7-a9ba7db63063 admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:24.315103 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1130/2254] 10.222.0.26 () {60 vars in 1483 bytes} [Wed Aug 24 05:47:24 2022] PUT /identity/v3/projects/29454440aac64e3eb1625b97e4b7ebae/users/ddb689465e3a4a4180914f71bb02154b/roles/640bda0879494e60b72680ee505285f0 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:47:24.319069 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d861951f-79b3-42fb-8b48-55d3423c09e8 admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:24.329833 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d861951f-79b3-42fb-8b48-55d3423c09e8 admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:24.383983 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab33ea7-9087-4cde-9c0a-fc9e806ca72e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:24.384508 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab33ea7-9087-4cde-9c0a-fc9e806ca72e admin admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:24.384784 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab33ea7-9087-4cde-9c0a-fc9e806ca72e admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:24.385055 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab33ea7-9087-4cde-9c0a-fc9e806ca72e admin admin] PATH_INFO: `/v3/roles` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:24.385716 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab33ea7-9087-4cde-9c0a-fc9e806ca72e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:24.388024 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab33ea7-9087-4cde-9c0a-fc9e806ca72e admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:24.400825 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1125/2255] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Aug 24 05:47:24 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:47:24.402439 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e709046-0341-4a27-97a7-a9ba7db63063 admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:24.412773 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e709046-0341-4a27-97a7-a9ba7db63063 admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:24.417390 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5e1384-b099-4ec3-b501-2e34ebd4b21f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:24.418138 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5e1384-b099-4ec3-b501-2e34ebd4b21f admin admin] REQUEST_METHOD: `PUT` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:24.418418 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5e1384-b099-4ec3-b501-2e34ebd4b21f admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:24.418684 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5e1384-b099-4ec3-b501-2e34ebd4b21f admin admin] PATH_INFO: `/v3/projects/29454440aac64e3eb1625b97e4b7ebae/users/ddb689465e3a4a4180914f71bb02154b/roles/640bda0879494e60b72680ee505285f0` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:24.420585 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5e1384-b099-4ec3-b501-2e34ebd4b21f admin admin] RBAC: Authorizing `identity:create_grant(project_id=29454440aac64e3eb1625b97e4b7ebae, user_id=ddb689465e3a4a4180914f71bb02154b, role_id=640bda0879494e60b72680ee505285f0)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:24.423236 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5e1384-b099-4ec3-b501-2e34ebd4b21f admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:24.434093 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1131/2256] 10.222.0.26 () {60 vars in 1483 bytes} [Wed Aug 24 05:47:24 2022] PUT /identity/v3/projects/29454440aac64e3eb1625b97e4b7ebae/users/ddb689465e3a4a4180914f71bb02154b/roles/640bda0879494e60b72680ee505285f0 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:47:24.444131 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0815e29e-55b6-4964-aa33-16c5d751a895 None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:24.444421 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0815e29e-55b6-4964-aa33-16c5d751a895 None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:24.444810 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0815e29e-55b6-4964-aa33-16c5d751a895 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:24.474524 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-0815e29e-55b6-4964-aa33-16c5d751a895 None None] MFA Rules not processed for user `ddb689465e3a4a4180914f71bb02154b`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:47:24.475742 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-0815e29e-55b6-4964-aa33-16c5d751a895 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:47:24.567852 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1126/2257] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:47:24 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:47:24.579224 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5e1384-b099-4ec3-b501-2e34ebd4b21f admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:24.580943 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-9b5e1384-b099-4ec3-b501-2e34ebd4b21f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:47:24.601126 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:47:24.641085 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5e1384-b099-4ec3-b501-2e34ebd4b21f admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:24.644660 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8933e4b9-bdbf-46d3-96a1-7ed2192c9234 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17b450afe795495680fc70f522c83750', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:24.645259 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8933e4b9-bdbf-46d3-96a1-7ed2192c9234 service cinder] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:24.645536 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8933e4b9-bdbf-46d3-96a1-7ed2192c9234 service cinder] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:24.645804 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8933e4b9-bdbf-46d3-96a1-7ed2192c9234 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:24.654723 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8933e4b9-bdbf-46d3-96a1-7ed2192c9234 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:24.656159 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8933e4b9-bdbf-46d3-96a1-7ed2192c9234 service cinder] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:24.665634 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1132/2258] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 24 05:47:24 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:47:24.719681 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0815e29e-55b6-4964-aa33-16c5d751a895 None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:24.721079 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-0815e29e-55b6-4964-aa33-16c5d751a895 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:47:24.733852 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0815e29e-55b6-4964-aa33-16c5d751a895 None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:24.737629 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448d2bba-b4b5-4282-b198-5f1802eff3e8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17b450afe795495680fc70f522c83750', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:24.738342 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448d2bba-b4b5-4282-b198-5f1802eff3e8 service cinder] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:24.738695 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448d2bba-b4b5-4282-b198-5f1802eff3e8 service cinder] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:24.739035 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448d2bba-b4b5-4282-b198-5f1802eff3e8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:24.799412 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448d2bba-b4b5-4282-b198-5f1802eff3e8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:24.800839 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448d2bba-b4b5-4282-b198-5f1802eff3e8 service cinder] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:24.811792 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1127/2259] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 24 05:47:24 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:47:28.253592 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8933e4b9-bdbf-46d3-96a1-7ed2192c9234 service cinder] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:28.419374 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8933e4b9-bdbf-46d3-96a1-7ed2192c9234 service cinder] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:28.430702 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66008cd8-6efb-4129-b60d-91d77a1eea99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:28.431714 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66008cd8-6efb-4129-b60d-91d77a1eea99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:28.433222 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66008cd8-6efb-4129-b60d-91d77a1eea99 admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:28.433520 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66008cd8-6efb-4129-b60d-91d77a1eea99 admin admin] PATH_INFO: `/v3/users/3f5c485d10b94f29a9219ca8cfbea297` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:28.434945 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66008cd8-6efb-4129-b60d-91d77a1eea99 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f5c485d10b94f29a9219ca8cfbea297)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:28.437206 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66008cd8-6efb-4129-b60d-91d77a1eea99 admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:28.517092 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-66008cd8-6efb-4129-b60d-91d77a1eea99 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f5c485d10b94f29a9219ca8cfbea297'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:28.524429 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-66008cd8-6efb-4129-b60d-91d77a1eea99 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f5c485d10b94f29a9219ca8cfbea297'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:28.525132 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-66008cd8-6efb-4129-b60d-91d77a1eea99 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f5c485d10b94f29a9219ca8cfbea297'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:28.541666 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-66008cd8-6efb-4129-b60d-91d77a1eea99 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f5c485d10b94f29a9219ca8cfbea297'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:28.551312 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-66008cd8-6efb-4129-b60d-91d77a1eea99 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f5c485d10b94f29a9219ca8cfbea297'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:28.557695 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1133/2260] 10.222.0.26 () {58 vars in 1224 bytes} [Wed Aug 24 05:47:28 2022] DELETE /identity/v3/users/3f5c485d10b94f29a9219ca8cfbea297 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:47:28.562759 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616030e6-21ad-4c68-bd5e-ba00253a193f None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:28.563219 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616030e6-21ad-4c68-bd5e-ba00253a193f None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:28.563346 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616030e6-21ad-4c68-bd5e-ba00253a193f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:28.591221 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-616030e6-21ad-4c68-bd5e-ba00253a193f None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:47:28.593068 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-616030e6-21ad-4c68-bd5e-ba00253a193f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:47:28.597569 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:47:28.707981 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1128/2261] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:47:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:47:28.717909 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66008cd8-6efb-4129-b60d-91d77a1eea99 admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:28.719451 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-66008cd8-6efb-4129-b60d-91d77a1eea99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:47:28.788933 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:47:28.812901 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66008cd8-6efb-4129-b60d-91d77a1eea99 admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:28.822852 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6140ca99-fd43-41d1-b1ea-a110b5889819 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '874348b647194ac2b5ecbf12c33bf59e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:28.824073 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6140ca99-fd43-41d1-b1ea-a110b5889819 service neutron] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:28.824404 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6140ca99-fd43-41d1-b1ea-a110b5889819 service neutron] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:28.824615 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6140ca99-fd43-41d1-b1ea-a110b5889819 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:28.837099 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6140ca99-fd43-41d1-b1ea-a110b5889819 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:28.838783 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6140ca99-fd43-41d1-b1ea-a110b5889819 service neutron] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:28.849335 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1134/2262] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 24 05:47:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:47:29.157542 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616030e6-21ad-4c68-bd5e-ba00253a193f None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:29.159076 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-616030e6-21ad-4c68-bd5e-ba00253a193f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:47:29.172488 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616030e6-21ad-4c68-bd5e-ba00253a193f None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:29.177826 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3f17e0-43a7-4c04-9b90-c138254fa658 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:29.178580 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3f17e0-43a7-4c04-9b90-c138254fa658 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:29.178866 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3f17e0-43a7-4c04-9b90-c138254fa658 admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:29.179135 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3f17e0-43a7-4c04-9b90-c138254fa658 admin admin] PATH_INFO: `/v3/projects/61d6816f9aad4c868210bebb2c28822e` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:29.180619 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3f17e0-43a7-4c04-9b90-c138254fa658 admin admin] RBAC: Authorizing `identity:delete_project(project_id=61d6816f9aad4c868210bebb2c28822e)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:29.182787 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3f17e0-43a7-4c04-9b90-c138254fa658 admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:29.235580 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-7e3f17e0-43a7-4c04-9b90-c138254fa658 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '61d6816f9aad4c868210bebb2c28822e', 'request_id': 'req-7e3f17e0-43a7-4c04-9b90-c138254fa658'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:29.246642 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-7e3f17e0-43a7-4c04-9b90-c138254fa658 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '61d6816f9aad4c868210bebb2c28822e', 'request_id': 'req-7e3f17e0-43a7-4c04-9b90-c138254fa658'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:29.253287 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-7e3f17e0-43a7-4c04-9b90-c138254fa658 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '61d6816f9aad4c868210bebb2c28822e', 'request_id': 'req-7e3f17e0-43a7-4c04-9b90-c138254fa658'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:29.267123 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-7e3f17e0-43a7-4c04-9b90-c138254fa658 admin admin] The token cache is being invalidate because project 61d6816f9aad4c868210bebb2c28822e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88112) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:47:29.267427 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-7e3f17e0-43a7-4c04-9b90-c138254fa658 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:29.268205 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-7e3f17e0-43a7-4c04-9b90-c138254fa658 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:29.269586 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1129/2263] 10.222.0.26 () {58 vars in 1233 bytes} [Wed Aug 24 05:47:29 2022] DELETE /identity/v3/projects/61d6816f9aad4c868210bebb2c28822e => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:47:29.273513 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6140ca99-fd43-41d1-b1ea-a110b5889819 service neutron] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:29.283778 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6140ca99-fd43-41d1-b1ea-a110b5889819 service neutron] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:29.347333 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa586df-2722-42e6-9f9f-40aa8dbbb518 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:29.348506 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa586df-2722-42e6-9f9f-40aa8dbbb518 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:29.348795 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa586df-2722-42e6-9f9f-40aa8dbbb518 admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:29.349067 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa586df-2722-42e6-9f9f-40aa8dbbb518 admin admin] PATH_INFO: `/v3/users/ddb689465e3a4a4180914f71bb02154b` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:29.350241 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa586df-2722-42e6-9f9f-40aa8dbbb518 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ddb689465e3a4a4180914f71bb02154b)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:29.352156 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa586df-2722-42e6-9f9f-40aa8dbbb518 admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:29.409624 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-5aa586df-2722-42e6-9f9f-40aa8dbbb518 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ddb689465e3a4a4180914f71bb02154b'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:29.418212 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-5aa586df-2722-42e6-9f9f-40aa8dbbb518 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ddb689465e3a4a4180914f71bb02154b'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:29.418930 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-5aa586df-2722-42e6-9f9f-40aa8dbbb518 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ddb689465e3a4a4180914f71bb02154b'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:29.433646 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-5aa586df-2722-42e6-9f9f-40aa8dbbb518 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ddb689465e3a4a4180914f71bb02154b'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:29.444476 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-5aa586df-2722-42e6-9f9f-40aa8dbbb518 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ddb689465e3a4a4180914f71bb02154b'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:29.455368 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1135/2264] 10.222.0.26 () {58 vars in 1224 bytes} [Wed Aug 24 05:47:29 2022] DELETE /identity/v3/users/ddb689465e3a4a4180914f71bb02154b => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 05:47:30.203487 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3f17e0-43a7-4c04-9b90-c138254fa658 admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:30.205000 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-7e3f17e0-43a7-4c04-9b90-c138254fa658 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:47:30.223895 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3f17e0-43a7-4c04-9b90-c138254fa658 admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:30.282360 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561b9d01-1fdb-42b8-91fd-8651fc71f488 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:30.282991 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561b9d01-1fdb-42b8-91fd-8651fc71f488 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:30.283266 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561b9d01-1fdb-42b8-91fd-8651fc71f488 admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:30.283557 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561b9d01-1fdb-42b8-91fd-8651fc71f488 admin admin] PATH_INFO: `/v3/projects/29454440aac64e3eb1625b97e4b7ebae` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:30.284645 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561b9d01-1fdb-42b8-91fd-8651fc71f488 admin admin] RBAC: Authorizing `identity:delete_project(project_id=29454440aac64e3eb1625b97e4b7ebae)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:30.286599 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561b9d01-1fdb-42b8-91fd-8651fc71f488 admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:30.324999 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:47:30.336524 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-561b9d01-1fdb-42b8-91fd-8651fc71f488 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '29454440aac64e3eb1625b97e4b7ebae', 'request_id': 'req-561b9d01-1fdb-42b8-91fd-8651fc71f488'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:30.344103 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-561b9d01-1fdb-42b8-91fd-8651fc71f488 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '29454440aac64e3eb1625b97e4b7ebae', 'request_id': 'req-561b9d01-1fdb-42b8-91fd-8651fc71f488'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:30.350441 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-561b9d01-1fdb-42b8-91fd-8651fc71f488 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '29454440aac64e3eb1625b97e4b7ebae', 'request_id': 'req-561b9d01-1fdb-42b8-91fd-8651fc71f488'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:30.361093 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-561b9d01-1fdb-42b8-91fd-8651fc71f488 admin admin] The token cache is being invalidate because project 29454440aac64e3eb1625b97e4b7ebae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88112) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:47:30.361399 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-561b9d01-1fdb-42b8-91fd-8651fc71f488 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:30.362086 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-561b9d01-1fdb-42b8-91fd-8651fc71f488 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:30.363730 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1130/2265] 10.222.0.26 () {58 vars in 1233 bytes} [Wed Aug 24 05:47:30 2022] DELETE /identity/v3/projects/29454440aac64e3eb1625b97e4b7ebae => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:47:30.368637 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c29cf5-062e-4786-8518-972f0d3484b8 None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:30.369136 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c29cf5-062e-4786-8518-972f0d3484b8 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:30.369251 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c29cf5-062e-4786-8518-972f0d3484b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:30.389076 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-64c29cf5-062e-4786-8518-972f0d3484b8 None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:47:30.390298 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-64c29cf5-062e-4786-8518-972f0d3484b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:47:30.446613 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1136/2266] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:47:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:47:30.455285 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bfcc4f-5425-4b0c-80bb-6b4bf177ad94 None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:30.455575 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bfcc4f-5425-4b0c-80bb-6b4bf177ad94 None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:30.455852 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bfcc4f-5425-4b0c-80bb-6b4bf177ad94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:30.475175 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-c5bfcc4f-5425-4b0c-80bb-6b4bf177ad94 None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:47:30.476420 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-c5bfcc4f-5425-4b0c-80bb-6b4bf177ad94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:47:30.484440 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1131/2267] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:47:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:47:30.488633 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c29cf5-062e-4786-8518-972f0d3484b8 None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:30.493465 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:47:30.499404 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c29cf5-062e-4786-8518-972f0d3484b8 None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:30.505654 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c423bd77-928b-4211-8d0d-0f2bf95d7f1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:30.506608 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c423bd77-928b-4211-8d0d-0f2bf95d7f1c admin admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:30.507055 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c423bd77-928b-4211-8d0d-0f2bf95d7f1c admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:30.507749 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c423bd77-928b-4211-8d0d-0f2bf95d7f1c admin admin] PATH_INFO: `/v3/domains` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:30.508512 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c423bd77-928b-4211-8d0d-0f2bf95d7f1c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:47:30.508931 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c423bd77-928b-4211-8d0d-0f2bf95d7f1c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:30.510750 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c423bd77-928b-4211-8d0d-0f2bf95d7f1c admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:30.523339 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1137/2268] 10.222.0.26 () {58 vars in 1153 bytes} [Wed Aug 24 05:47:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:47:30.528163 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bfcc4f-5425-4b0c-80bb-6b4bf177ad94 None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:30.537978 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bfcc4f-5425-4b0c-80bb-6b4bf177ad94 None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:30.543254 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f59fb8-ce0c-4000-b5e4-68f821ef95dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:30.543455 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f59fb8-ce0c-4000-b5e4-68f821ef95dd admin admin] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:30.543735 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f59fb8-ce0c-4000-b5e4-68f821ef95dd admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:30.544008 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f59fb8-ce0c-4000-b5e4-68f821ef95dd admin admin] PATH_INFO: `/v3/projects` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:30.544739 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f59fb8-ce0c-4000-b5e4-68f821ef95dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:30.546713 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f59fb8-ce0c-4000-b5e4-68f821ef95dd admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:30.582910 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1132/2269] 10.222.0.26 () {60 vars in 1153 bytes} [Wed Aug 24 05:47:30 2022] POST /identity/v3/projects => generated 385 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:47:30.587317 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c423bd77-928b-4211-8d0d-0f2bf95d7f1c admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:30.597406 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c423bd77-928b-4211-8d0d-0f2bf95d7f1c admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:30.705769 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdd8def-9bb1-431d-bc68-a2bd8526584a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:30.708642 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdd8def-9bb1-431d-bc68-a2bd8526584a admin admin] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:30.708950 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdd8def-9bb1-431d-bc68-a2bd8526584a admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:30.709232 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdd8def-9bb1-431d-bc68-a2bd8526584a admin admin] PATH_INFO: `/v3/users` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:30.710514 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdd8def-9bb1-431d-bc68-a2bd8526584a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:30.712762 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdd8def-9bb1-431d-bc68-a2bd8526584a admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:30.747063 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f59fb8-ce0c-4000-b5e4-68f821ef95dd admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:30.753507 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1138/2270] 10.222.0.26 () {60 vars in 1144 bytes} [Wed Aug 24 05:47:30 2022] POST /identity/v3/users => generated 293 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 05:47:30.768060 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f59fb8-ce0c-4000-b5e4-68f821ef95dd admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:30.773142 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ac42b2-4bc0-4f20-9499-f5672f092758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:30.773916 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ac42b2-4bc0-4f20-9499-f5672f092758 admin admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:30.774441 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ac42b2-4bc0-4f20-9499-f5672f092758 admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:30.774639 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ac42b2-4bc0-4f20-9499-f5672f092758 admin admin] PATH_INFO: `/v3/roles` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:30.775300 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ac42b2-4bc0-4f20-9499-f5672f092758 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:30.777719 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ac42b2-4bc0-4f20-9499-f5672f092758 admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:30.789446 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1133/2271] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Aug 24 05:47:30 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:47:30.794005 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdd8def-9bb1-431d-bc68-a2bd8526584a admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:30.804567 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdd8def-9bb1-431d-bc68-a2bd8526584a admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:30.811902 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6c7fcb-908d-45da-afda-f5dd57e0169c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:30.812662 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6c7fcb-908d-45da-afda-f5dd57e0169c admin admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:30.813077 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6c7fcb-908d-45da-afda-f5dd57e0169c admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:30.813367 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6c7fcb-908d-45da-afda-f5dd57e0169c admin admin] PATH_INFO: `/v3/roles` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:30.814094 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6c7fcb-908d-45da-afda-f5dd57e0169c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:30.815877 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6c7fcb-908d-45da-afda-f5dd57e0169c admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:30.829994 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1139/2272] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Aug 24 05:47:30 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:47:30.831224 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ac42b2-4bc0-4f20-9499-f5672f092758 admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:30.841387 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ac42b2-4bc0-4f20-9499-f5672f092758 admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:30.846264 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57947c3-3cf7-4d71-a5b5-0851cdf8f5f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:30.846942 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57947c3-3cf7-4d71-a5b5-0851cdf8f5f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:30.847227 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57947c3-3cf7-4d71-a5b5-0851cdf8f5f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:30.847506 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57947c3-3cf7-4d71-a5b5-0851cdf8f5f8 admin admin] PATH_INFO: `/v3/projects/7ea989f4f87e41329ed40b30e9e5c5f5/users/c05850dd98c244bf8bccf184fe232fbd/roles/f7aa4a2c74c94c1b9ca8ecdcccccda5c` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:30.866390 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57947c3-3cf7-4d71-a5b5-0851cdf8f5f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ea989f4f87e41329ed40b30e9e5c5f5, user_id=c05850dd98c244bf8bccf184fe232fbd, role_id=f7aa4a2c74c94c1b9ca8ecdcccccda5c)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:30.869355 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57947c3-3cf7-4d71-a5b5-0851cdf8f5f8 admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:30.883471 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1134/2273] 10.222.0.26 () {60 vars in 1483 bytes} [Wed Aug 24 05:47:30 2022] PUT /identity/v3/projects/7ea989f4f87e41329ed40b30e9e5c5f5/users/c05850dd98c244bf8bccf184fe232fbd/roles/f7aa4a2c74c94c1b9ca8ecdcccccda5c => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:47:30.894638 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a02e6d3-30d6-42df-bd5a-9d5a4c47ff2f None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:30.894923 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a02e6d3-30d6-42df-bd5a-9d5a4c47ff2f None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:30.895624 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a02e6d3-30d6-42df-bd5a-9d5a4c47ff2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:30.940781 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-9a02e6d3-30d6-42df-bd5a-9d5a4c47ff2f None None] MFA Rules not processed for user `c05850dd98c244bf8bccf184fe232fbd`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:47:30.942400 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-9a02e6d3-30d6-42df-bd5a-9d5a4c47ff2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:47:31.017907 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1140/2274] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:47:30 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:47:31.030908 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57947c3-3cf7-4d71-a5b5-0851cdf8f5f8 admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:31.032603 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-e57947c3-3cf7-4d71-a5b5-0851cdf8f5f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:47:31.092486 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57947c3-3cf7-4d71-a5b5-0851cdf8f5f8 admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:31.096181 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b6013a-4009-4d5f-bcc0-18f4f4c8d702 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17b450afe795495680fc70f522c83750', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:31.096964 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b6013a-4009-4d5f-bcc0-18f4f4c8d702 service cinder] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:31.097355 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b6013a-4009-4d5f-bcc0-18f4f4c8d702 service cinder] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:31.097639 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b6013a-4009-4d5f-bcc0-18f4f4c8d702 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:31.106891 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b6013a-4009-4d5f-bcc0-18f4f4c8d702 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:31.108324 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b6013a-4009-4d5f-bcc0-18f4f4c8d702 service cinder] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:31.117996 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1135/2275] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 24 05:47:31 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:47:33.135097 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a02e6d3-30d6-42df-bd5a-9d5a4c47ff2f None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:33.137045 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-9a02e6d3-30d6-42df-bd5a-9d5a4c47ff2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:47:33.199215 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:47:33.203802 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a02e6d3-30d6-42df-bd5a-9d5a4c47ff2f None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:33.209510 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c120a617-b768-46b4-a9e5-e3777a7a9dd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:33.210157 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c120a617-b768-46b4-a9e5-e3777a7a9dd2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:33.210435 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c120a617-b768-46b4-a9e5-e3777a7a9dd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:33.210704 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c120a617-b768-46b4-a9e5-e3777a7a9dd2 admin admin] PATH_INFO: `/v3/users/9f192769928546a889537ee1fa3230e9` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:33.211800 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c120a617-b768-46b4-a9e5-e3777a7a9dd2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f192769928546a889537ee1fa3230e9)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:33.213734 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c120a617-b768-46b4-a9e5-e3777a7a9dd2 admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:33.258249 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-c120a617-b768-46b4-a9e5-e3777a7a9dd2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f192769928546a889537ee1fa3230e9'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:33.266079 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-c120a617-b768-46b4-a9e5-e3777a7a9dd2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f192769928546a889537ee1fa3230e9'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:33.266926 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-c120a617-b768-46b4-a9e5-e3777a7a9dd2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f192769928546a889537ee1fa3230e9'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:33.278774 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-c120a617-b768-46b4-a9e5-e3777a7a9dd2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f192769928546a889537ee1fa3230e9'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:33.285678 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-c120a617-b768-46b4-a9e5-e3777a7a9dd2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f192769928546a889537ee1fa3230e9'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:33.291488 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1141/2276] 10.222.0.26 () {58 vars in 1224 bytes} [Wed Aug 24 05:47:33 2022] DELETE /identity/v3/users/9f192769928546a889537ee1fa3230e9 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:47:33.296056 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f96c5c-9b47-4f1e-8cd3-4e969cc87228 None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:33.296564 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f96c5c-9b47-4f1e-8cd3-4e969cc87228 None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:33.296657 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f96c5c-9b47-4f1e-8cd3-4e969cc87228 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:33.317046 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-a5f96c5c-9b47-4f1e-8cd3-4e969cc87228 None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:47:33.318398 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-a5f96c5c-9b47-4f1e-8cd3-4e969cc87228 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:47:33.378627 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1136/2277] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:47:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:47:33.388795 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c120a617-b768-46b4-a9e5-e3777a7a9dd2 admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:33.390218 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-c120a617-b768-46b4-a9e5-e3777a7a9dd2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:47:33.445420 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c120a617-b768-46b4-a9e5-e3777a7a9dd2 admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:33.450193 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84628f6-48ff-4513-be96-9400a4e145c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '874348b647194ac2b5ecbf12c33bf59e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:33.450789 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84628f6-48ff-4513-be96-9400a4e145c6 service neutron] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:33.451066 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84628f6-48ff-4513-be96-9400a4e145c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:33.451336 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84628f6-48ff-4513-be96-9400a4e145c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:33.460214 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84628f6-48ff-4513-be96-9400a4e145c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:33.461636 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84628f6-48ff-4513-be96-9400a4e145c6 service neutron] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:33.471200 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1142/2278] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 24 05:47:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:47:33.756789 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f96c5c-9b47-4f1e-8cd3-4e969cc87228 None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:33.758350 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-a5f96c5c-9b47-4f1e-8cd3-4e969cc87228 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:47:33.766569 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:DELETE=5,keystone:SELECT=92,keystone:INSERT=3 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:47:33.780647 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f96c5c-9b47-4f1e-8cd3-4e969cc87228 None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:33.786777 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084127b4-1115-4750-bc54-e21248aa542a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:33.787703 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084127b4-1115-4750-bc54-e21248aa542a admin admin] REQUEST_METHOD: `DELETE` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:33.788355 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084127b4-1115-4750-bc54-e21248aa542a admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:33.788853 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084127b4-1115-4750-bc54-e21248aa542a admin admin] PATH_INFO: `/v3/projects/b1ec8861d1f4440085238e6e145971c8` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:33.790166 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084127b4-1115-4750-bc54-e21248aa542a admin admin] RBAC: Authorizing `identity:delete_project(project_id=b1ec8861d1f4440085238e6e145971c8)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:33.792878 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084127b4-1115-4750-bc54-e21248aa542a admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:33.849136 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-084127b4-1115-4750-bc54-e21248aa542a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b1ec8861d1f4440085238e6e145971c8', 'request_id': 'req-084127b4-1115-4750-bc54-e21248aa542a'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:33.858124 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-084127b4-1115-4750-bc54-e21248aa542a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b1ec8861d1f4440085238e6e145971c8', 'request_id': 'req-084127b4-1115-4750-bc54-e21248aa542a'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:33.865173 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-084127b4-1115-4750-bc54-e21248aa542a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b1ec8861d1f4440085238e6e145971c8', 'request_id': 'req-084127b4-1115-4750-bc54-e21248aa542a'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:33.878347 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-084127b4-1115-4750-bc54-e21248aa542a admin admin] The token cache is being invalidate because project b1ec8861d1f4440085238e6e145971c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88112) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:47:33.878704 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-084127b4-1115-4750-bc54-e21248aa542a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:33.879510 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-084127b4-1115-4750-bc54-e21248aa542a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:33.881518 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1137/2279] 10.222.0.26 () {58 vars in 1233 bytes} [Wed Aug 24 05:47:33 2022] DELETE /identity/v3/projects/b1ec8861d1f4440085238e6e145971c8 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:47:36.549319 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84628f6-48ff-4513-be96-9400a4e145c6 service neutron] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:36.551495 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-a84628f6-48ff-4513-be96-9400a4e145c6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:47:36.584895 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84628f6-48ff-4513-be96-9400a4e145c6 service neutron] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:36.676891 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f3a7a5-de31-463f-9183-ee39849bdec5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:36.677735 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f3a7a5-de31-463f-9183-ee39849bdec5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:36.678223 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f3a7a5-de31-463f-9183-ee39849bdec5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:36.678733 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f3a7a5-de31-463f-9183-ee39849bdec5 admin admin] PATH_INFO: `/v3/users/c05850dd98c244bf8bccf184fe232fbd` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:36.679935 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f3a7a5-de31-463f-9183-ee39849bdec5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c05850dd98c244bf8bccf184fe232fbd)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:36.681972 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f3a7a5-de31-463f-9183-ee39849bdec5 admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:36.709790 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:47:36.745008 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-33f3a7a5-de31-463f-9183-ee39849bdec5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c05850dd98c244bf8bccf184fe232fbd'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:36.752871 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-33f3a7a5-de31-463f-9183-ee39849bdec5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c05850dd98c244bf8bccf184fe232fbd'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:36.753644 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-33f3a7a5-de31-463f-9183-ee39849bdec5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c05850dd98c244bf8bccf184fe232fbd'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:36.767030 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-33f3a7a5-de31-463f-9183-ee39849bdec5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c05850dd98c244bf8bccf184fe232fbd'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:36.774940 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-33f3a7a5-de31-463f-9183-ee39849bdec5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c05850dd98c244bf8bccf184fe232fbd'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:36.782322 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1143/2280] 10.222.0.26 () {58 vars in 1224 bytes} [Wed Aug 24 05:47:36 2022] DELETE /identity/v3/users/c05850dd98c244bf8bccf184fe232fbd => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:47:36.786755 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd1864c-ecf9-4712-a316-51c37a1a9dd8 None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:36.787260 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd1864c-ecf9-4712-a316-51c37a1a9dd8 None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:36.787632 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd1864c-ecf9-4712-a316-51c37a1a9dd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:36.807145 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-8fd1864c-ecf9-4712-a316-51c37a1a9dd8 None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:47:36.808418 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-8fd1864c-ecf9-4712-a316-51c37a1a9dd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:47:36.875557 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1138/2281] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:47:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:47:36.885894 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f3a7a5-de31-463f-9183-ee39849bdec5 admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:36.888016 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-33f3a7a5-de31-463f-9183-ee39849bdec5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:47:36.958775 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f3a7a5-de31-463f-9183-ee39849bdec5 admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:36.962405 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4619b16-43fa-49e4-8448-6ec32834839e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '874348b647194ac2b5ecbf12c33bf59e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:36.963010 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4619b16-43fa-49e4-8448-6ec32834839e service neutron] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:36.963396 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4619b16-43fa-49e4-8448-6ec32834839e service neutron] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:36.963699 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4619b16-43fa-49e4-8448-6ec32834839e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:36.972873 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4619b16-43fa-49e4-8448-6ec32834839e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:36.974490 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4619b16-43fa-49e4-8448-6ec32834839e service neutron] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:36.984380 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1144/2282] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 24 05:47:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:47:37.247113 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd1864c-ecf9-4712-a316-51c37a1a9dd8 None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:37.248786 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-8fd1864c-ecf9-4712-a316-51c37a1a9dd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:47:37.263294 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd1864c-ecf9-4712-a316-51c37a1a9dd8 None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:37.270310 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa577c8-e1f2-4a02-b41c-2fdc09335bb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:37.271020 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa577c8-e1f2-4a02-b41c-2fdc09335bb6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:37.271385 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa577c8-e1f2-4a02-b41c-2fdc09335bb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:37.272392 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa577c8-e1f2-4a02-b41c-2fdc09335bb6 admin admin] PATH_INFO: `/v3/projects/7ea989f4f87e41329ed40b30e9e5c5f5` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:37.274688 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa577c8-e1f2-4a02-b41c-2fdc09335bb6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ea989f4f87e41329ed40b30e9e5c5f5)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:37.276815 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa577c8-e1f2-4a02-b41c-2fdc09335bb6 admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:37.331064 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-afa577c8-e1f2-4a02-b41c-2fdc09335bb6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ea989f4f87e41329ed40b30e9e5c5f5', 'request_id': 'req-afa577c8-e1f2-4a02-b41c-2fdc09335bb6'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:37.339370 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-afa577c8-e1f2-4a02-b41c-2fdc09335bb6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ea989f4f87e41329ed40b30e9e5c5f5', 'request_id': 'req-afa577c8-e1f2-4a02-b41c-2fdc09335bb6'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:37.346428 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-afa577c8-e1f2-4a02-b41c-2fdc09335bb6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ea989f4f87e41329ed40b30e9e5c5f5', 'request_id': 'req-afa577c8-e1f2-4a02-b41c-2fdc09335bb6'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:37.359418 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-afa577c8-e1f2-4a02-b41c-2fdc09335bb6 admin admin] The token cache is being invalidate because project 7ea989f4f87e41329ed40b30e9e5c5f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88112) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:47:37.359711 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-afa577c8-e1f2-4a02-b41c-2fdc09335bb6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:37.362260 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-afa577c8-e1f2-4a02-b41c-2fdc09335bb6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:37.362260 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1139/2283] 10.222.0.26 () {58 vars in 1233 bytes} [Wed Aug 24 05:47:37 2022] DELETE /identity/v3/projects/7ea989f4f87e41329ed40b30e9e5c5f5 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:47:37.366684 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9012b2ed-8c60-4b55-be1a-8e033eb54bd6 None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:37.366904 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9012b2ed-8c60-4b55-be1a-8e033eb54bd6 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:37.367180 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9012b2ed-8c60-4b55-be1a-8e033eb54bd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:37.396727 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-9012b2ed-8c60-4b55-be1a-8e033eb54bd6 None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:47:37.398058 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-9012b2ed-8c60-4b55-be1a-8e033eb54bd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:47:37.483987 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1145/2284] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:47:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:47:37.491637 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c421f0bf-423c-40e7-8120-3aa2fe07f9a1 None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:37.491924 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c421f0bf-423c-40e7-8120-3aa2fe07f9a1 None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:37.492193 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c421f0bf-423c-40e7-8120-3aa2fe07f9a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:37.512798 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-c421f0bf-423c-40e7-8120-3aa2fe07f9a1 None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:47:37.514021 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-c421f0bf-423c-40e7-8120-3aa2fe07f9a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:47:37.522130 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1140/2285] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:47:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:47:37.526555 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9012b2ed-8c60-4b55-be1a-8e033eb54bd6 None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:37.538099 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9012b2ed-8c60-4b55-be1a-8e033eb54bd6 None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:37.542672 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68816fa-c10a-4e0b-8642-b92cec83ac1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:37.543299 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68816fa-c10a-4e0b-8642-b92cec83ac1c admin admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:37.544127 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68816fa-c10a-4e0b-8642-b92cec83ac1c admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:37.545060 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68816fa-c10a-4e0b-8642-b92cec83ac1c admin admin] PATH_INFO: `/v3/domains` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:37.545358 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68816fa-c10a-4e0b-8642-b92cec83ac1c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:47:37.545547 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68816fa-c10a-4e0b-8642-b92cec83ac1c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:37.547295 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68816fa-c10a-4e0b-8642-b92cec83ac1c admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:37.564111 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1146/2286] 10.222.0.26 () {58 vars in 1153 bytes} [Wed Aug 24 05:47:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:47:37.565852 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c421f0bf-423c-40e7-8120-3aa2fe07f9a1 None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:37.570936 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:47:37.577302 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c421f0bf-423c-40e7-8120-3aa2fe07f9a1 None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:37.583560 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcfdb0b-6e1e-4859-9239-314a9a7efc91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:37.584233 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcfdb0b-6e1e-4859-9239-314a9a7efc91 admin admin] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:37.584527 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcfdb0b-6e1e-4859-9239-314a9a7efc91 admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:37.584797 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcfdb0b-6e1e-4859-9239-314a9a7efc91 admin admin] PATH_INFO: `/v3/projects` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:37.585580 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcfdb0b-6e1e-4859-9239-314a9a7efc91 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:37.588641 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcfdb0b-6e1e-4859-9239-314a9a7efc91 admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:37.626361 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1141/2287] 10.222.0.26 () {60 vars in 1153 bytes} [Wed Aug 24 05:47:37 2022] POST /identity/v3/projects => generated 385 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:47:37.630025 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68816fa-c10a-4e0b-8642-b92cec83ac1c admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:37.643747 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68816fa-c10a-4e0b-8642-b92cec83ac1c admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:37.683721 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:47:37.728943 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af693669-71ea-4251-a931-5348402efd48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:37.729662 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af693669-71ea-4251-a931-5348402efd48 admin admin] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:37.730052 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af693669-71ea-4251-a931-5348402efd48 admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:37.730399 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af693669-71ea-4251-a931-5348402efd48 admin admin] PATH_INFO: `/v3/users` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:37.731719 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af693669-71ea-4251-a931-5348402efd48 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:37.733806 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af693669-71ea-4251-a931-5348402efd48 admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:37.762485 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1147/2288] 10.222.0.26 () {60 vars in 1144 bytes} [Wed Aug 24 05:47:37 2022] POST /identity/v3/users => generated 293 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:47:37.766638 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcfdb0b-6e1e-4859-9239-314a9a7efc91 admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:37.777141 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcfdb0b-6e1e-4859-9239-314a9a7efc91 admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:37.783624 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa72c6f1-0b8b-45f0-877b-105828294893 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:37.784233 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa72c6f1-0b8b-45f0-877b-105828294893 admin admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:37.784521 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa72c6f1-0b8b-45f0-877b-105828294893 admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:37.784779 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa72c6f1-0b8b-45f0-877b-105828294893 admin admin] PATH_INFO: `/v3/roles` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:37.785452 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa72c6f1-0b8b-45f0-877b-105828294893 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:37.787064 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa72c6f1-0b8b-45f0-877b-105828294893 admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:37.798123 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1142/2289] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Aug 24 05:47:37 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 05:47:37.802087 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af693669-71ea-4251-a931-5348402efd48 admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:37.812418 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af693669-71ea-4251-a931-5348402efd48 admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:37.817222 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dc7f38-a2d1-433c-8d90-23489cecfef7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:37.817834 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dc7f38-a2d1-433c-8d90-23489cecfef7 admin admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:37.818153 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dc7f38-a2d1-433c-8d90-23489cecfef7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:37.818423 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dc7f38-a2d1-433c-8d90-23489cecfef7 admin admin] PATH_INFO: `/v3/roles` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:37.819213 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9dc7f38-a2d1-433c-8d90-23489cecfef7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:37.820835 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9dc7f38-a2d1-433c-8d90-23489cecfef7 admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:37.832322 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1148/2290] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Aug 24 05:47:37 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 05:47:37.836238 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa72c6f1-0b8b-45f0-877b-105828294893 admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:37.846827 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa72c6f1-0b8b-45f0-877b-105828294893 admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:37.851543 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbae8a2-4b10-494f-839c-e86bc9fdf4f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:37.852196 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbae8a2-4b10-494f-839c-e86bc9fdf4f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:37.852478 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbae8a2-4b10-494f-839c-e86bc9fdf4f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:37.852752 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbae8a2-4b10-494f-839c-e86bc9fdf4f0 admin admin] PATH_INFO: `/v3/projects/c0a16f76f46f4fc9ab6ae4d190b695dc/users/c4fe9c3ec7544540801e8b8f7ef3b079/roles/f7aa4a2c74c94c1b9ca8ecdcccccda5c` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:37.868685 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbae8a2-4b10-494f-839c-e86bc9fdf4f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0a16f76f46f4fc9ab6ae4d190b695dc, user_id=c4fe9c3ec7544540801e8b8f7ef3b079, role_id=f7aa4a2c74c94c1b9ca8ecdcccccda5c)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:37.871380 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbae8a2-4b10-494f-839c-e86bc9fdf4f0 admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:37.884491 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1143/2291] 10.222.0.26 () {60 vars in 1483 bytes} [Wed Aug 24 05:47:37 2022] PUT /identity/v3/projects/c0a16f76f46f4fc9ab6ae4d190b695dc/users/c4fe9c3ec7544540801e8b8f7ef3b079/roles/f7aa4a2c74c94c1b9ca8ecdcccccda5c => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 05:47:37.894742 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737af016-d137-4bae-b65e-b9f6a746c201 None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:37.895035 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737af016-d137-4bae-b65e-b9f6a746c201 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:37.895314 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737af016-d137-4bae-b65e-b9f6a746c201 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:37.924262 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-737af016-d137-4bae-b65e-b9f6a746c201 None None] MFA Rules not processed for user `c4fe9c3ec7544540801e8b8f7ef3b079`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:47:37.925580 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-737af016-d137-4bae-b65e-b9f6a746c201 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:47:37.990505 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1149/2292] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:47:37 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:47:37.995001 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbae8a2-4b10-494f-839c-e86bc9fdf4f0 admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:38.059721 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbae8a2-4b10-494f-839c-e86bc9fdf4f0 admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:38.064406 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33bd524-ce3e-4b94-b3ae-bda3eb8525b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:38.065016 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33bd524-ce3e-4b94-b3ae-bda3eb8525b9 admin admin] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:38.065297 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33bd524-ce3e-4b94-b3ae-bda3eb8525b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:38.065570 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33bd524-ce3e-4b94-b3ae-bda3eb8525b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:38.066233 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33bd524-ce3e-4b94-b3ae-bda3eb8525b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:38.068133 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33bd524-ce3e-4b94-b3ae-bda3eb8525b9 admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:38.099560 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1144/2293] 10.222.0.26 () {60 vars in 1153 bytes} [Wed Aug 24 05:47:37 2022] POST /identity/v3/projects => generated 385 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:47:38.100722 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737af016-d137-4bae-b65e-b9f6a746c201 None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:38.113525 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737af016-d137-4bae-b65e-b9f6a746c201 None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:38.169647 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7db17ca-4d13-44d1-84a2-ae2a2866190a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:38.170185 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7db17ca-4d13-44d1-84a2-ae2a2866190a admin admin] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:38.170466 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7db17ca-4d13-44d1-84a2-ae2a2866190a admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:38.170738 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7db17ca-4d13-44d1-84a2-ae2a2866190a admin admin] PATH_INFO: `/v3/users` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:38.171355 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7db17ca-4d13-44d1-84a2-ae2a2866190a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:38.173272 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7db17ca-4d13-44d1-84a2-ae2a2866190a admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:38.193682 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1150/2294] 10.222.0.26 () {60 vars in 1144 bytes} [Wed Aug 24 05:47:38 2022] POST /identity/v3/users => generated 293 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:47:38.197990 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33bd524-ce3e-4b94-b3ae-bda3eb8525b9 admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:38.208491 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33bd524-ce3e-4b94-b3ae-bda3eb8525b9 admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:38.213453 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d069e189-8064-4557-b82d-d06f249b24a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:38.214091 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d069e189-8064-4557-b82d-d06f249b24a4 admin admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:38.214374 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d069e189-8064-4557-b82d-d06f249b24a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:38.214649 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d069e189-8064-4557-b82d-d06f249b24a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:38.215417 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d069e189-8064-4557-b82d-d06f249b24a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:38.217005 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d069e189-8064-4557-b82d-d06f249b24a4 admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:38.227287 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1145/2295] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Aug 24 05:47:38 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:47:38.231561 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7db17ca-4d13-44d1-84a2-ae2a2866190a admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:38.241376 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7db17ca-4d13-44d1-84a2-ae2a2866190a admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:38.245977 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd45227e-0cfe-46fc-afd5-a2304d21f669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:38.247182 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd45227e-0cfe-46fc-afd5-a2304d21f669 admin admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:38.247467 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd45227e-0cfe-46fc-afd5-a2304d21f669 admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:38.247738 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd45227e-0cfe-46fc-afd5-a2304d21f669 admin admin] PATH_INFO: `/v3/roles` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:38.248376 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd45227e-0cfe-46fc-afd5-a2304d21f669 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:38.249990 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd45227e-0cfe-46fc-afd5-a2304d21f669 admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:38.259637 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1151/2296] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Aug 24 05:47:38 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:47:38.263672 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d069e189-8064-4557-b82d-d06f249b24a4 admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:38.273378 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d069e189-8064-4557-b82d-d06f249b24a4 admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:38.278065 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600e79da-1d02-4244-aff8-5f95248bb8d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:38.278714 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600e79da-1d02-4244-aff8-5f95248bb8d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:38.278994 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600e79da-1d02-4244-aff8-5f95248bb8d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:38.279266 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600e79da-1d02-4244-aff8-5f95248bb8d0 admin admin] PATH_INFO: `/v3/projects/333dedf8a3b44d5e94d17950d847710f/users/7a6c6b4754424816854eb0d6dbac0758/roles/f7aa4a2c74c94c1b9ca8ecdcccccda5c` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:38.294234 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600e79da-1d02-4244-aff8-5f95248bb8d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=333dedf8a3b44d5e94d17950d847710f, user_id=7a6c6b4754424816854eb0d6dbac0758, role_id=f7aa4a2c74c94c1b9ca8ecdcccccda5c)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:38.296854 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600e79da-1d02-4244-aff8-5f95248bb8d0 admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:38.308900 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1146/2297] 10.222.0.26 () {60 vars in 1483 bytes} [Wed Aug 24 05:47:38 2022] PUT /identity/v3/projects/333dedf8a3b44d5e94d17950d847710f/users/7a6c6b4754424816854eb0d6dbac0758/roles/f7aa4a2c74c94c1b9ca8ecdcccccda5c => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:47:38.320388 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409b8d49-0f25-4f90-9864-acefefdec345 None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:38.320681 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409b8d49-0f25-4f90-9864-acefefdec345 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:38.320951 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409b8d49-0f25-4f90-9864-acefefdec345 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:38.348978 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-409b8d49-0f25-4f90-9864-acefefdec345 None None] MFA Rules not processed for user `7a6c6b4754424816854eb0d6dbac0758`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:47:38.350218 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-409b8d49-0f25-4f90-9864-acefefdec345 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:47:38.354099 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:47:38.422935 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1152/2298] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:47:38 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:47:38.427352 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600e79da-1d02-4244-aff8-5f95248bb8d0 admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:38.485888 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:47:38.492125 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600e79da-1d02-4244-aff8-5f95248bb8d0 admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:38.497670 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b6e3af-7ea4-4ff9-b20b-f9348afba571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:38.498315 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b6e3af-7ea4-4ff9-b20b-f9348afba571 admin admin] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:38.498604 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b6e3af-7ea4-4ff9-b20b-f9348afba571 admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:38.498869 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b6e3af-7ea4-4ff9-b20b-f9348afba571 admin admin] PATH_INFO: `/v3/projects` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:38.499497 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b6e3af-7ea4-4ff9-b20b-f9348afba571 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:38.501401 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b6e3af-7ea4-4ff9-b20b-f9348afba571 admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:38.527654 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1147/2299] 10.222.0.26 () {60 vars in 1153 bytes} [Wed Aug 24 05:47:38 2022] POST /identity/v3/projects => generated 383 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:47:38.531739 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409b8d49-0f25-4f90-9864-acefefdec345 None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:38.542922 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409b8d49-0f25-4f90-9864-acefefdec345 None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:38.599136 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c5dc76-9b2f-40d4-894f-3d41f726b8b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:38.599763 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c5dc76-9b2f-40d4-894f-3d41f726b8b9 admin admin] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:38.600006 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c5dc76-9b2f-40d4-894f-3d41f726b8b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:38.600280 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c5dc76-9b2f-40d4-894f-3d41f726b8b9 admin admin] PATH_INFO: `/v3/users` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:38.600919 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c5dc76-9b2f-40d4-894f-3d41f726b8b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:38.602886 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c5dc76-9b2f-40d4-894f-3d41f726b8b9 admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:38.624899 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1153/2300] 10.222.0.26 () {60 vars in 1144 bytes} [Wed Aug 24 05:47:38 2022] POST /identity/v3/users => generated 298 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:47:38.628625 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b6e3af-7ea4-4ff9-b20b-f9348afba571 admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:38.639593 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b6e3af-7ea4-4ff9-b20b-f9348afba571 admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:38.644504 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d00a25c-97e7-481f-a45d-7b66b196b068 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:38.645103 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d00a25c-97e7-481f-a45d-7b66b196b068 admin admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:38.645387 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d00a25c-97e7-481f-a45d-7b66b196b068 admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:38.645659 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d00a25c-97e7-481f-a45d-7b66b196b068 admin admin] PATH_INFO: `/v3/roles` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:38.646358 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d00a25c-97e7-481f-a45d-7b66b196b068 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:38.647978 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d00a25c-97e7-481f-a45d-7b66b196b068 admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:38.658713 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1148/2301] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Aug 24 05:47:38 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:47:38.662837 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c5dc76-9b2f-40d4-894f-3d41f726b8b9 admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:38.672841 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c5dc76-9b2f-40d4-894f-3d41f726b8b9 admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:38.677575 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb01269-0ce6-4a9a-adb7-4f6957ea6859 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:38.678199 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb01269-0ce6-4a9a-adb7-4f6957ea6859 admin admin] REQUEST_METHOD: `PUT` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:38.678483 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb01269-0ce6-4a9a-adb7-4f6957ea6859 admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:38.678762 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb01269-0ce6-4a9a-adb7-4f6957ea6859 admin admin] PATH_INFO: `/v3/projects/7391777418e248a9a05ee79753358051/users/8909c228b2904262b0fe5c90bfd42675/roles/640bda0879494e60b72680ee505285f0` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:38.695001 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb01269-0ce6-4a9a-adb7-4f6957ea6859 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7391777418e248a9a05ee79753358051, user_id=8909c228b2904262b0fe5c90bfd42675, role_id=640bda0879494e60b72680ee505285f0)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:38.697988 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb01269-0ce6-4a9a-adb7-4f6957ea6859 admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:38.712567 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1154/2302] 10.222.0.26 () {60 vars in 1483 bytes} [Wed Aug 24 05:47:38 2022] PUT /identity/v3/projects/7391777418e248a9a05ee79753358051/users/8909c228b2904262b0fe5c90bfd42675/roles/640bda0879494e60b72680ee505285f0 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:47:38.716533 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d00a25c-97e7-481f-a45d-7b66b196b068 admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:38.727936 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d00a25c-97e7-481f-a45d-7b66b196b068 admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:38.789627 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbf1129-af17-4ea0-818c-8e1791fab59c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:38.790130 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbf1129-af17-4ea0-818c-8e1791fab59c admin admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:38.790690 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbf1129-af17-4ea0-818c-8e1791fab59c admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:38.790980 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbf1129-af17-4ea0-818c-8e1791fab59c admin admin] PATH_INFO: `/v3/roles` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:38.791637 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbf1129-af17-4ea0-818c-8e1791fab59c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:38.793240 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbf1129-af17-4ea0-818c-8e1791fab59c admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:38.804308 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1149/2303] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Aug 24 05:47:38 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:47:38.808200 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb01269-0ce6-4a9a-adb7-4f6957ea6859 admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:38.826071 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb01269-0ce6-4a9a-adb7-4f6957ea6859 admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:38.826071 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9192bf09-1ccd-4752-bdfe-92aac1fd9f73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:38.826071 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9192bf09-1ccd-4752-bdfe-92aac1fd9f73 admin admin] REQUEST_METHOD: `PUT` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:38.826376 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9192bf09-1ccd-4752-bdfe-92aac1fd9f73 admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:38.826610 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9192bf09-1ccd-4752-bdfe-92aac1fd9f73 admin admin] PATH_INFO: `/v3/projects/7391777418e248a9a05ee79753358051/users/8909c228b2904262b0fe5c90bfd42675/roles/640bda0879494e60b72680ee505285f0` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:38.828708 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9192bf09-1ccd-4752-bdfe-92aac1fd9f73 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7391777418e248a9a05ee79753358051, user_id=8909c228b2904262b0fe5c90bfd42675, role_id=640bda0879494e60b72680ee505285f0)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:38.831674 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9192bf09-1ccd-4752-bdfe-92aac1fd9f73 admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:38.846588 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1155/2304] 10.222.0.26 () {60 vars in 1483 bytes} [Wed Aug 24 05:47:38 2022] PUT /identity/v3/projects/7391777418e248a9a05ee79753358051/users/8909c228b2904262b0fe5c90bfd42675/roles/640bda0879494e60b72680ee505285f0 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 05:47:38.857649 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dcbe81-c382-4bc2-b233-9fb3e7e7889d None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:38.857968 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dcbe81-c382-4bc2-b233-9fb3e7e7889d None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:38.858252 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dcbe81-c382-4bc2-b233-9fb3e7e7889d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:38.892586 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-81dcbe81-c382-4bc2-b233-9fb3e7e7889d None None] MFA Rules not processed for user `8909c228b2904262b0fe5c90bfd42675`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:47:38.893876 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-81dcbe81-c382-4bc2-b233-9fb3e7e7889d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:47:39.011035 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1150/2305] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:47:38 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:47:39.023349 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9192bf09-1ccd-4752-bdfe-92aac1fd9f73 admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:39.025977 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-9192bf09-1ccd-4752-bdfe-92aac1fd9f73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:47:39.128331 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9192bf09-1ccd-4752-bdfe-92aac1fd9f73 admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:39.132397 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c60b5d-c8bf-4dc7-a0fc-663ad5970e7c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17b450afe795495680fc70f522c83750', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:39.133205 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c60b5d-c8bf-4dc7-a0fc-663ad5970e7c service cinder] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:39.133487 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c60b5d-c8bf-4dc7-a0fc-663ad5970e7c service cinder] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:39.133819 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c60b5d-c8bf-4dc7-a0fc-663ad5970e7c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:39.147456 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:47:39.202383 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c60b5d-c8bf-4dc7-a0fc-663ad5970e7c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:39.203817 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c60b5d-c8bf-4dc7-a0fc-663ad5970e7c service cinder] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:39.213653 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1156/2306] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 24 05:47:39 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:47:40.753630 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dcbe81-c382-4bc2-b233-9fb3e7e7889d None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:40.755191 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-81dcbe81-c382-4bc2-b233-9fb3e7e7889d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:47:40.767019 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dcbe81-c382-4bc2-b233-9fb3e7e7889d None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:40.770555 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd7307e-29df-4691-9797-b00dc4cce2ea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17b450afe795495680fc70f522c83750', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:40.771151 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd7307e-29df-4691-9797-b00dc4cce2ea service cinder] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:40.771429 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd7307e-29df-4691-9797-b00dc4cce2ea service cinder] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:40.771696 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd7307e-29df-4691-9797-b00dc4cce2ea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:40.818247 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:47:40.829001 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd7307e-29df-4691-9797-b00dc4cce2ea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:40.830467 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd7307e-29df-4691-9797-b00dc4cce2ea service cinder] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:40.839177 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1151/2307] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 24 05:47:40 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:47:41.421248 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c60b5d-c8bf-4dc7-a0fc-663ad5970e7c service cinder] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:41.431462 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c60b5d-c8bf-4dc7-a0fc-663ad5970e7c service cinder] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:41.435956 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed8d80b-8efa-4643-a8d4-27510c5989dd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17b450afe795495680fc70f522c83750', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:41.436571 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed8d80b-8efa-4643-a8d4-27510c5989dd service cinder] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:41.436853 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed8d80b-8efa-4643-a8d4-27510c5989dd service cinder] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:41.437126 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed8d80b-8efa-4643-a8d4-27510c5989dd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:41.459565 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed8d80b-8efa-4643-a8d4-27510c5989dd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:41.459998 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed8d80b-8efa-4643-a8d4-27510c5989dd service cinder] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:41.471202 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1157/2308] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 24 05:47:41 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:47:45.420871 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd7307e-29df-4691-9797-b00dc4cce2ea service cinder] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:45.511033 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd7307e-29df-4691-9797-b00dc4cce2ea service cinder] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:45.517046 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aeba266-021a-4b9b-86ff-9ed4075f9631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:45.517739 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aeba266-021a-4b9b-86ff-9ed4075f9631 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:45.518179 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aeba266-021a-4b9b-86ff-9ed4075f9631 admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:45.518543 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aeba266-021a-4b9b-86ff-9ed4075f9631 admin admin] PATH_INFO: `/v3/users/c4fe9c3ec7544540801e8b8f7ef3b079` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:45.520359 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aeba266-021a-4b9b-86ff-9ed4075f9631 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c4fe9c3ec7544540801e8b8f7ef3b079)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:45.523400 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aeba266-021a-4b9b-86ff-9ed4075f9631 admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:45.587800 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-1aeba266-021a-4b9b-86ff-9ed4075f9631 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c4fe9c3ec7544540801e8b8f7ef3b079'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:45.595558 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-1aeba266-021a-4b9b-86ff-9ed4075f9631 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c4fe9c3ec7544540801e8b8f7ef3b079'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:45.612564 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-1aeba266-021a-4b9b-86ff-9ed4075f9631 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c4fe9c3ec7544540801e8b8f7ef3b079'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:45.623624 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-1aeba266-021a-4b9b-86ff-9ed4075f9631 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c4fe9c3ec7544540801e8b8f7ef3b079'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:45.625170 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-1aeba266-021a-4b9b-86ff-9ed4075f9631 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c4fe9c3ec7544540801e8b8f7ef3b079'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:45.641061 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1152/2309] 10.222.0.26 () {58 vars in 1224 bytes} [Wed Aug 24 05:47:45 2022] DELETE /identity/v3/users/c4fe9c3ec7544540801e8b8f7ef3b079 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:47:45.645238 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad95f496-dcf2-4b3d-b851-e79a373e734a None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:45.646123 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad95f496-dcf2-4b3d-b851-e79a373e734a None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:45.646563 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad95f496-dcf2-4b3d-b851-e79a373e734a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:45.674148 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-ad95f496-dcf2-4b3d-b851-e79a373e734a None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:47:45.675642 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-ad95f496-dcf2-4b3d-b851-e79a373e734a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:47:45.698844 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aeba266-021a-4b9b-86ff-9ed4075f9631 admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:45.701310 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-1aeba266-021a-4b9b-86ff-9ed4075f9631 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:47:45.753846 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1158/2310] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:47:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:47:45.764007 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad95f496-dcf2-4b3d-b851-e79a373e734a None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:45.765342 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-ad95f496-dcf2-4b3d-b851-e79a373e734a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:47:45.782135 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aeba266-021a-4b9b-86ff-9ed4075f9631 admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:45.788187 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570a1863-d08b-4fe0-ad86-240b99af846b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:45.788814 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570a1863-d08b-4fe0-ad86-240b99af846b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:45.789095 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570a1863-d08b-4fe0-ad86-240b99af846b admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:45.789365 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570a1863-d08b-4fe0-ad86-240b99af846b admin admin] PATH_INFO: `/v3/users/b0126aa8d30a4cb3b8a790679ef7391b` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:45.790529 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570a1863-d08b-4fe0-ad86-240b99af846b admin admin] RBAC: Authorizing `identity:delete_user(user_id=b0126aa8d30a4cb3b8a790679ef7391b)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:45.792468 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570a1863-d08b-4fe0-ad86-240b99af846b admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:45.803569 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:47:45.824776 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad95f496-dcf2-4b3d-b851-e79a373e734a None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:45.828731 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222442cf-7bd5-497f-94be-39af0462a07c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '874348b647194ac2b5ecbf12c33bf59e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:45.829338 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222442cf-7bd5-497f-94be-39af0462a07c service neutron] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:45.829617 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222442cf-7bd5-497f-94be-39af0462a07c service neutron] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:45.830242 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222442cf-7bd5-497f-94be-39af0462a07c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:45.839217 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222442cf-7bd5-497f-94be-39af0462a07c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:45.840689 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222442cf-7bd5-497f-94be-39af0462a07c service neutron] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:45.842387 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-570a1863-d08b-4fe0-ad86-240b99af846b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b0126aa8d30a4cb3b8a790679ef7391b'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:45.849743 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-570a1863-d08b-4fe0-ad86-240b99af846b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b0126aa8d30a4cb3b8a790679ef7391b'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:45.850232 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1159/2311] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 24 05:47:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 05:47:45.863238 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-570a1863-d08b-4fe0-ad86-240b99af846b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b0126aa8d30a4cb3b8a790679ef7391b'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:45.872327 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-570a1863-d08b-4fe0-ad86-240b99af846b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b0126aa8d30a4cb3b8a790679ef7391b'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:45.872960 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-570a1863-d08b-4fe0-ad86-240b99af846b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b0126aa8d30a4cb3b8a790679ef7391b'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:45.880134 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1153/2312] 10.222.0.26 () {58 vars in 1224 bytes} [Wed Aug 24 05:47:45 2022] DELETE /identity/v3/users/b0126aa8d30a4cb3b8a790679ef7391b => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:47:46.051630 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222442cf-7bd5-497f-94be-39af0462a07c service neutron] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:46.064375 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222442cf-7bd5-497f-94be-39af0462a07c service neutron] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:46.108299 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:47:46.128467 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd743735-7a87-4c81-a482-cfc97c9aeee9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:46.129353 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd743735-7a87-4c81-a482-cfc97c9aeee9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:46.129640 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd743735-7a87-4c81-a482-cfc97c9aeee9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:46.130000 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd743735-7a87-4c81-a482-cfc97c9aeee9 admin admin] PATH_INFO: `/v3/projects/24eeedd3eba24ca6884cea6eb27a060b` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:46.131247 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd743735-7a87-4c81-a482-cfc97c9aeee9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=24eeedd3eba24ca6884cea6eb27a060b)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:46.133143 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd743735-7a87-4c81-a482-cfc97c9aeee9 admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:46.138212 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570a1863-d08b-4fe0-ad86-240b99af846b admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:46.139728 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-570a1863-d08b-4fe0-ad86-240b99af846b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:47:46.153906 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570a1863-d08b-4fe0-ad86-240b99af846b admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:46.158695 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a0bba8-f70b-4f40-af2b-1ba2c6887703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:46.159407 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a0bba8-f70b-4f40-af2b-1ba2c6887703 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:46.159767 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a0bba8-f70b-4f40-af2b-1ba2c6887703 admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:46.160119 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a0bba8-f70b-4f40-af2b-1ba2c6887703 admin admin] PATH_INFO: `/v3/projects/c0a16f76f46f4fc9ab6ae4d190b695dc` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:46.161332 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a0bba8-f70b-4f40-af2b-1ba2c6887703 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c0a16f76f46f4fc9ab6ae4d190b695dc)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:46.163363 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a0bba8-f70b-4f40-af2b-1ba2c6887703 admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:46.191007 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-cd743735-7a87-4c81-a482-cfc97c9aeee9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '24eeedd3eba24ca6884cea6eb27a060b', 'request_id': 'req-cd743735-7a87-4c81-a482-cfc97c9aeee9'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:46.198516 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-cd743735-7a87-4c81-a482-cfc97c9aeee9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '24eeedd3eba24ca6884cea6eb27a060b', 'request_id': 'req-cd743735-7a87-4c81-a482-cfc97c9aeee9'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:46.205495 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-cd743735-7a87-4c81-a482-cfc97c9aeee9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '24eeedd3eba24ca6884cea6eb27a060b', 'request_id': 'req-cd743735-7a87-4c81-a482-cfc97c9aeee9'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:46.214437 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-d9a0bba8-f70b-4f40-af2b-1ba2c6887703 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c0a16f76f46f4fc9ab6ae4d190b695dc', 'request_id': 'req-d9a0bba8-f70b-4f40-af2b-1ba2c6887703'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:46.216920 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-cd743735-7a87-4c81-a482-cfc97c9aeee9 admin admin] The token cache is being invalidate because project 24eeedd3eba24ca6884cea6eb27a060b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:47:46.217206 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-cd743735-7a87-4c81-a482-cfc97c9aeee9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:46.217881 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-cd743735-7a87-4c81-a482-cfc97c9aeee9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:46.219744 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1160/2313] 10.222.0.26 () {58 vars in 1233 bytes} [Wed Aug 24 05:47:46 2022] DELETE /identity/v3/projects/24eeedd3eba24ca6884cea6eb27a060b => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:47:46.222671 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-d9a0bba8-f70b-4f40-af2b-1ba2c6887703 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c0a16f76f46f4fc9ab6ae4d190b695dc', 'request_id': 'req-d9a0bba8-f70b-4f40-af2b-1ba2c6887703'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:46.223721 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd743735-7a87-4c81-a482-cfc97c9aeee9 admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:46.225054 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-cd743735-7a87-4c81-a482-cfc97c9aeee9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:47:46.229070 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-d9a0bba8-f70b-4f40-af2b-1ba2c6887703 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c0a16f76f46f4fc9ab6ae4d190b695dc', 'request_id': 'req-d9a0bba8-f70b-4f40-af2b-1ba2c6887703'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:46.239570 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-d9a0bba8-f70b-4f40-af2b-1ba2c6887703 admin admin] The token cache is being invalidate because project c0a16f76f46f4fc9ab6ae4d190b695dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88112) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:47:46.239858 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-d9a0bba8-f70b-4f40-af2b-1ba2c6887703 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:46.240525 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-d9a0bba8-f70b-4f40-af2b-1ba2c6887703 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:46.242221 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1154/2314] 10.222.0.26 () {58 vars in 1233 bytes} [Wed Aug 24 05:47:46 2022] DELETE /identity/v3/projects/c0a16f76f46f4fc9ab6ae4d190b695dc => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 05:47:46.245839 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a0bba8-f70b-4f40-af2b-1ba2c6887703 admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:46.247750 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-d9a0bba8-f70b-4f40-af2b-1ba2c6887703 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:47:46.289997 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd743735-7a87-4c81-a482-cfc97c9aeee9 admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:46.312545 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a0bba8-f70b-4f40-af2b-1ba2c6887703 admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:46.317091 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a30ea03-bb06-406b-aa12-7bddf724b869 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:46.317718 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a30ea03-bb06-406b-aa12-7bddf724b869 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:46.318027 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a30ea03-bb06-406b-aa12-7bddf724b869 admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:46.318300 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a30ea03-bb06-406b-aa12-7bddf724b869 admin admin] PATH_INFO: `/v3/users/7a6c6b4754424816854eb0d6dbac0758` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:46.319438 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a30ea03-bb06-406b-aa12-7bddf724b869 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a6c6b4754424816854eb0d6dbac0758)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:46.321373 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a30ea03-bb06-406b-aa12-7bddf724b869 admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:46.335329 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:DELETE=18,keystone:SELECT=80,keystone:INSERT=2 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:47:46.350956 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf26d8a4-113a-4dca-bd50-61da3d39f6d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:46.351598 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf26d8a4-113a-4dca-bd50-61da3d39f6d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:46.351870 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf26d8a4-113a-4dca-bd50-61da3d39f6d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:46.352142 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf26d8a4-113a-4dca-bd50-61da3d39f6d2 admin admin] PATH_INFO: `/v3/users/f71fa47acf0149099797f4b5d3281f6d` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:46.353373 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf26d8a4-113a-4dca-bd50-61da3d39f6d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f71fa47acf0149099797f4b5d3281f6d)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:46.355339 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf26d8a4-113a-4dca-bd50-61da3d39f6d2 admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:46.372858 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-4a30ea03-bb06-406b-aa12-7bddf724b869 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a6c6b4754424816854eb0d6dbac0758'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:46.379180 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:47:46.380725 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-4a30ea03-bb06-406b-aa12-7bddf724b869 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a6c6b4754424816854eb0d6dbac0758'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:46.393369 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-4a30ea03-bb06-406b-aa12-7bddf724b869 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a6c6b4754424816854eb0d6dbac0758'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:46.401014 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-4a30ea03-bb06-406b-aa12-7bddf724b869 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a6c6b4754424816854eb0d6dbac0758'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:46.401661 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-4a30ea03-bb06-406b-aa12-7bddf724b869 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a6c6b4754424816854eb0d6dbac0758'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:46.407976 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1155/2315] 10.222.0.26 () {58 vars in 1224 bytes} [Wed Aug 24 05:47:46 2022] DELETE /identity/v3/users/7a6c6b4754424816854eb0d6dbac0758 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 05:47:46.415181 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-cf26d8a4-113a-4dca-bd50-61da3d39f6d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f71fa47acf0149099797f4b5d3281f6d'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:46.423114 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-cf26d8a4-113a-4dca-bd50-61da3d39f6d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f71fa47acf0149099797f4b5d3281f6d'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:46.423845 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-cf26d8a4-113a-4dca-bd50-61da3d39f6d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f71fa47acf0149099797f4b5d3281f6d'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:46.437562 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-cf26d8a4-113a-4dca-bd50-61da3d39f6d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f71fa47acf0149099797f4b5d3281f6d'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:46.446313 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-cf26d8a4-113a-4dca-bd50-61da3d39f6d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f71fa47acf0149099797f4b5d3281f6d'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:46.452769 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1161/2316] 10.222.0.26 () {58 vars in 1224 bytes} [Wed Aug 24 05:47:46 2022] DELETE /identity/v3/users/f71fa47acf0149099797f4b5d3281f6d => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:47:46.625906 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfca2ee7-fafd-4426-8eff-611288619c6f None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:46.626808 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfca2ee7-fafd-4426-8eff-611288619c6f None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:46.627126 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfca2ee7-fafd-4426-8eff-611288619c6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:46.647689 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-cfca2ee7-fafd-4426-8eff-611288619c6f None None] MFA Rules not processed for user `6c2c08b27a0f4943b5da908eb7b1cd96`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:47:46.648929 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-cfca2ee7-fafd-4426-8eff-611288619c6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:47:46.711040 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf26d8a4-113a-4dca-bd50-61da3d39f6d2 admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:46.713259 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-cf26d8a4-113a-4dca-bd50-61da3d39f6d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:47:46.750901 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1156/2317] 10.222.0.26 () {58 vars in 1009 bytes} [Wed Aug 24 05:47:46 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 05:47:46.804167 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf26d8a4-113a-4dca-bd50-61da3d39f6d2 admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:46.812120 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcf83da-88bd-4f52-94aa-8d845bd1f7cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:46.812120 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcf83da-88bd-4f52-94aa-8d845bd1f7cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:46.812120 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcf83da-88bd-4f52-94aa-8d845bd1f7cb admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:46.812120 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcf83da-88bd-4f52-94aa-8d845bd1f7cb admin admin] PATH_INFO: `/v3/projects/406f1a7e25254dca9626de39969f0943` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:46.813064 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfca2ee7-fafd-4426-8eff-611288619c6f None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:46.813982 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcf83da-88bd-4f52-94aa-8d845bd1f7cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=406f1a7e25254dca9626de39969f0943)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:46.814507 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-cfca2ee7-fafd-4426-8eff-611288619c6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:47:46.816333 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcf83da-88bd-4f52-94aa-8d845bd1f7cb admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:46.837508 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfca2ee7-fafd-4426-8eff-611288619c6f None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:46.844903 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2181b256-4c11-4d1a-8b0c-b491ba14aa57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:46.845671 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2181b256-4c11-4d1a-8b0c-b491ba14aa57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:46.846062 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2181b256-4c11-4d1a-8b0c-b491ba14aa57 admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:46.846637 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2181b256-4c11-4d1a-8b0c-b491ba14aa57 admin admin] PATH_INFO: `/v3/projects/333dedf8a3b44d5e94d17950d847710f` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:46.847968 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2181b256-4c11-4d1a-8b0c-b491ba14aa57 admin admin] RBAC: Authorizing `identity:delete_project(project_id=333dedf8a3b44d5e94d17950d847710f)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:46.850761 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2181b256-4c11-4d1a-8b0c-b491ba14aa57 admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:46.899970 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-fbcf83da-88bd-4f52-94aa-8d845bd1f7cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '406f1a7e25254dca9626de39969f0943', 'request_id': 'req-fbcf83da-88bd-4f52-94aa-8d845bd1f7cb'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:46.908292 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-fbcf83da-88bd-4f52-94aa-8d845bd1f7cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '406f1a7e25254dca9626de39969f0943', 'request_id': 'req-fbcf83da-88bd-4f52-94aa-8d845bd1f7cb'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:46.915863 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-fbcf83da-88bd-4f52-94aa-8d845bd1f7cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '406f1a7e25254dca9626de39969f0943', 'request_id': 'req-fbcf83da-88bd-4f52-94aa-8d845bd1f7cb'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:46.919895 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-2181b256-4c11-4d1a-8b0c-b491ba14aa57 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '333dedf8a3b44d5e94d17950d847710f', 'request_id': 'req-2181b256-4c11-4d1a-8b0c-b491ba14aa57'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:46.928143 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-2181b256-4c11-4d1a-8b0c-b491ba14aa57 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '333dedf8a3b44d5e94d17950d847710f', 'request_id': 'req-2181b256-4c11-4d1a-8b0c-b491ba14aa57'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:46.932301 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-fbcf83da-88bd-4f52-94aa-8d845bd1f7cb admin admin] The token cache is being invalidate because project 406f1a7e25254dca9626de39969f0943 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:47:46.932601 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-fbcf83da-88bd-4f52-94aa-8d845bd1f7cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:46.933263 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-fbcf83da-88bd-4f52-94aa-8d845bd1f7cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:46.938802 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1162/2318] 10.222.0.26 () {58 vars in 1233 bytes} [Wed Aug 24 05:47:46 2022] DELETE /identity/v3/projects/406f1a7e25254dca9626de39969f0943 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:47:46.938802 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcf83da-88bd-4f52-94aa-8d845bd1f7cb admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:46.939002 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-2181b256-4c11-4d1a-8b0c-b491ba14aa57 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '333dedf8a3b44d5e94d17950d847710f', 'request_id': 'req-2181b256-4c11-4d1a-8b0c-b491ba14aa57'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:46.947366 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-fbcf83da-88bd-4f52-94aa-8d845bd1f7cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:47:46.950566 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-2181b256-4c11-4d1a-8b0c-b491ba14aa57 admin admin] The token cache is being invalidate because project 333dedf8a3b44d5e94d17950d847710f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88112) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:47:46.951014 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-2181b256-4c11-4d1a-8b0c-b491ba14aa57 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:46.951807 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-2181b256-4c11-4d1a-8b0c-b491ba14aa57 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:46.953512 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1157/2319] 10.222.0.26 () {58 vars in 1233 bytes} [Wed Aug 24 05:47:46 2022] DELETE /identity/v3/projects/333dedf8a3b44d5e94d17950d847710f => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 05:47:46.957728 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47438600-d389-4ca0-bfe2-0f498d535152 None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:46.958204 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47438600-d389-4ca0-bfe2-0f498d535152 None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:46.958632 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47438600-d389-4ca0-bfe2-0f498d535152 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:46.977673 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-47438600-d389-4ca0-bfe2-0f498d535152 None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:47:46.979424 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-47438600-d389-4ca0-bfe2-0f498d535152 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:47:46.986100 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:47:46.993422 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:47:47.029262 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcf83da-88bd-4f52-94aa-8d845bd1f7cb admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:47.049884 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1158/2320] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:47:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:47:47.051004 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47438600-d389-4ca0-bfe2-0f498d535152 None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:47.052326 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-47438600-d389-4ca0-bfe2-0f498d535152 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:47:47.065314 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47438600-d389-4ca0-bfe2-0f498d535152 None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:47.071761 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf3ca96-4ef3-416f-a507-b73f8007213f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:47.072659 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf3ca96-4ef3-416f-a507-b73f8007213f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:47.072939 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf3ca96-4ef3-416f-a507-b73f8007213f admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:47.073213 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf3ca96-4ef3-416f-a507-b73f8007213f admin admin] PATH_INFO: `/v3/users/8909c228b2904262b0fe5c90bfd42675` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:47.074450 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf3ca96-4ef3-416f-a507-b73f8007213f admin admin] RBAC: Authorizing `identity:delete_user(user_id=8909c228b2904262b0fe5c90bfd42675)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:47.076314 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf3ca96-4ef3-416f-a507-b73f8007213f admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:47.095844 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453152ba-d85e-418c-962c-cae8251fc84f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87ff96222a7c4baea31fc1bebf4d89a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:47.096578 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453152ba-d85e-418c-962c-cae8251fc84f service swift] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:47.096954 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453152ba-d85e-418c-962c-cae8251fc84f service swift] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:47.097328 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453152ba-d85e-418c-962c-cae8251fc84f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:47.099288 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-453152ba-d85e-418c-962c-cae8251fc84f service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:47:47.133014 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-ecf3ca96-4ef3-416f-a507-b73f8007213f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8909c228b2904262b0fe5c90bfd42675'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:47.142234 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-ecf3ca96-4ef3-416f-a507-b73f8007213f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8909c228b2904262b0fe5c90bfd42675'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:47.154252 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-ecf3ca96-4ef3-416f-a507-b73f8007213f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8909c228b2904262b0fe5c90bfd42675'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:47.161719 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-ecf3ca96-4ef3-416f-a507-b73f8007213f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8909c228b2904262b0fe5c90bfd42675'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:47.162386 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-ecf3ca96-4ef3-416f-a507-b73f8007213f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8909c228b2904262b0fe5c90bfd42675'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:47.164684 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453152ba-d85e-418c-962c-cae8251fc84f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:47.166370 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453152ba-d85e-418c-962c-cae8251fc84f service swift] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:47.169115 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1159/2321] 10.222.0.26 () {58 vars in 1224 bytes} [Wed Aug 24 05:47:47 2022] DELETE /identity/v3/users/8909c228b2904262b0fe5c90bfd42675 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:47:47.170566 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c380fef7-a7e2-4bfb-bc43-270c14956a1f None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:47.170854 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c380fef7-a7e2-4bfb-bc43-270c14956a1f None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:47.171132 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c380fef7-a7e2-4bfb-bc43-270c14956a1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:47.177350 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1163/2322] 10.222.0.26 () {60 vars in 1384 bytes} [Wed Aug 24 05:47:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 05:47:47.192816 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-c380fef7-a7e2-4bfb-bc43-270c14956a1f None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:47:47.194078 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-c380fef7-a7e2-4bfb-bc43-270c14956a1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:47:47.275154 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1160/2323] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:47:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:47:47.279478 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453152ba-d85e-418c-962c-cae8251fc84f service swift] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:47.281071 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-453152ba-d85e-418c-962c-cae8251fc84f service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:47:47.299240 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453152ba-d85e-418c-962c-cae8251fc84f service swift] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:47.307190 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e7d20d-53dc-4038-81d1-dfcd49275bb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:47.308231 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e7d20d-53dc-4038-81d1-dfcd49275bb3 admin admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:47.308925 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e7d20d-53dc-4038-81d1-dfcd49275bb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:47.310057 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e7d20d-53dc-4038-81d1-dfcd49275bb3 admin admin] PATH_INFO: `/v3/domains` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:47.312101 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e7d20d-53dc-4038-81d1-dfcd49275bb3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:47:47.312703 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e7d20d-53dc-4038-81d1-dfcd49275bb3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:47.314867 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e7d20d-53dc-4038-81d1-dfcd49275bb3 admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:47.329614 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1164/2324] 10.222.0.26 () {58 vars in 1153 bytes} [Wed Aug 24 05:47:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:47:47.333749 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c380fef7-a7e2-4bfb-bc43-270c14956a1f None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:47.344096 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c380fef7-a7e2-4bfb-bc43-270c14956a1f None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:47.349717 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab61a53-de5f-47b4-8059-77cd9e3654b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:47.350603 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab61a53-de5f-47b4-8059-77cd9e3654b0 admin admin] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:47.350879 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab61a53-de5f-47b4-8059-77cd9e3654b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:47.351152 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab61a53-de5f-47b4-8059-77cd9e3654b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:47.351798 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab61a53-de5f-47b4-8059-77cd9e3654b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:47.353743 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab61a53-de5f-47b4-8059-77cd9e3654b0 admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:47.395500 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1161/2325] 10.222.0.26 () {60 vars in 1153 bytes} [Wed Aug 24 05:47:47 2022] POST /identity/v3/projects => generated 385 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:47:47.399701 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e7d20d-53dc-4038-81d1-dfcd49275bb3 admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:47.431238 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e7d20d-53dc-4038-81d1-dfcd49275bb3 admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:47.526807 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f442ec-bdc2-456d-a0d0-df501f449ab9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:47.527830 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f442ec-bdc2-456d-a0d0-df501f449ab9 admin admin] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:47.528337 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f442ec-bdc2-456d-a0d0-df501f449ab9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:47.528790 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f442ec-bdc2-456d-a0d0-df501f449ab9 admin admin] PATH_INFO: `/v3/users` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:47.529624 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f442ec-bdc2-456d-a0d0-df501f449ab9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:47.531984 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f442ec-bdc2-456d-a0d0-df501f449ab9 admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:47.547771 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:47:47.569183 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1165/2326] 10.222.0.26 () {60 vars in 1144 bytes} [Wed Aug 24 05:47:47 2022] POST /identity/v3/users => generated 293 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:47:47.576325 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab61a53-de5f-47b4-8059-77cd9e3654b0 admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:47.591936 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab61a53-de5f-47b4-8059-77cd9e3654b0 admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:47.597308 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49ab9a4-0b42-42eb-9d8d-400f41bb86ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:47.598135 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49ab9a4-0b42-42eb-9d8d-400f41bb86ad admin admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:47.598494 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49ab9a4-0b42-42eb-9d8d-400f41bb86ad admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:47.598834 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49ab9a4-0b42-42eb-9d8d-400f41bb86ad admin admin] PATH_INFO: `/v3/roles` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:47.599556 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49ab9a4-0b42-42eb-9d8d-400f41bb86ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:47.601399 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49ab9a4-0b42-42eb-9d8d-400f41bb86ad admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:47.604012 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:47:47.620967 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f442ec-bdc2-456d-a0d0-df501f449ab9 admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:47.627585 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1162/2327] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Aug 24 05:47:47 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:47:47.633738 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f442ec-bdc2-456d-a0d0-df501f449ab9 admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:47.640469 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97586c42-5ffc-4ceb-8239-613eefe7ebd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:47.641176 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97586c42-5ffc-4ceb-8239-613eefe7ebd2 admin admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:47.641539 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97586c42-5ffc-4ceb-8239-613eefe7ebd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:47.641880 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97586c42-5ffc-4ceb-8239-613eefe7ebd2 admin admin] PATH_INFO: `/v3/roles` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:47.643204 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97586c42-5ffc-4ceb-8239-613eefe7ebd2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:47.645518 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97586c42-5ffc-4ceb-8239-613eefe7ebd2 admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:47.662727 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49ab9a4-0b42-42eb-9d8d-400f41bb86ad admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:47.663949 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1166/2328] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Aug 24 05:47:47 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:47:47.673835 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49ab9a4-0b42-42eb-9d8d-400f41bb86ad admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:47.678949 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdbde65-8bec-4566-a578-3fa566d1eb48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:47.679692 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdbde65-8bec-4566-a578-3fa566d1eb48 admin admin] REQUEST_METHOD: `PUT` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:47.680120 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdbde65-8bec-4566-a578-3fa566d1eb48 admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:47.680476 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdbde65-8bec-4566-a578-3fa566d1eb48 admin admin] PATH_INFO: `/v3/projects/cfda4d4d80bd4a138fe0ff18ad4164aa/users/a0f93cf1ca1b40cca05a995b8c97299e/roles/f7aa4a2c74c94c1b9ca8ecdcccccda5c` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:47.701937 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdbde65-8bec-4566-a578-3fa566d1eb48 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cfda4d4d80bd4a138fe0ff18ad4164aa, user_id=a0f93cf1ca1b40cca05a995b8c97299e, role_id=f7aa4a2c74c94c1b9ca8ecdcccccda5c)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:47.705131 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdbde65-8bec-4566-a578-3fa566d1eb48 admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:47.743443 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97586c42-5ffc-4ceb-8239-613eefe7ebd2 admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:47.745464 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-97586c42-5ffc-4ceb-8239-613eefe7ebd2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:47:47.756332 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1163/2329] 10.222.0.26 () {60 vars in 1483 bytes} [Wed Aug 24 05:47:47 2022] PUT /identity/v3/projects/cfda4d4d80bd4a138fe0ff18ad4164aa/users/a0f93cf1ca1b40cca05a995b8c97299e/roles/f7aa4a2c74c94c1b9ca8ecdcccccda5c => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:47:47.764495 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97586c42-5ffc-4ceb-8239-613eefe7ebd2 admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:47.770405 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bd0f6d-a9a0-42f5-92dc-6bba602919b1 None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:47.773190 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bd0f6d-a9a0-42f5-92dc-6bba602919b1 None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:47.775498 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bd0f6d-a9a0-42f5-92dc-6bba602919b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:47.827892 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-16bd0f6d-a9a0-42f5-92dc-6bba602919b1 None None] MFA Rules not processed for user `a0f93cf1ca1b40cca05a995b8c97299e`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:47:47.830152 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-16bd0f6d-a9a0-42f5-92dc-6bba602919b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:47:47.859976 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78b6a6c-05ed-409b-b6d6-352bf13aee59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:47.861140 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78b6a6c-05ed-409b-b6d6-352bf13aee59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:47.861429 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78b6a6c-05ed-409b-b6d6-352bf13aee59 admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:47.861700 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78b6a6c-05ed-409b-b6d6-352bf13aee59 admin admin] PATH_INFO: `/v3/projects/7391777418e248a9a05ee79753358051` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:47.863530 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78b6a6c-05ed-409b-b6d6-352bf13aee59 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7391777418e248a9a05ee79753358051)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:47.865803 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78b6a6c-05ed-409b-b6d6-352bf13aee59 admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:47.937804 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1164/2330] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:47:47 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 05:47:47.944051 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-d78b6a6c-05ed-409b-b6d6-352bf13aee59 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7391777418e248a9a05ee79753358051', 'request_id': 'req-d78b6a6c-05ed-409b-b6d6-352bf13aee59'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:47.950876 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bd0f6d-a9a0-42f5-92dc-6bba602919b1 None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:47.952992 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-16bd0f6d-a9a0-42f5-92dc-6bba602919b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:47:47.966530 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-d78b6a6c-05ed-409b-b6d6-352bf13aee59 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7391777418e248a9a05ee79753358051', 'request_id': 'req-d78b6a6c-05ed-409b-b6d6-352bf13aee59'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:47.983321 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-d78b6a6c-05ed-409b-b6d6-352bf13aee59 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7391777418e248a9a05ee79753358051', 'request_id': 'req-d78b6a6c-05ed-409b-b6d6-352bf13aee59'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:48.011285 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-d78b6a6c-05ed-409b-b6d6-352bf13aee59 admin admin] The token cache is being invalidate because project 7391777418e248a9a05ee79753358051 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:47:48.011285 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-d78b6a6c-05ed-409b-b6d6-352bf13aee59 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:48.012497 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-d78b6a6c-05ed-409b-b6d6-352bf13aee59 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:48.023241 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1167/2331] 10.222.0.26 () {58 vars in 1233 bytes} [Wed Aug 24 05:47:47 2022] DELETE /identity/v3/projects/7391777418e248a9a05ee79753358051 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:47:48.030883 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a476ec9-e0bb-4bc0-931a-cef1db88dde1 None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:48.031225 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a476ec9-e0bb-4bc0-931a-cef1db88dde1 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:48.031511 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a476ec9-e0bb-4bc0-931a-cef1db88dde1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:48.071392 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-6a476ec9-e0bb-4bc0-931a-cef1db88dde1 None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:47:48.073284 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-6a476ec9-e0bb-4bc0-931a-cef1db88dde1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:47:48.075607 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bd0f6d-a9a0-42f5-92dc-6bba602919b1 None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:48.160649 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc636a06-21db-4565-8c72-68c2866d902a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17b450afe795495680fc70f522c83750', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:48.161270 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc636a06-21db-4565-8c72-68c2866d902a service cinder] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:48.161642 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc636a06-21db-4565-8c72-68c2866d902a service cinder] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:48.162131 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc636a06-21db-4565-8c72-68c2866d902a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:48.182012 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1168/2332] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:47:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:47:48.183654 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-bc636a06-21db-4565-8c72-68c2866d902a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:47:48.185048 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d24eb2-5954-4257-9e68-8c9838a99d9e None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:48.185341 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d24eb2-5954-4257-9e68-8c9838a99d9e None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:48.185620 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d24eb2-5954-4257-9e68-8c9838a99d9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:48.207742 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-75d24eb2-5954-4257-9e68-8c9838a99d9e None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:47:48.209222 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-75d24eb2-5954-4257-9e68-8c9838a99d9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:47:48.219409 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1169/2333] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:47:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:47:48.225644 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d24eb2-5954-4257-9e68-8c9838a99d9e None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:48.231819 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:INSERT=4,keystone:SELECT=89,keystone:DELETE=7 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:47:48.238388 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d24eb2-5954-4257-9e68-8c9838a99d9e None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:48.244439 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d142612-40ff-407f-8618-53f20b032e1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:48.245910 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d142612-40ff-407f-8618-53f20b032e1f admin admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:48.245910 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d142612-40ff-407f-8618-53f20b032e1f admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:48.245910 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d142612-40ff-407f-8618-53f20b032e1f admin admin] PATH_INFO: `/v3/domains` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:48.247972 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d142612-40ff-407f-8618-53f20b032e1f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:47:48.247972 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d142612-40ff-407f-8618-53f20b032e1f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:48.249986 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d142612-40ff-407f-8618-53f20b032e1f admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:48.267025 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:47:48.268112 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1170/2334] 10.222.0.26 () {58 vars in 1153 bytes} [Wed Aug 24 05:47:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:47:48.275017 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d142612-40ff-407f-8618-53f20b032e1f admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:48.290909 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d142612-40ff-407f-8618-53f20b032e1f admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:48.296960 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c953a92a-bf2a-400b-ac41-f20355eaec67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:48.297570 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c953a92a-bf2a-400b-ac41-f20355eaec67 admin admin] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:48.297853 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c953a92a-bf2a-400b-ac41-f20355eaec67 admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:48.298161 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c953a92a-bf2a-400b-ac41-f20355eaec67 admin admin] PATH_INFO: `/v3/projects` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:48.298831 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c953a92a-bf2a-400b-ac41-f20355eaec67 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:48.300715 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c953a92a-bf2a-400b-ac41-f20355eaec67 admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:48.301389 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc636a06-21db-4565-8c72-68c2866d902a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:48.303579 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc636a06-21db-4565-8c72-68c2866d902a service cinder] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:48.314189 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1165/2335] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 24 05:47:47 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:47:48.336578 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc636a06-21db-4565-8c72-68c2866d902a service cinder] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:48.336857 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-bc636a06-21db-4565-8c72-68c2866d902a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:47:48.339262 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1171/2336] 10.222.0.26 () {60 vars in 1153 bytes} [Wed Aug 24 05:47:48 2022] POST /identity/v3/projects => generated 375 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:47:48.344065 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c953a92a-bf2a-400b-ac41-f20355eaec67 admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:48.354783 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc636a06-21db-4565-8c72-68c2866d902a service cinder] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:48.421911 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c953a92a-bf2a-400b-ac41-f20355eaec67 admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:48.427991 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3071a796-34f5-4d18-b5db-cd240b9687a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:48.428816 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3071a796-34f5-4d18-b5db-cd240b9687a8 admin admin] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:48.429250 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3071a796-34f5-4d18-b5db-cd240b9687a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:48.429729 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3071a796-34f5-4d18-b5db-cd240b9687a8 admin admin] PATH_INFO: `/v3/users` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:48.430531 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3071a796-34f5-4d18-b5db-cd240b9687a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:48.431646 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321ce7ba-2892-46bc-bc68-3767806eba0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:48.432299 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321ce7ba-2892-46bc-bc68-3767806eba0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:48.432586 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321ce7ba-2892-46bc-bc68-3767806eba0e admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:48.432861 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321ce7ba-2892-46bc-bc68-3767806eba0e admin admin] PATH_INFO: `/v3/users/a0f93cf1ca1b40cca05a995b8c97299e` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:48.433611 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3071a796-34f5-4d18-b5db-cd240b9687a8 admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:48.434083 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321ce7ba-2892-46bc-bc68-3767806eba0e admin admin] RBAC: Authorizing `identity:delete_user(user_id=a0f93cf1ca1b40cca05a995b8c97299e)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:48.436174 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321ce7ba-2892-46bc-bc68-3767806eba0e admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:48.461932 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1172/2337] 10.222.0.26 () {60 vars in 1144 bytes} [Wed Aug 24 05:47:48 2022] POST /identity/v3/users => generated 288 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 05:47:48.466571 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3071a796-34f5-4d18-b5db-cd240b9687a8 admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:48.478310 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3071a796-34f5-4d18-b5db-cd240b9687a8 admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:48.487629 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149a99f0-4a7b-4000-972e-086bab33e63c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:48.488429 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149a99f0-4a7b-4000-972e-086bab33e63c admin admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:48.488720 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149a99f0-4a7b-4000-972e-086bab33e63c admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:48.489001 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149a99f0-4a7b-4000-972e-086bab33e63c admin admin] PATH_INFO: `/v3/roles` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:48.489725 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149a99f0-4a7b-4000-972e-086bab33e63c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:48.491394 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149a99f0-4a7b-4000-972e-086bab33e63c admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:48.508296 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-321ce7ba-2892-46bc-bc68-3767806eba0e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0f93cf1ca1b40cca05a995b8c97299e'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:48.511295 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1173/2338] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Aug 24 05:47:48 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 05:47:48.515857 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149a99f0-4a7b-4000-972e-086bab33e63c admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:48.518734 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-321ce7ba-2892-46bc-bc68-3767806eba0e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0f93cf1ca1b40cca05a995b8c97299e'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:48.533035 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-321ce7ba-2892-46bc-bc68-3767806eba0e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0f93cf1ca1b40cca05a995b8c97299e'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:48.533877 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149a99f0-4a7b-4000-972e-086bab33e63c admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:48.540643 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25b9e62-9290-4fd3-ac5b-f3ea5d12f9ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:48.541330 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25b9e62-9290-4fd3-ac5b-f3ea5d12f9ce admin admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:48.541611 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25b9e62-9290-4fd3-ac5b-f3ea5d12f9ce admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:48.541889 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25b9e62-9290-4fd3-ac5b-f3ea5d12f9ce admin admin] PATH_INFO: `/v3/roles` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:48.542804 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25b9e62-9290-4fd3-ac5b-f3ea5d12f9ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:48.545454 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25b9e62-9290-4fd3-ac5b-f3ea5d12f9ce admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:48.548364 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-321ce7ba-2892-46bc-bc68-3767806eba0e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0f93cf1ca1b40cca05a995b8c97299e'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:48.549453 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-321ce7ba-2892-46bc-bc68-3767806eba0e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0f93cf1ca1b40cca05a995b8c97299e'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:48.557846 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1166/2339] 10.222.0.26 () {58 vars in 1224 bytes} [Wed Aug 24 05:47:48 2022] DELETE /identity/v3/users/a0f93cf1ca1b40cca05a995b8c97299e => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 05:47:48.563588 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1174/2340] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Aug 24 05:47:48 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:47:48.563777 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879d125e-8852-4b97-a053-0393d5a29c67 None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:48.563777 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879d125e-8852-4b97-a053-0393d5a29c67 None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:48.563777 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879d125e-8852-4b97-a053-0393d5a29c67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:48.565378 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25b9e62-9290-4fd3-ac5b-f3ea5d12f9ce admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:48.567211 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-f25b9e62-9290-4fd3-ac5b-f3ea5d12f9ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:47:48.582652 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25b9e62-9290-4fd3-ac5b-f3ea5d12f9ce admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:48.586280 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-879d125e-8852-4b97-a053-0393d5a29c67 None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:47:48.587825 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-879d125e-8852-4b97-a053-0393d5a29c67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:47:48.652608 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:47:48.661504 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8542c4a5-8f89-4204-b249-66c4d655dc35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:48.662366 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8542c4a5-8f89-4204-b249-66c4d655dc35 admin admin] REQUEST_METHOD: `PUT` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:48.662755 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8542c4a5-8f89-4204-b249-66c4d655dc35 admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:48.663274 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8542c4a5-8f89-4204-b249-66c4d655dc35 admin admin] PATH_INFO: `/v3/projects/602c69ad09d14ead980d32ca071db0e9/users/bd5806eaaa50407e963d95cbfc32e71b/roles/f7aa4a2c74c94c1b9ca8ecdcccccda5c` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:48.675021 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1167/2341] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:47:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 05:47:48.686014 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879d125e-8852-4b97-a053-0393d5a29c67 None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:48.688011 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-879d125e-8852-4b97-a053-0393d5a29c67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:47:48.689360 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8542c4a5-8f89-4204-b249-66c4d655dc35 admin admin] RBAC: Authorizing `identity:create_grant(project_id=602c69ad09d14ead980d32ca071db0e9, user_id=bd5806eaaa50407e963d95cbfc32e71b, role_id=f7aa4a2c74c94c1b9ca8ecdcccccda5c)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:48.693468 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8542c4a5-8f89-4204-b249-66c4d655dc35 admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:48.722798 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1175/2342] 10.222.0.26 () {60 vars in 1483 bytes} [Wed Aug 24 05:47:48 2022] PUT /identity/v3/projects/602c69ad09d14ead980d32ca071db0e9/users/bd5806eaaa50407e963d95cbfc32e71b/roles/f7aa4a2c74c94c1b9ca8ecdcccccda5c => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:47:48.725231 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6eee9e-0a05-4bbd-812e-54ce26b05fa6 None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:48.725636 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6eee9e-0a05-4bbd-812e-54ce26b05fa6 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:48.725942 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6eee9e-0a05-4bbd-812e-54ce26b05fa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:48.766350 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-ef6eee9e-0a05-4bbd-812e-54ce26b05fa6 None None] MFA Rules not processed for user `bd5806eaaa50407e963d95cbfc32e71b`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:47:48.767691 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-ef6eee9e-0a05-4bbd-812e-54ce26b05fa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:47:48.772365 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879d125e-8852-4b97-a053-0393d5a29c67 None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:48.774452 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:47:48.846503 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427fe4bd-5d74-49e9-b163-4b878dd18e93 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '874348b647194ac2b5ecbf12c33bf59e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:48.847412 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427fe4bd-5d74-49e9-b163-4b878dd18e93 service neutron] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:48.847845 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427fe4bd-5d74-49e9-b163-4b878dd18e93 service neutron] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:48.848278 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427fe4bd-5d74-49e9-b163-4b878dd18e93 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:48.854509 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1176/2343] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:47:48 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 05:47:48.877167 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6eee9e-0a05-4bbd-812e-54ce26b05fa6 None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:48.883638 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-ef6eee9e-0a05-4bbd-812e-54ce26b05fa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:47:49.018830 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427fe4bd-5d74-49e9-b163-4b878dd18e93 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:49.020530 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427fe4bd-5d74-49e9-b163-4b878dd18e93 service neutron] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:49.035984 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1168/2344] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 24 05:47:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:47:49.062188 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6eee9e-0a05-4bbd-812e-54ce26b05fa6 None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:49.068306 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683e7080-dbc3-4c70-9113-55696b874dc6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17b450afe795495680fc70f522c83750', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:49.069285 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683e7080-dbc3-4c70-9113-55696b874dc6 service cinder] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:49.069592 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683e7080-dbc3-4c70-9113-55696b874dc6 service cinder] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:49.069870 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683e7080-dbc3-4c70-9113-55696b874dc6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:49.081229 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683e7080-dbc3-4c70-9113-55696b874dc6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:49.082680 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683e7080-dbc3-4c70-9113-55696b874dc6 service cinder] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:49.093398 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1177/2345] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 24 05:47:48 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 05:47:49.396856 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427fe4bd-5d74-49e9-b163-4b878dd18e93 service neutron] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:47:49.399186 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-427fe4bd-5d74-49e9-b163-4b878dd18e93 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:47:49.420547 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427fe4bd-5d74-49e9-b163-4b878dd18e93 service neutron] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:47:49.425844 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa2e64a-5872-4b7d-9650-fe157509620c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:47:49.426603 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa2e64a-5872-4b7d-9650-fe157509620c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:47:49.427534 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa2e64a-5872-4b7d-9650-fe157509620c admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:47:49.427889 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa2e64a-5872-4b7d-9650-fe157509620c admin admin] PATH_INFO: `/v3/projects/cfda4d4d80bd4a138fe0ff18ad4164aa` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:47:49.429126 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa2e64a-5872-4b7d-9650-fe157509620c admin admin] RBAC: Authorizing `identity:delete_project(project_id=cfda4d4d80bd4a138fe0ff18ad4164aa)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:47:49.431490 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa2e64a-5872-4b7d-9650-fe157509620c admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:47:49.519958 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-ffa2e64a-5872-4b7d-9650-fe157509620c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cfda4d4d80bd4a138fe0ff18ad4164aa', 'request_id': 'req-ffa2e64a-5872-4b7d-9650-fe157509620c'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:49.530698 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:47:49.535713 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-ffa2e64a-5872-4b7d-9650-fe157509620c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cfda4d4d80bd4a138fe0ff18ad4164aa', 'request_id': 'req-ffa2e64a-5872-4b7d-9650-fe157509620c'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:49.547855 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-ffa2e64a-5872-4b7d-9650-fe157509620c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cfda4d4d80bd4a138fe0ff18ad4164aa', 'request_id': 'req-ffa2e64a-5872-4b7d-9650-fe157509620c'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:49.561183 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-ffa2e64a-5872-4b7d-9650-fe157509620c admin admin] The token cache is being invalidate because project cfda4d4d80bd4a138fe0ff18ad4164aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88112) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:47:49.561608 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-ffa2e64a-5872-4b7d-9650-fe157509620c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:49.563041 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-ffa2e64a-5872-4b7d-9650-fe157509620c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:47:49.566128 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1169/2346] 10.222.0.26 () {58 vars in 1233 bytes} [Wed Aug 24 05:47:49 2022] DELETE /identity/v3/projects/cfda4d4d80bd4a138fe0ff18ad4164aa => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:47:59.088471 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=50 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:47:59.556854 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=6,keystone:DELETE=2 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:48:00.394475 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683e7080-dbc3-4c70-9113-55696b874dc6 service cinder] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:48:00.406429 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683e7080-dbc3-4c70-9113-55696b874dc6 service cinder] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:48:00.486480 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7bb59c-2297-4a0b-9daa-81039160929e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:48:00.486817 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7bb59c-2297-4a0b-9daa-81039160929e admin admin] REQUEST_METHOD: `DELETE` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:48:00.487476 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7bb59c-2297-4a0b-9daa-81039160929e admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:48:00.487476 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7bb59c-2297-4a0b-9daa-81039160929e admin admin] PATH_INFO: `/v3/users/bd5806eaaa50407e963d95cbfc32e71b` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:48:00.488673 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7bb59c-2297-4a0b-9daa-81039160929e admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd5806eaaa50407e963d95cbfc32e71b)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:48:00.490932 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7bb59c-2297-4a0b-9daa-81039160929e admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:48:00.572654 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-ae7bb59c-2297-4a0b-9daa-81039160929e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd5806eaaa50407e963d95cbfc32e71b'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:48:00.581629 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-ae7bb59c-2297-4a0b-9daa-81039160929e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd5806eaaa50407e963d95cbfc32e71b'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:48:00.582616 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-ae7bb59c-2297-4a0b-9daa-81039160929e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd5806eaaa50407e963d95cbfc32e71b'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:48:00.603688 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-ae7bb59c-2297-4a0b-9daa-81039160929e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd5806eaaa50407e963d95cbfc32e71b'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:48:00.615180 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-ae7bb59c-2297-4a0b-9daa-81039160929e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd5806eaaa50407e963d95cbfc32e71b'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:48:00.629866 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f66290-8394-41a9-b7ac-ea36b1ef4a35 None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:48:00.630418 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f66290-8394-41a9-b7ac-ea36b1ef4a35 None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:48:00.630503 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f66290-8394-41a9-b7ac-ea36b1ef4a35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:48:00.633324 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1178/2347] 10.222.0.26 () {58 vars in 1224 bytes} [Wed Aug 24 05:48:00 2022] DELETE /identity/v3/users/bd5806eaaa50407e963d95cbfc32e71b => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 05:48:00.655841 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-b8f66290-8394-41a9-b7ac-ea36b1ef4a35 None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:48:00.657286 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-b8f66290-8394-41a9-b7ac-ea36b1ef4a35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:48:00.736887 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1170/2348] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:48:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 05:48:00.750390 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7bb59c-2297-4a0b-9daa-81039160929e admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:48:00.752191 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-ae7bb59c-2297-4a0b-9daa-81039160929e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:48:00.825564 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7bb59c-2297-4a0b-9daa-81039160929e admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:48:00.829582 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702ec5c6-0f69-4cab-a3b8-160892366f38 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '874348b647194ac2b5ecbf12c33bf59e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:48:00.830234 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702ec5c6-0f69-4cab-a3b8-160892366f38 service neutron] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:48:00.830514 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702ec5c6-0f69-4cab-a3b8-160892366f38 service neutron] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:48:00.830787 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702ec5c6-0f69-4cab-a3b8-160892366f38 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:48:00.841282 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702ec5c6-0f69-4cab-a3b8-160892366f38 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:48:00.842859 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702ec5c6-0f69-4cab-a3b8-160892366f38 service neutron] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:48:00.853922 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1179/2349] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 24 05:48:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:48:01.199730 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f66290-8394-41a9-b7ac-ea36b1ef4a35 None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:48:01.201333 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-b8f66290-8394-41a9-b7ac-ea36b1ef4a35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:48:01.215127 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f66290-8394-41a9-b7ac-ea36b1ef4a35 None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:48:01.220125 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66b5c14-2ec8-4042-a889-93d34e3c254f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:48:01.230885 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66b5c14-2ec8-4042-a889-93d34e3c254f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:48:01.231183 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66b5c14-2ec8-4042-a889-93d34e3c254f admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:48:01.231462 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66b5c14-2ec8-4042-a889-93d34e3c254f admin admin] PATH_INFO: `/v3/projects/602c69ad09d14ead980d32ca071db0e9` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:48:01.233163 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66b5c14-2ec8-4042-a889-93d34e3c254f admin admin] RBAC: Authorizing `identity:delete_project(project_id=602c69ad09d14ead980d32ca071db0e9)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:48:01.235206 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66b5c14-2ec8-4042-a889-93d34e3c254f admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:48:01.288291 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-e66b5c14-2ec8-4042-a889-93d34e3c254f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '602c69ad09d14ead980d32ca071db0e9', 'request_id': 'req-e66b5c14-2ec8-4042-a889-93d34e3c254f'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:48:01.298476 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-e66b5c14-2ec8-4042-a889-93d34e3c254f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '602c69ad09d14ead980d32ca071db0e9', 'request_id': 'req-e66b5c14-2ec8-4042-a889-93d34e3c254f'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:48:01.306322 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-e66b5c14-2ec8-4042-a889-93d34e3c254f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '602c69ad09d14ead980d32ca071db0e9', 'request_id': 'req-e66b5c14-2ec8-4042-a889-93d34e3c254f'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:48:01.320700 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-e66b5c14-2ec8-4042-a889-93d34e3c254f admin admin] The token cache is being invalidate because project 602c69ad09d14ead980d32ca071db0e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88112) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:48:01.322052 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-e66b5c14-2ec8-4042-a889-93d34e3c254f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:48:01.322884 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-e66b5c14-2ec8-4042-a889-93d34e3c254f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:48:01.325978 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1171/2350] 10.222.0.26 () {58 vars in 1233 bytes} [Wed Aug 24 05:48:01 2022] DELETE /identity/v3/projects/602c69ad09d14ead980d32ca071db0e9 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:48:01.331382 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1899308e-dcd6-4e1a-ba55-85feb4df67a5 None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:48:01.331545 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1899308e-dcd6-4e1a-ba55-85feb4df67a5 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:48:01.331886 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1899308e-dcd6-4e1a-ba55-85feb4df67a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:48:01.354141 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-1899308e-dcd6-4e1a-ba55-85feb4df67a5 None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:48:01.355940 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-1899308e-dcd6-4e1a-ba55-85feb4df67a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:48:01.379617 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:48:01.442241 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1180/2351] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:48:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:48:01.449704 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e150de-9185-46a5-9f35-355531305039 None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:48:01.450205 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e150de-9185-46a5-9f35-355531305039 None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:48:01.450485 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e150de-9185-46a5-9f35-355531305039 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:48:01.473148 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-80e150de-9185-46a5-9f35-355531305039 None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:48:01.474412 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-80e150de-9185-46a5-9f35-355531305039 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:48:01.483426 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1172/2352] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:48:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 05:48:01.487632 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1899308e-dcd6-4e1a-ba55-85feb4df67a5 None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:48:01.501639 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1899308e-dcd6-4e1a-ba55-85feb4df67a5 None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:48:01.506869 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbf9ea2-4226-4c34-8ba2-5daf0f50dbe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:48:01.507457 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbf9ea2-4226-4c34-8ba2-5daf0f50dbe4 admin admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:48:01.507752 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbf9ea2-4226-4c34-8ba2-5daf0f50dbe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:48:01.508018 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbf9ea2-4226-4c34-8ba2-5daf0f50dbe4 admin admin] PATH_INFO: `/v3/domains` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:48:01.508678 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbf9ea2-4226-4c34-8ba2-5daf0f50dbe4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:48:01.508985 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbf9ea2-4226-4c34-8ba2-5daf0f50dbe4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:48:01.510676 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbf9ea2-4226-4c34-8ba2-5daf0f50dbe4 admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:48:01.526969 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1181/2353] 10.222.0.26 () {58 vars in 1153 bytes} [Wed Aug 24 05:48:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:48:01.531998 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e150de-9185-46a5-9f35-355531305039 None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:48:01.544279 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e150de-9185-46a5-9f35-355531305039 None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:48:01.549443 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596fdda8-51b1-483d-afbf-e324e89eef64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:48:01.550092 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596fdda8-51b1-483d-afbf-e324e89eef64 admin admin] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:48:01.550497 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596fdda8-51b1-483d-afbf-e324e89eef64 admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:48:01.550771 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596fdda8-51b1-483d-afbf-e324e89eef64 admin admin] PATH_INFO: `/v3/projects` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:48:01.551398 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596fdda8-51b1-483d-afbf-e324e89eef64 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:48:01.553326 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596fdda8-51b1-483d-afbf-e324e89eef64 admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:48:01.589991 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1173/2354] 10.222.0.26 () {60 vars in 1153 bytes} [Wed Aug 24 05:48:01 2022] POST /identity/v3/projects => generated 399 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:48:01.591830 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbf9ea2-4226-4c34-8ba2-5daf0f50dbe4 admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:48:01.603103 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbf9ea2-4226-4c34-8ba2-5daf0f50dbe4 admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:48:01.702114 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a454df1-ef05-4005-822b-d402d6525d90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:48:01.703228 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a454df1-ef05-4005-822b-d402d6525d90 admin admin] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:48:01.703613 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a454df1-ef05-4005-822b-d402d6525d90 admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:48:01.704042 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a454df1-ef05-4005-822b-d402d6525d90 admin admin] PATH_INFO: `/v3/users` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:48:01.705028 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a454df1-ef05-4005-822b-d402d6525d90 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:48:01.708982 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a454df1-ef05-4005-822b-d402d6525d90 admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:48:01.747581 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596fdda8-51b1-483d-afbf-e324e89eef64 admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:48:01.755395 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1182/2355] 10.222.0.26 () {60 vars in 1144 bytes} [Wed Aug 24 05:48:01 2022] POST /identity/v3/users => generated 300 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:48:01.764740 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596fdda8-51b1-483d-afbf-e324e89eef64 admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:48:01.771965 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabf9458-353c-4d02-ba69-f1785ab78167 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:48:01.773343 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabf9458-353c-4d02-ba69-f1785ab78167 admin admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:48:01.773343 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabf9458-353c-4d02-ba69-f1785ab78167 admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:48:01.773611 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabf9458-353c-4d02-ba69-f1785ab78167 admin admin] PATH_INFO: `/v3/roles` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:48:01.774663 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabf9458-353c-4d02-ba69-f1785ab78167 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:48:01.776237 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabf9458-353c-4d02-ba69-f1785ab78167 admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:48:01.794344 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1174/2356] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Aug 24 05:48:01 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 05:48:01.798938 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a454df1-ef05-4005-822b-d402d6525d90 admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:48:01.811029 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a454df1-ef05-4005-822b-d402d6525d90 admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:48:01.817142 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7310932-4b54-418d-92df-b37e3d1cae77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:48:01.817762 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7310932-4b54-418d-92df-b37e3d1cae77 admin admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:48:01.818084 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7310932-4b54-418d-92df-b37e3d1cae77 admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:48:01.818360 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7310932-4b54-418d-92df-b37e3d1cae77 admin admin] PATH_INFO: `/v3/roles` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:48:01.819160 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7310932-4b54-418d-92df-b37e3d1cae77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:48:01.820797 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7310932-4b54-418d-92df-b37e3d1cae77 admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:48:01.846179 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1183/2357] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Aug 24 05:48:01 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 05:48:01.863607 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabf9458-353c-4d02-ba69-f1785ab78167 admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:48:01.875040 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabf9458-353c-4d02-ba69-f1785ab78167 admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:48:01.880115 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb3b148-6f50-4288-90a1-e629ca240a0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:48:01.880933 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb3b148-6f50-4288-90a1-e629ca240a0c admin admin] REQUEST_METHOD: `PUT` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:48:01.881179 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb3b148-6f50-4288-90a1-e629ca240a0c admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:48:01.881496 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb3b148-6f50-4288-90a1-e629ca240a0c admin admin] PATH_INFO: `/v3/projects/3d8ee0abad2c4e518a84c551ccc7836e/users/a378c74e7f3d4366965befacb9b9c8a5/roles/f7aa4a2c74c94c1b9ca8ecdcccccda5c` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:48:01.897589 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb3b148-6f50-4288-90a1-e629ca240a0c admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d8ee0abad2c4e518a84c551ccc7836e, user_id=a378c74e7f3d4366965befacb9b9c8a5, role_id=f7aa4a2c74c94c1b9ca8ecdcccccda5c)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:48:01.900304 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb3b148-6f50-4288-90a1-e629ca240a0c admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:48:01.916455 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1175/2358] 10.222.0.26 () {60 vars in 1483 bytes} [Wed Aug 24 05:48:01 2022] PUT /identity/v3/projects/3d8ee0abad2c4e518a84c551ccc7836e/users/a378c74e7f3d4366965befacb9b9c8a5/roles/f7aa4a2c74c94c1b9ca8ecdcccccda5c => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:48:02.005351 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3526b9bd-cb1a-4d6f-812e-18634bac0e72 None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:48:02.005623 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3526b9bd-cb1a-4d6f-812e-18634bac0e72 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:48:02.005906 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3526b9bd-cb1a-4d6f-812e-18634bac0e72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:48:02.036855 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-3526b9bd-cb1a-4d6f-812e-18634bac0e72 None None] MFA Rules not processed for user `a378c74e7f3d4366965befacb9b9c8a5`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:48:02.038206 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-3526b9bd-cb1a-4d6f-812e-18634bac0e72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:48:02.134453 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1184/2359] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:48:02 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:48:02.142183 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb3b148-6f50-4288-90a1-e629ca240a0c admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:48:02.144192 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-acb3b148-6f50-4288-90a1-e629ca240a0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:48:02.174598 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:48:02.217508 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb3b148-6f50-4288-90a1-e629ca240a0c admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:48:02.221381 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15167f0b-6ba8-4fe5-9e16-75a1074016a4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17b450afe795495680fc70f522c83750', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:48:02.222265 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15167f0b-6ba8-4fe5-9e16-75a1074016a4 service cinder] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:48:02.222435 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15167f0b-6ba8-4fe5-9e16-75a1074016a4 service cinder] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:48:02.222726 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15167f0b-6ba8-4fe5-9e16-75a1074016a4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:48:02.233261 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15167f0b-6ba8-4fe5-9e16-75a1074016a4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:48:02.234747 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15167f0b-6ba8-4fe5-9e16-75a1074016a4 service cinder] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:48:02.246359 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1176/2360] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 24 05:48:02 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:48:04.312994 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc14f91-7ec8-4acc-9bde-7b5d352e221b None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:48:04.313481 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc14f91-7ec8-4acc-9bde-7b5d352e221b None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:48:04.313574 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc14f91-7ec8-4acc-9bde-7b5d352e221b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:48:04.332509 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-5bc14f91-7ec8-4acc-9bde-7b5d352e221b None None] MFA Rules not processed for user `6c2c08b27a0f4943b5da908eb7b1cd96`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:48:04.333704 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-5bc14f91-7ec8-4acc-9bde-7b5d352e221b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:48:04.345457 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:48:04.388129 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1185/2361] 10.222.0.26 () {58 vars in 967 bytes} [Wed Aug 24 05:48:04 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:48:04.400377 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15167f0b-6ba8-4fe5-9e16-75a1074016a4 service cinder] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:48:04.401758 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-15167f0b-6ba8-4fe5-9e16-75a1074016a4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:48:04.469676 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15167f0b-6ba8-4fe5-9e16-75a1074016a4 service cinder] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:48:04.474571 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d32f48b-f102-4cbe-9b96-fc8974780b36 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87ff96222a7c4baea31fc1bebf4d89a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:48:04.475160 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d32f48b-f102-4cbe-9b96-fc8974780b36 service swift] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:48:04.475436 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d32f48b-f102-4cbe-9b96-fc8974780b36 service swift] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:48:04.475703 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d32f48b-f102-4cbe-9b96-fc8974780b36 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:48:04.483929 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d32f48b-f102-4cbe-9b96-fc8974780b36 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:48:04.485493 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d32f48b-f102-4cbe-9b96-fc8974780b36 service swift] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:48:04.493242 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1177/2362] 10.222.0.26 () {60 vars in 1384 bytes} [Wed Aug 24 05:48:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 05:48:06.429232 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc14f91-7ec8-4acc-9bde-7b5d352e221b None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:48:06.430964 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-5bc14f91-7ec8-4acc-9bde-7b5d352e221b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:48:06.512406 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc14f91-7ec8-4acc-9bde-7b5d352e221b None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:48:06.516964 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a44d9f-fd28-49fe-ae71-ef53843e27a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:48:06.517600 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a44d9f-fd28-49fe-ae71-ef53843e27a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:48:06.517882 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a44d9f-fd28-49fe-ae71-ef53843e27a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:48:06.518192 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a44d9f-fd28-49fe-ae71-ef53843e27a5 admin admin] PATH_INFO: `/v3/users/246cc4e07c754c62bb5337197867e8ce` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:48:06.519697 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a44d9f-fd28-49fe-ae71-ef53843e27a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=246cc4e07c754c62bb5337197867e8ce)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:48:06.521639 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a44d9f-fd28-49fe-ae71-ef53843e27a5 admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:48:06.578859 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-50a44d9f-fd28-49fe-ae71-ef53843e27a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '246cc4e07c754c62bb5337197867e8ce'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:48:06.586093 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-50a44d9f-fd28-49fe-ae71-ef53843e27a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '246cc4e07c754c62bb5337197867e8ce'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:48:06.586777 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-50a44d9f-fd28-49fe-ae71-ef53843e27a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '246cc4e07c754c62bb5337197867e8ce'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:48:06.598647 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-50a44d9f-fd28-49fe-ae71-ef53843e27a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '246cc4e07c754c62bb5337197867e8ce'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:48:06.606549 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-50a44d9f-fd28-49fe-ae71-ef53843e27a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '246cc4e07c754c62bb5337197867e8ce'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:48:06.612797 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1186/2363] 10.222.0.26 () {58 vars in 1224 bytes} [Wed Aug 24 05:48:06 2022] DELETE /identity/v3/users/246cc4e07c754c62bb5337197867e8ce => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:48:06.781185 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d32f48b-f102-4cbe-9b96-fc8974780b36 service swift] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:48:06.791968 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d32f48b-f102-4cbe-9b96-fc8974780b36 service swift] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:48:06.850816 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d1d3ca-ea1d-409d-bff9-62154998a2b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:48:06.851431 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d1d3ca-ea1d-409d-bff9-62154998a2b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:48:06.851712 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d1d3ca-ea1d-409d-bff9-62154998a2b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:48:06.851985 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d1d3ca-ea1d-409d-bff9-62154998a2b2 admin admin] PATH_INFO: `/v3/projects/ec547256768942888afaea0dd2f9eedd` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:48:06.853097 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d1d3ca-ea1d-409d-bff9-62154998a2b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec547256768942888afaea0dd2f9eedd)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:48:06.855560 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d1d3ca-ea1d-409d-bff9-62154998a2b2 admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:48:06.900821 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-02d1d3ca-ea1d-409d-bff9-62154998a2b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec547256768942888afaea0dd2f9eedd', 'request_id': 'req-02d1d3ca-ea1d-409d-bff9-62154998a2b2'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:48:06.904904 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:48:06.909035 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-02d1d3ca-ea1d-409d-bff9-62154998a2b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec547256768942888afaea0dd2f9eedd', 'request_id': 'req-02d1d3ca-ea1d-409d-bff9-62154998a2b2'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:48:06.916682 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-02d1d3ca-ea1d-409d-bff9-62154998a2b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec547256768942888afaea0dd2f9eedd', 'request_id': 'req-02d1d3ca-ea1d-409d-bff9-62154998a2b2'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:48:06.927622 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-02d1d3ca-ea1d-409d-bff9-62154998a2b2 admin admin] The token cache is being invalidate because project ec547256768942888afaea0dd2f9eedd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88112) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:48:06.927933 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-02d1d3ca-ea1d-409d-bff9-62154998a2b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:48:06.928544 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-02d1d3ca-ea1d-409d-bff9-62154998a2b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:48:06.930031 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1178/2364] 10.222.0.26 () {58 vars in 1233 bytes} [Wed Aug 24 05:48:06 2022] DELETE /identity/v3/projects/ec547256768942888afaea0dd2f9eedd => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:48:06.934978 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da0e950-4b2c-4f04-9521-8efe099d3d41 None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:48:06.935264 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da0e950-4b2c-4f04-9521-8efe099d3d41 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:48:06.935538 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da0e950-4b2c-4f04-9521-8efe099d3d41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:48:06.954933 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-5da0e950-4b2c-4f04-9521-8efe099d3d41 None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:48:06.956112 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-5da0e950-4b2c-4f04-9521-8efe099d3d41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:48:06.993275 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:48:07.016223 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1187/2365] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:48:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:48:07.024470 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733c3b4b-51f6-4b20-a84e-d1ee61a56887 None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:48:07.024771 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733c3b4b-51f6-4b20-a84e-d1ee61a56887 None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:48:07.025194 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733c3b4b-51f6-4b20-a84e-d1ee61a56887 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:48:07.044356 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-733c3b4b-51f6-4b20-a84e-d1ee61a56887 None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:48:07.045548 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-733c3b4b-51f6-4b20-a84e-d1ee61a56887 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:48:07.053255 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1179/2366] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:48:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:48:07.057371 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da0e950-4b2c-4f04-9521-8efe099d3d41 None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:48:07.067430 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da0e950-4b2c-4f04-9521-8efe099d3d41 None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:48:07.072184 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47c172f-6855-4135-8001-4582a68c1225 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:48:07.072770 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47c172f-6855-4135-8001-4582a68c1225 admin admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:48:07.073047 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47c172f-6855-4135-8001-4582a68c1225 admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:48:07.073315 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47c172f-6855-4135-8001-4582a68c1225 admin admin] PATH_INFO: `/v3/domains` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:48:07.074534 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47c172f-6855-4135-8001-4582a68c1225 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:48:07.074835 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47c172f-6855-4135-8001-4582a68c1225 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:48:07.076416 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47c172f-6855-4135-8001-4582a68c1225 admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:48:07.087772 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1188/2367] 10.222.0.26 () {58 vars in 1153 bytes} [Wed Aug 24 05:48:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:48:07.091996 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733c3b4b-51f6-4b20-a84e-d1ee61a56887 None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:48:07.101018 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733c3b4b-51f6-4b20-a84e-d1ee61a56887 None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:48:07.105575 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4deda9-5f1c-4d4a-b1f9-fcad840c5605 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:48:07.106190 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4deda9-5f1c-4d4a-b1f9-fcad840c5605 admin admin] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:48:07.106470 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4deda9-5f1c-4d4a-b1f9-fcad840c5605 admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:48:07.106738 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4deda9-5f1c-4d4a-b1f9-fcad840c5605 admin admin] PATH_INFO: `/v3/projects` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:48:07.107371 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4deda9-5f1c-4d4a-b1f9-fcad840c5605 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:48:07.109250 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4deda9-5f1c-4d4a-b1f9-fcad840c5605 admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:48:07.137350 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1180/2368] 10.222.0.26 () {60 vars in 1153 bytes} [Wed Aug 24 05:48:07 2022] POST /identity/v3/projects => generated 365 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:48:07.143031 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47c172f-6855-4135-8001-4582a68c1225 admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:48:07.152948 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47c172f-6855-4135-8001-4582a68c1225 admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:48:07.208294 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17cd60b-d7a7-4cd0-a366-971c6de217eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:48:07.208889 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17cd60b-d7a7-4cd0-a366-971c6de217eb admin admin] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:48:07.209177 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17cd60b-d7a7-4cd0-a366-971c6de217eb admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:48:07.209449 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17cd60b-d7a7-4cd0-a366-971c6de217eb admin admin] PATH_INFO: `/v3/users` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:48:07.210092 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17cd60b-d7a7-4cd0-a366-971c6de217eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:48:07.212012 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17cd60b-d7a7-4cd0-a366-971c6de217eb admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:48:07.231661 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1189/2369] 10.222.0.26 () {60 vars in 1144 bytes} [Wed Aug 24 05:48:07 2022] POST /identity/v3/users => generated 283 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 05:48:07.235933 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4deda9-5f1c-4d4a-b1f9-fcad840c5605 admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:48:07.246655 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4deda9-5f1c-4d4a-b1f9-fcad840c5605 admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:48:07.251069 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12c93f3-5674-4486-a1c2-6e4bcd8fc060 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:48:07.251653 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12c93f3-5674-4486-a1c2-6e4bcd8fc060 admin admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:48:07.251929 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12c93f3-5674-4486-a1c2-6e4bcd8fc060 admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:48:07.252196 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12c93f3-5674-4486-a1c2-6e4bcd8fc060 admin admin] PATH_INFO: `/v3/roles` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:48:07.252826 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12c93f3-5674-4486-a1c2-6e4bcd8fc060 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:48:07.254444 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12c93f3-5674-4486-a1c2-6e4bcd8fc060 admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:48:07.264610 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1181/2370] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Aug 24 05:48:07 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 05:48:07.268274 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17cd60b-d7a7-4cd0-a366-971c6de217eb admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:48:07.278088 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17cd60b-d7a7-4cd0-a366-971c6de217eb admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:48:07.282678 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30540f4-dfbe-415f-b3c2-dd7c464efa1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:48:07.283260 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30540f4-dfbe-415f-b3c2-dd7c464efa1a admin admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:48:07.283540 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30540f4-dfbe-415f-b3c2-dd7c464efa1a admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:48:07.283815 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30540f4-dfbe-415f-b3c2-dd7c464efa1a admin admin] PATH_INFO: `/v3/roles` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:48:07.284447 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30540f4-dfbe-415f-b3c2-dd7c464efa1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:48:07.286080 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30540f4-dfbe-415f-b3c2-dd7c464efa1a admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:48:07.296844 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1190/2371] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Aug 24 05:48:07 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:48:07.300729 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12c93f3-5674-4486-a1c2-6e4bcd8fc060 admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:48:07.311093 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12c93f3-5674-4486-a1c2-6e4bcd8fc060 admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:48:07.315633 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba94d6a8-2cec-400e-828c-545ba5c95263 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:48:07.316271 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba94d6a8-2cec-400e-828c-545ba5c95263 admin admin] REQUEST_METHOD: `PUT` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:48:07.316567 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba94d6a8-2cec-400e-828c-545ba5c95263 admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:48:07.316817 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba94d6a8-2cec-400e-828c-545ba5c95263 admin admin] PATH_INFO: `/v3/projects/ad4e5bffff5f4f55904b04b1f00e377d/users/81a8a9ff426149f29d2bdf6af1326f86/roles/f7aa4a2c74c94c1b9ca8ecdcccccda5c` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:48:07.331455 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba94d6a8-2cec-400e-828c-545ba5c95263 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad4e5bffff5f4f55904b04b1f00e377d, user_id=81a8a9ff426149f29d2bdf6af1326f86, role_id=f7aa4a2c74c94c1b9ca8ecdcccccda5c)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:48:07.334146 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba94d6a8-2cec-400e-828c-545ba5c95263 admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:48:07.348227 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1182/2372] 10.222.0.26 () {60 vars in 1483 bytes} [Wed Aug 24 05:48:07 2022] PUT /identity/v3/projects/ad4e5bffff5f4f55904b04b1f00e377d/users/81a8a9ff426149f29d2bdf6af1326f86/roles/f7aa4a2c74c94c1b9ca8ecdcccccda5c => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 05:48:07.360086 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a5f349-fde5-4fa5-bef7-4d1a0906ebd5 None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:48:07.360086 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a5f349-fde5-4fa5-bef7-4d1a0906ebd5 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:48:07.360086 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a5f349-fde5-4fa5-bef7-4d1a0906ebd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:48:07.361028 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba94d6a8-2cec-400e-828c-545ba5c95263 admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:48:07.362853 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-ba94d6a8-2cec-400e-828c-545ba5c95263 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:48:07.389104 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-01a5f349-fde5-4fa5-bef7-4d1a0906ebd5 None None] MFA Rules not processed for user `81a8a9ff426149f29d2bdf6af1326f86`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:48:07.389754 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-01a5f349-fde5-4fa5-bef7-4d1a0906ebd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:48:07.428097 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba94d6a8-2cec-400e-828c-545ba5c95263 admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:48:07.432817 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01490dc-4c56-4dce-8ddd-8220579390d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:48:07.434038 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01490dc-4c56-4dce-8ddd-8220579390d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:48:07.434324 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01490dc-4c56-4dce-8ddd-8220579390d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:48:07.434810 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01490dc-4c56-4dce-8ddd-8220579390d6 admin admin] PATH_INFO: `/v3/users/a378c74e7f3d4366965befacb9b9c8a5` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:48:07.436001 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01490dc-4c56-4dce-8ddd-8220579390d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a378c74e7f3d4366965befacb9b9c8a5)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:48:07.437915 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01490dc-4c56-4dce-8ddd-8220579390d6 admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:48:07.455895 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1191/2373] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:48:07 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:48:07.468472 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a5f349-fde5-4fa5-bef7-4d1a0906ebd5 None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:48:07.470220 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-01a5f349-fde5-4fa5-bef7-4d1a0906ebd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:48:07.484258 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-c01490dc-4c56-4dce-8ddd-8220579390d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a378c74e7f3d4366965befacb9b9c8a5'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:48:07.491354 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-c01490dc-4c56-4dce-8ddd-8220579390d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a378c74e7f3d4366965befacb9b9c8a5'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:48:07.504775 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-c01490dc-4c56-4dce-8ddd-8220579390d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a378c74e7f3d4366965befacb9b9c8a5'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:48:07.513463 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:48:07.513695 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-c01490dc-4c56-4dce-8ddd-8220579390d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a378c74e7f3d4366965befacb9b9c8a5'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:48:07.514543 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-c01490dc-4c56-4dce-8ddd-8220579390d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a378c74e7f3d4366965befacb9b9c8a5'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:48:07.516338 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:48:07.524487 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1183/2374] 10.222.0.26 () {58 vars in 1224 bytes} [Wed Aug 24 05:48:07 2022] DELETE /identity/v3/users/a378c74e7f3d4366965befacb9b9c8a5 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 05:48:07.528711 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f5cfe7-dde5-42eb-9afe-9422f2fa4fb0 None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:48:07.528999 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f5cfe7-dde5-42eb-9afe-9422f2fa4fb0 None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:48:07.529396 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f5cfe7-dde5-42eb-9afe-9422f2fa4fb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:48:07.532021 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a5f349-fde5-4fa5-bef7-4d1a0906ebd5 None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:48:07.548614 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-92f5cfe7-dde5-42eb-9afe-9422f2fa4fb0 None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:48:07.549814 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-92f5cfe7-dde5-42eb-9afe-9422f2fa4fb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:48:07.591450 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68440eb5-5e55-4e0a-b0ac-a7b5d19045fb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17b450afe795495680fc70f522c83750', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:48:07.592185 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68440eb5-5e55-4e0a-b0ac-a7b5d19045fb service cinder] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:48:07.592473 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68440eb5-5e55-4e0a-b0ac-a7b5d19045fb service cinder] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:48:07.592746 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68440eb5-5e55-4e0a-b0ac-a7b5d19045fb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:48:07.594597 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-68440eb5-5e55-4e0a-b0ac-a7b5d19045fb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:48:07.618354 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1184/2375] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:48:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 05:48:07.628749 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f5cfe7-dde5-42eb-9afe-9422f2fa4fb0 None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:48:07.630925 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-92f5cfe7-dde5-42eb-9afe-9422f2fa4fb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:48:07.662470 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68440eb5-5e55-4e0a-b0ac-a7b5d19045fb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:48:07.663975 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68440eb5-5e55-4e0a-b0ac-a7b5d19045fb service cinder] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:48:07.675343 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1192/2376] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 24 05:48:07 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 05:48:07.698546 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f5cfe7-dde5-42eb-9afe-9422f2fa4fb0 None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:48:07.702294 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342684ba-db10-458c-92ba-3b401335bbcc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '874348b647194ac2b5ecbf12c33bf59e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:48:07.702979 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342684ba-db10-458c-92ba-3b401335bbcc service neutron] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:48:07.703324 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342684ba-db10-458c-92ba-3b401335bbcc service neutron] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:48:07.703657 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342684ba-db10-458c-92ba-3b401335bbcc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:48:07.713517 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342684ba-db10-458c-92ba-3b401335bbcc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:48:07.715505 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342684ba-db10-458c-92ba-3b401335bbcc service neutron] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:48:07.725737 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1185/2377] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 24 05:48:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:48:08.020113 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68440eb5-5e55-4e0a-b0ac-a7b5d19045fb service cinder] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:48:08.021787 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-68440eb5-5e55-4e0a-b0ac-a7b5d19045fb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:48:08.048703 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68440eb5-5e55-4e0a-b0ac-a7b5d19045fb service cinder] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:48:08.054138 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918a310e-f8e6-4789-9e3c-6efafba80ffa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:48:08.054780 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918a310e-f8e6-4789-9e3c-6efafba80ffa admin admin] REQUEST_METHOD: `DELETE` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:48:08.055063 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918a310e-f8e6-4789-9e3c-6efafba80ffa admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:48:08.055333 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918a310e-f8e6-4789-9e3c-6efafba80ffa admin admin] PATH_INFO: `/v3/projects/3d8ee0abad2c4e518a84c551ccc7836e` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:48:08.056485 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918a310e-f8e6-4789-9e3c-6efafba80ffa admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d8ee0abad2c4e518a84c551ccc7836e)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:48:08.059066 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918a310e-f8e6-4789-9e3c-6efafba80ffa admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:48:08.106165 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-918a310e-f8e6-4789-9e3c-6efafba80ffa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d8ee0abad2c4e518a84c551ccc7836e', 'request_id': 'req-918a310e-f8e6-4789-9e3c-6efafba80ffa'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:48:08.114068 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-918a310e-f8e6-4789-9e3c-6efafba80ffa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d8ee0abad2c4e518a84c551ccc7836e', 'request_id': 'req-918a310e-f8e6-4789-9e3c-6efafba80ffa'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:48:08.121324 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-918a310e-f8e6-4789-9e3c-6efafba80ffa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d8ee0abad2c4e518a84c551ccc7836e', 'request_id': 'req-918a310e-f8e6-4789-9e3c-6efafba80ffa'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:48:08.131493 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-918a310e-f8e6-4789-9e3c-6efafba80ffa admin admin] The token cache is being invalidate because project 3d8ee0abad2c4e518a84c551ccc7836e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:48:08.131775 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-918a310e-f8e6-4789-9e3c-6efafba80ffa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:48:08.132394 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-918a310e-f8e6-4789-9e3c-6efafba80ffa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:48:08.133846 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1193/2378] 10.222.0.26 () {58 vars in 1233 bytes} [Wed Aug 24 05:48:08 2022] DELETE /identity/v3/projects/3d8ee0abad2c4e518a84c551ccc7836e => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:48:17.721711 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=54 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:48:18.128479 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=78,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:48:41.250238 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141c42af-b7d5-45b3-81b9-a258cbda5d0d None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:48:41.250741 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141c42af-b7d5-45b3-81b9-a258cbda5d0d None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:48:41.250838 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141c42af-b7d5-45b3-81b9-a258cbda5d0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:48:41.269782 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-141c42af-b7d5-45b3-81b9-a258cbda5d0d None None] MFA Rules not processed for user `7ea384c1544c424eb2b524760e1d6d22`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:48:41.271003 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-141c42af-b7d5-45b3-81b9-a258cbda5d0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:48:41.324674 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1186/2379] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:48:41 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:48:43.790632 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918a310e-f8e6-4789-9e3c-6efafba80ffa admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:48:43.792095 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-918a310e-f8e6-4789-9e3c-6efafba80ffa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:48:43.862920 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918a310e-f8e6-4789-9e3c-6efafba80ffa admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:48:43.867472 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65729ba-eb9a-43e5-9ac9-9d9bab1458d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:48:43.868151 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65729ba-eb9a-43e5-9ac9-9d9bab1458d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:48:43.868426 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65729ba-eb9a-43e5-9ac9-9d9bab1458d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:48:43.868694 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65729ba-eb9a-43e5-9ac9-9d9bab1458d7 admin admin] PATH_INFO: `/v3/users/81a8a9ff426149f29d2bdf6af1326f86` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:48:43.869813 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65729ba-eb9a-43e5-9ac9-9d9bab1458d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=81a8a9ff426149f29d2bdf6af1326f86)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:48:43.871832 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65729ba-eb9a-43e5-9ac9-9d9bab1458d7 admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:48:43.922820 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-a65729ba-eb9a-43e5-9ac9-9d9bab1458d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '81a8a9ff426149f29d2bdf6af1326f86'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:48:43.930166 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-a65729ba-eb9a-43e5-9ac9-9d9bab1458d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '81a8a9ff426149f29d2bdf6af1326f86'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:48:43.930866 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-a65729ba-eb9a-43e5-9ac9-9d9bab1458d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '81a8a9ff426149f29d2bdf6af1326f86'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:48:43.943211 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-a65729ba-eb9a-43e5-9ac9-9d9bab1458d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '81a8a9ff426149f29d2bdf6af1326f86'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:48:43.950484 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-a65729ba-eb9a-43e5-9ac9-9d9bab1458d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '81a8a9ff426149f29d2bdf6af1326f86'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:48:43.957133 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1194/2380] 10.222.0.26 () {58 vars in 1224 bytes} [Wed Aug 24 05:48:43 2022] DELETE /identity/v3/users/81a8a9ff426149f29d2bdf6af1326f86 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:48:43.961692 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76e5073-4b8f-45a9-a625-c9c757ec232d None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:48:43.962236 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76e5073-4b8f-45a9-a625-c9c757ec232d None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:48:43.962347 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76e5073-4b8f-45a9-a625-c9c757ec232d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:48:43.981261 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-c76e5073-4b8f-45a9-a625-c9c757ec232d None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:48:43.982493 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-c76e5073-4b8f-45a9-a625-c9c757ec232d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:48:44.048213 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1187/2381] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:48:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:48:44.058829 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65729ba-eb9a-43e5-9ac9-9d9bab1458d7 admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:48:44.060577 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-a65729ba-eb9a-43e5-9ac9-9d9bab1458d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:48:44.122737 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65729ba-eb9a-43e5-9ac9-9d9bab1458d7 admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:48:44.126792 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4a585c-8734-46ff-96a6-499ac375d060 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '874348b647194ac2b5ecbf12c33bf59e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:48:44.127391 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4a585c-8734-46ff-96a6-499ac375d060 service neutron] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:48:44.127669 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4a585c-8734-46ff-96a6-499ac375d060 service neutron] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:48:44.128035 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4a585c-8734-46ff-96a6-499ac375d060 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:48:44.138813 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4a585c-8734-46ff-96a6-499ac375d060 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:48:44.140779 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4a585c-8734-46ff-96a6-499ac375d060 service neutron] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:48:44.150271 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1195/2382] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 24 05:48:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:48:44.489327 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76e5073-4b8f-45a9-a625-c9c757ec232d None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:48:44.490897 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-c76e5073-4b8f-45a9-a625-c9c757ec232d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:48:44.511515 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76e5073-4b8f-45a9-a625-c9c757ec232d None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:48:44.523262 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd42356-aaa1-444c-a380-6453759a6f3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:48:44.524465 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd42356-aaa1-444c-a380-6453759a6f3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:48:44.525124 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd42356-aaa1-444c-a380-6453759a6f3b admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:48:44.525602 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd42356-aaa1-444c-a380-6453759a6f3b admin admin] PATH_INFO: `/v3/projects/ad4e5bffff5f4f55904b04b1f00e377d` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:48:44.527525 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd42356-aaa1-444c-a380-6453759a6f3b admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad4e5bffff5f4f55904b04b1f00e377d)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:48:44.531950 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd42356-aaa1-444c-a380-6453759a6f3b admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:48:44.606419 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-2fd42356-aaa1-444c-a380-6453759a6f3b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad4e5bffff5f4f55904b04b1f00e377d', 'request_id': 'req-2fd42356-aaa1-444c-a380-6453759a6f3b'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:48:44.626521 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-2fd42356-aaa1-444c-a380-6453759a6f3b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad4e5bffff5f4f55904b04b1f00e377d', 'request_id': 'req-2fd42356-aaa1-444c-a380-6453759a6f3b'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:48:44.636591 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-2fd42356-aaa1-444c-a380-6453759a6f3b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad4e5bffff5f4f55904b04b1f00e377d', 'request_id': 'req-2fd42356-aaa1-444c-a380-6453759a6f3b'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:48:44.666758 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-2fd42356-aaa1-444c-a380-6453759a6f3b admin admin] The token cache is being invalidate because project ad4e5bffff5f4f55904b04b1f00e377d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88112) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:48:44.667062 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-2fd42356-aaa1-444c-a380-6453759a6f3b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:48:44.668098 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-2fd42356-aaa1-444c-a380-6453759a6f3b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:48:44.669971 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1188/2383] 10.222.0.26 () {58 vars in 1233 bytes} [Wed Aug 24 05:48:44 2022] DELETE /identity/v3/projects/ad4e5bffff5f4f55904b04b1f00e377d => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:48:44.674908 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff4e180-30a2-4fcf-b81b-8b0c11486240 None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:48:44.675191 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff4e180-30a2-4fcf-b81b-8b0c11486240 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:48:44.675460 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff4e180-30a2-4fcf-b81b-8b0c11486240 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:48:44.696365 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-3ff4e180-30a2-4fcf-b81b-8b0c11486240 None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:48:44.698324 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-3ff4e180-30a2-4fcf-b81b-8b0c11486240 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:48:44.717224 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:48:44.763449 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1196/2384] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:48:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:48:44.773552 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4dff17-217a-43b2-98f2-e539aa0552fb None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:48:44.774049 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4dff17-217a-43b2-98f2-e539aa0552fb None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:48:44.774447 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4dff17-217a-43b2-98f2-e539aa0552fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:48:44.797316 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-4a4dff17-217a-43b2-98f2-e539aa0552fb None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:48:44.798682 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-4a4dff17-217a-43b2-98f2-e539aa0552fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:48:44.807294 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1189/2385] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:48:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:48:44.811780 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff4e180-30a2-4fcf-b81b-8b0c11486240 None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:48:44.822807 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff4e180-30a2-4fcf-b81b-8b0c11486240 None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:48:44.827960 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083483d8-a854-4da8-a640-1d6b1ac5453d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:48:44.828744 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083483d8-a854-4da8-a640-1d6b1ac5453d admin admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:48:44.829164 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083483d8-a854-4da8-a640-1d6b1ac5453d admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:48:44.830128 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083483d8-a854-4da8-a640-1d6b1ac5453d admin admin] PATH_INFO: `/v3/domains` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:48:44.831021 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083483d8-a854-4da8-a640-1d6b1ac5453d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:48:44.831210 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083483d8-a854-4da8-a640-1d6b1ac5453d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:48:44.832842 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083483d8-a854-4da8-a640-1d6b1ac5453d admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:48:44.845997 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1197/2386] 10.222.0.26 () {58 vars in 1153 bytes} [Wed Aug 24 05:48:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:48:44.850467 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4dff17-217a-43b2-98f2-e539aa0552fb None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:48:44.860421 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4dff17-217a-43b2-98f2-e539aa0552fb None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:48:44.865159 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f380231-ff1f-4bb0-8a4f-e9239a107cf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:48:44.865760 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f380231-ff1f-4bb0-8a4f-e9239a107cf4 admin admin] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:48:44.866142 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f380231-ff1f-4bb0-8a4f-e9239a107cf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:48:44.866417 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f380231-ff1f-4bb0-8a4f-e9239a107cf4 admin admin] PATH_INFO: `/v3/projects` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:48:44.867090 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f380231-ff1f-4bb0-8a4f-e9239a107cf4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:48:44.868984 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f380231-ff1f-4bb0-8a4f-e9239a107cf4 admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:48:44.892454 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:48:44.902789 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1190/2387] 10.222.0.26 () {60 vars in 1153 bytes} [Wed Aug 24 05:48:44 2022] POST /identity/v3/projects => generated 383 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:48:44.903998 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083483d8-a854-4da8-a640-1d6b1ac5453d admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:48:44.914490 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083483d8-a854-4da8-a640-1d6b1ac5453d admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:48:44.990348 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00f4f31-6b11-4e82-90f5-1e9d855f51ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:48:44.990972 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00f4f31-6b11-4e82-90f5-1e9d855f51ca admin admin] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:48:44.991252 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00f4f31-6b11-4e82-90f5-1e9d855f51ca admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:48:44.991528 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00f4f31-6b11-4e82-90f5-1e9d855f51ca admin admin] PATH_INFO: `/v3/users` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:48:44.992168 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00f4f31-6b11-4e82-90f5-1e9d855f51ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:48:44.994202 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00f4f31-6b11-4e82-90f5-1e9d855f51ca admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:48:45.020846 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1198/2388] 10.222.0.26 () {60 vars in 1144 bytes} [Wed Aug 24 05:48:44 2022] POST /identity/v3/users => generated 292 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 05:48:45.025451 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f380231-ff1f-4bb0-8a4f-e9239a107cf4 admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:48:45.037753 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f380231-ff1f-4bb0-8a4f-e9239a107cf4 admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:48:45.042807 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e35c31-919d-469f-a2fd-dbae91bcdb3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:48:45.043625 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e35c31-919d-469f-a2fd-dbae91bcdb3e admin admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:48:45.044071 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e35c31-919d-469f-a2fd-dbae91bcdb3e admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:48:45.044474 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e35c31-919d-469f-a2fd-dbae91bcdb3e admin admin] PATH_INFO: `/v3/roles` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:48:45.045145 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e35c31-919d-469f-a2fd-dbae91bcdb3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:48:45.047480 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e35c31-919d-469f-a2fd-dbae91bcdb3e admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:48:45.060786 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1191/2389] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Aug 24 05:48:45 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:48:45.067917 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00f4f31-6b11-4e82-90f5-1e9d855f51ca admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:48:45.080026 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00f4f31-6b11-4e82-90f5-1e9d855f51ca admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:48:45.085167 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51dd2074-4c49-46f3-a685-713bdb776e6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:48:45.086002 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dd2074-4c49-46f3-a685-713bdb776e6d admin admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:48:45.086364 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dd2074-4c49-46f3-a685-713bdb776e6d admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:48:45.086713 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dd2074-4c49-46f3-a685-713bdb776e6d admin admin] PATH_INFO: `/v3/roles` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:48:45.087438 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51dd2074-4c49-46f3-a685-713bdb776e6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:48:45.089138 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51dd2074-4c49-46f3-a685-713bdb776e6d admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:48:45.104809 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1199/2390] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Aug 24 05:48:45 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:48:45.109479 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e35c31-919d-469f-a2fd-dbae91bcdb3e admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:48:45.120216 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e35c31-919d-469f-a2fd-dbae91bcdb3e admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:48:45.125930 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f004a81-849d-4c6e-844f-16cee592a745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:48:45.126703 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f004a81-849d-4c6e-844f-16cee592a745 admin admin] REQUEST_METHOD: `PUT` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:48:45.127055 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f004a81-849d-4c6e-844f-16cee592a745 admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:48:45.127430 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f004a81-849d-4c6e-844f-16cee592a745 admin admin] PATH_INFO: `/v3/projects/eafab246291a4e949728e4ad0fe979af/users/58d3b2fe99094a3bab136843fb8f8150/roles/f7aa4a2c74c94c1b9ca8ecdcccccda5c` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:48:45.145743 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f004a81-849d-4c6e-844f-16cee592a745 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eafab246291a4e949728e4ad0fe979af, user_id=58d3b2fe99094a3bab136843fb8f8150, role_id=f7aa4a2c74c94c1b9ca8ecdcccccda5c)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:48:45.148564 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f004a81-849d-4c6e-844f-16cee592a745 admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:48:45.164552 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1192/2391] 10.222.0.26 () {60 vars in 1483 bytes} [Wed Aug 24 05:48:45 2022] PUT /identity/v3/projects/eafab246291a4e949728e4ad0fe979af/users/58d3b2fe99094a3bab136843fb8f8150/roles/f7aa4a2c74c94c1b9ca8ecdcccccda5c => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:48:45.171004 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c95b12-f4eb-4c59-9987-842ecdff1999 None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:48:45.171890 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c95b12-f4eb-4c59-9987-842ecdff1999 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:48:45.172285 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c95b12-f4eb-4c59-9987-842ecdff1999 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:48:45.194735 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-66c95b12-f4eb-4c59-9987-842ecdff1999 None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:48:45.197320 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-66c95b12-f4eb-4c59-9987-842ecdff1999 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:48:45.275459 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1200/2392] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:48:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:48:45.291511 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f004a81-849d-4c6e-844f-16cee592a745 admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:48:45.293260 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-1f004a81-849d-4c6e-844f-16cee592a745 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:48:45.377488 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f004a81-849d-4c6e-844f-16cee592a745 admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:48:45.382630 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb28905-4a6f-4b07-8d93-962544c23ccb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '874348b647194ac2b5ecbf12c33bf59e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:48:45.383255 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb28905-4a6f-4b07-8d93-962544c23ccb service neutron] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:48:45.383537 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb28905-4a6f-4b07-8d93-962544c23ccb service neutron] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:48:45.383813 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb28905-4a6f-4b07-8d93-962544c23ccb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:48:45.397240 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb28905-4a6f-4b07-8d93-962544c23ccb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:48:45.398710 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb28905-4a6f-4b07-8d93-962544c23ccb service neutron] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:48:45.419799 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1193/2393] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 24 05:48:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:48:46.425198 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc12707e-450e-4cce-8c10-78735ae77556 None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:48:46.425717 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc12707e-450e-4cce-8c10-78735ae77556 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:48:46.425717 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc12707e-450e-4cce-8c10-78735ae77556 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:48:46.448569 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-bc12707e-450e-4cce-8c10-78735ae77556 None None] MFA Rules not processed for user `d2bf5c5fc7a44e9ebcbd48aa4c9ba549`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:48:46.449775 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-bc12707e-450e-4cce-8c10-78735ae77556 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:48:46.479533 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:48:46.520322 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1201/2394] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:48:46 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:48:51.585023 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c96853-4f94-4c71-9e42-b22f6c2b01e6 None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:48:51.585485 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c96853-4f94-4c71-9e42-b22f6c2b01e6 None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:48:51.585677 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c96853-4f94-4c71-9e42-b22f6c2b01e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:48:51.632087 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-a3c96853-4f94-4c71-9e42-b22f6c2b01e6 None None] MFA Rules not processed for user `58d3b2fe99094a3bab136843fb8f8150`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:48:51.634234 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-a3c96853-4f94-4c71-9e42-b22f6c2b01e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:48:51.767397 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1194/2395] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:48:51 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:48:51.768712 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc12707e-450e-4cce-8c10-78735ae77556 None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:48:51.787631 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc12707e-450e-4cce-8c10-78735ae77556 None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:48:51.806673 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396e7f38-fb18-49aa-906b-7128f8e8de9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:48:51.807308 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396e7f38-fb18-49aa-906b-7128f8e8de9a admin admin] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:48:51.808281 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396e7f38-fb18-49aa-906b-7128f8e8de9a admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:48:51.808281 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396e7f38-fb18-49aa-906b-7128f8e8de9a admin admin] PATH_INFO: `/v3/projects` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:48:51.808599 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396e7f38-fb18-49aa-906b-7128f8e8de9a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:48:51.815470 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396e7f38-fb18-49aa-906b-7128f8e8de9a admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:48:51.877455 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1202/2396] 10.222.0.26 () {60 vars in 1153 bytes} [Wed Aug 24 05:48:51 2022] POST /identity/v3/projects => generated 385 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:48:51.881143 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c96853-4f94-4c71-9e42-b22f6c2b01e6 None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:48:51.903592 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c96853-4f94-4c71-9e42-b22f6c2b01e6 None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:48:52.034123 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:48:52.048271 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef90304f-af59-468f-a376-30e19e021668 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:48:52.050172 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef90304f-af59-468f-a376-30e19e021668 admin admin] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:48:52.050742 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef90304f-af59-468f-a376-30e19e021668 admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:48:52.051578 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef90304f-af59-468f-a376-30e19e021668 admin admin] PATH_INFO: `/v3/users` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:48:52.053103 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef90304f-af59-468f-a376-30e19e021668 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:48:52.056233 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef90304f-af59-468f-a376-30e19e021668 admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:48:52.087241 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1195/2397] 10.222.0.26 () {60 vars in 1144 bytes} [Wed Aug 24 05:48:51 2022] POST /identity/v3/users => generated 299 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:48:52.090967 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396e7f38-fb18-49aa-906b-7128f8e8de9a admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:48:52.112228 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396e7f38-fb18-49aa-906b-7128f8e8de9a admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:48:52.123493 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5256e1-d69c-46d3-9766-ce9175edda87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:48:52.125626 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5256e1-d69c-46d3-9766-ce9175edda87 admin admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:48:52.126128 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5256e1-d69c-46d3-9766-ce9175edda87 admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:48:52.126560 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5256e1-d69c-46d3-9766-ce9175edda87 admin admin] PATH_INFO: `/v3/roles` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:48:52.129882 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5256e1-d69c-46d3-9766-ce9175edda87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:48:52.133403 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5256e1-d69c-46d3-9766-ce9175edda87 admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:48:52.148272 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1203/2398] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Aug 24 05:48:52 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:48:52.152466 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef90304f-af59-468f-a376-30e19e021668 admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:48:52.168746 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef90304f-af59-468f-a376-30e19e021668 admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:48:52.177172 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff5f607-991c-4ab9-9414-5ed692413991 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:48:52.177911 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff5f607-991c-4ab9-9414-5ed692413991 admin admin] REQUEST_METHOD: `PUT` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:48:52.178180 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff5f607-991c-4ab9-9414-5ed692413991 admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:48:52.178460 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff5f607-991c-4ab9-9414-5ed692413991 admin admin] PATH_INFO: `/v3/projects/2d96cc7881964ee8b167581f6a6699d4/users/0007e95465594878947ad95619686a26/roles/640bda0879494e60b72680ee505285f0` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:48:52.200885 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff5f607-991c-4ab9-9414-5ed692413991 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d96cc7881964ee8b167581f6a6699d4, user_id=0007e95465594878947ad95619686a26, role_id=640bda0879494e60b72680ee505285f0)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:48:52.204349 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff5f607-991c-4ab9-9414-5ed692413991 admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:48:52.230143 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1196/2399] 10.222.0.26 () {60 vars in 1483 bytes} [Wed Aug 24 05:48:52 2022] PUT /identity/v3/projects/2d96cc7881964ee8b167581f6a6699d4/users/0007e95465594878947ad95619686a26/roles/640bda0879494e60b72680ee505285f0 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:48:52.234891 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5256e1-d69c-46d3-9766-ce9175edda87 admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:48:52.250025 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5256e1-d69c-46d3-9766-ce9175edda87 admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:48:52.360275 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfe0fd4-efa1-40ff-a875-9e24c2c09a45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:48:52.361580 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfe0fd4-efa1-40ff-a875-9e24c2c09a45 admin admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:48:52.361923 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfe0fd4-efa1-40ff-a875-9e24c2c09a45 admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:48:52.362320 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfe0fd4-efa1-40ff-a875-9e24c2c09a45 admin admin] PATH_INFO: `/v3/roles` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:48:52.363046 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfe0fd4-efa1-40ff-a875-9e24c2c09a45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:48:52.365288 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfe0fd4-efa1-40ff-a875-9e24c2c09a45 admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:48:52.382122 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1204/2400] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Aug 24 05:48:52 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:48:52.385104 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff5f607-991c-4ab9-9414-5ed692413991 admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:48:52.398444 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff5f607-991c-4ab9-9414-5ed692413991 admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:48:52.405860 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a8e7a3-bacd-4e4f-90ab-da5c5c7a4f6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:48:52.406712 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a8e7a3-bacd-4e4f-90ab-da5c5c7a4f6a admin admin] REQUEST_METHOD: `PUT` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:48:52.407012 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a8e7a3-bacd-4e4f-90ab-da5c5c7a4f6a admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:48:52.407382 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a8e7a3-bacd-4e4f-90ab-da5c5c7a4f6a admin admin] PATH_INFO: `/v3/projects/2d96cc7881964ee8b167581f6a6699d4/users/0007e95465594878947ad95619686a26/roles/640bda0879494e60b72680ee505285f0` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:48:52.411030 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a8e7a3-bacd-4e4f-90ab-da5c5c7a4f6a admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d96cc7881964ee8b167581f6a6699d4, user_id=0007e95465594878947ad95619686a26, role_id=640bda0879494e60b72680ee505285f0)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:48:52.413932 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a8e7a3-bacd-4e4f-90ab-da5c5c7a4f6a admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:48:52.430009 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1197/2401] 10.222.0.26 () {60 vars in 1483 bytes} [Wed Aug 24 05:48:52 2022] PUT /identity/v3/projects/2d96cc7881964ee8b167581f6a6699d4/users/0007e95465594878947ad95619686a26/roles/640bda0879494e60b72680ee505285f0 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:48:57.816441 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d30fd2-d803-4cb6-9915-cf10746a967a None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:48:57.817544 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d30fd2-d803-4cb6-9915-cf10746a967a None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:48:57.818025 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d30fd2-d803-4cb6-9915-cf10746a967a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:48:57.853721 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-c1d30fd2-d803-4cb6-9915-cf10746a967a None None] MFA Rules not processed for user `0007e95465594878947ad95619686a26`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:48:57.855209 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-c1d30fd2-d803-4cb6-9915-cf10746a967a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:48:58.032614 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1205/2402] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:48:57 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:48:58.053184 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a8e7a3-bacd-4e4f-90ab-da5c5c7a4f6a admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:48:58.054632 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-06a8e7a3-bacd-4e4f-90ab-da5c5c7a4f6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:48:58.160690 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a8e7a3-bacd-4e4f-90ab-da5c5c7a4f6a admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:48:58.170355 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e194ad5e-bc04-4b25-91f3-ced52521e9e5 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f856958add7474a989325cea7b1b224', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:48:58.171602 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e194ad5e-bc04-4b25-91f3-ced52521e9e5 service glance] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:48:58.171937 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e194ad5e-bc04-4b25-91f3-ced52521e9e5 service glance] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:48:58.172266 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e194ad5e-bc04-4b25-91f3-ced52521e9e5 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:48:58.241840 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e194ad5e-bc04-4b25-91f3-ced52521e9e5 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:48:58.243877 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e194ad5e-bc04-4b25-91f3-ced52521e9e5 service glance] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:48:58.255339 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1198/2403] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 24 05:48:58 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:48:58.419268 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e2161f-5be8-444e-b811-34b4e4835a36 None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:48:58.419589 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e2161f-5be8-444e-b811-34b4e4835a36 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:48:58.419863 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e2161f-5be8-444e-b811-34b4e4835a36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:48:58.446234 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-29e2161f-5be8-444e-b811-34b4e4835a36 None None] MFA Rules not processed for user `6c2c08b27a0f4943b5da908eb7b1cd96`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:48:58.448233 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-29e2161f-5be8-444e-b811-34b4e4835a36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:48:58.482148 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:48:58.558210 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1206/2404] 10.222.0.26 () {58 vars in 1009 bytes} [Wed Aug 24 05:48:58 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:48:58.597919 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e194ad5e-bc04-4b25-91f3-ced52521e9e5 service glance] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:48:58.599487 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-e194ad5e-bc04-4b25-91f3-ced52521e9e5 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:48:58.704583 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e194ad5e-bc04-4b25-91f3-ced52521e9e5 service glance] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:48:58.709780 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828bb87f-de7a-4011-a10f-78a31c735d6f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87ff96222a7c4baea31fc1bebf4d89a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:48:58.710433 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828bb87f-de7a-4011-a10f-78a31c735d6f service swift] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:48:58.710714 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828bb87f-de7a-4011-a10f-78a31c735d6f service swift] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:48:58.710980 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828bb87f-de7a-4011-a10f-78a31c735d6f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:48:58.716607 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:48:58.721528 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828bb87f-de7a-4011-a10f-78a31c735d6f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:48:58.723548 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828bb87f-de7a-4011-a10f-78a31c735d6f service swift] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:48:58.754328 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1199/2405] 10.222.0.26 () {60 vars in 1384 bytes} [Wed Aug 24 05:48:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 05:49:00.123113 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363db843-7e09-4f5b-ae17-e6d4bc910b55 None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:49:00.125936 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363db843-7e09-4f5b-ae17-e6d4bc910b55 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:49:00.126539 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363db843-7e09-4f5b-ae17-e6d4bc910b55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:49:00.156363 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-363db843-7e09-4f5b-ae17-e6d4bc910b55 None None] MFA Rules not processed for user `6c2c08b27a0f4943b5da908eb7b1cd96`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:49:00.157880 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-363db843-7e09-4f5b-ae17-e6d4bc910b55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:49:00.187553 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1207/2406] 10.222.0.26 () {58 vars in 1009 bytes} [Wed Aug 24 05:49:00 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:49:00.202802 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828bb87f-de7a-4011-a10f-78a31c735d6f service swift] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:49:00.226473 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828bb87f-de7a-4011-a10f-78a31c735d6f service swift] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:49:00.235259 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5724c542-b367-4556-8c5c-16f1ee547f18 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87ff96222a7c4baea31fc1bebf4d89a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:49:00.236128 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5724c542-b367-4556-8c5c-16f1ee547f18 service swift] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:49:00.236571 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5724c542-b367-4556-8c5c-16f1ee547f18 service swift] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:49:00.247715 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5724c542-b367-4556-8c5c-16f1ee547f18 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:49:00.260785 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5724c542-b367-4556-8c5c-16f1ee547f18 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:49:00.262475 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5724c542-b367-4556-8c5c-16f1ee547f18 service swift] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:49:00.276287 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1200/2407] 10.222.0.26 () {60 vars in 1384 bytes} [Wed Aug 24 05:49:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 24 05:49:01.000872 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363db843-7e09-4f5b-ae17-e6d4bc910b55 None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:49:01.003889 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-363db843-7e09-4f5b-ae17-e6d4bc910b55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:49:01.176630 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363db843-7e09-4f5b-ae17-e6d4bc910b55 None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:49:01.200085 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7b581c-c40e-450b-924e-e1b8872969e0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '995ebe690b7748c9842bc0696415fc52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:49:01.200728 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7b581c-c40e-450b-924e-e1b8872969e0 service placement] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:49:01.201013 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7b581c-c40e-450b-924e-e1b8872969e0 service placement] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:49:01.201290 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7b581c-c40e-450b-924e-e1b8872969e0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:49:01.203564 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-7e7b581c-c40e-450b-924e-e1b8872969e0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:49:01.234094 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7b581c-c40e-450b-924e-e1b8872969e0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:49:01.243404 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7b581c-c40e-450b-924e-e1b8872969e0 service placement] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:49:01.267765 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1208/2408] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 24 05:49:00 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:49:10.273320 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=9 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:49:11.262206 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=50 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:49:11.474477 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9ca48c-d173-4b02-938d-a6743e58216f None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:49:11.475060 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9ca48c-d173-4b02-938d-a6743e58216f None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:49:11.475181 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9ca48c-d173-4b02-938d-a6743e58216f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:49:11.498867 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-1e9ca48c-d173-4b02-938d-a6743e58216f None None] MFA Rules not processed for user `58d3b2fe99094a3bab136843fb8f8150`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:49:11.500410 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-1e9ca48c-d173-4b02-938d-a6743e58216f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:49:11.508128 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1201/2409] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:49:11 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:49:13.976021 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d797e21b-08e9-45f3-a9fe-ade7d67a36c9 None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:49:13.976508 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d797e21b-08e9-45f3-a9fe-ade7d67a36c9 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:49:13.976610 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d797e21b-08e9-45f3-a9fe-ade7d67a36c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:49:13.995513 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-d797e21b-08e9-45f3-a9fe-ade7d67a36c9 None None] MFA Rules not processed for user `6c2c08b27a0f4943b5da908eb7b1cd96`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:49:13.996732 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-d797e21b-08e9-45f3-a9fe-ade7d67a36c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:49:14.004690 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1209/2410] 10.222.0.26 () {58 vars in 1009 bytes} [Wed Aug 24 05:49:13 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:49:14.017381 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9ca48c-d173-4b02-938d-a6743e58216f None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:49:14.030237 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9ca48c-d173-4b02-938d-a6743e58216f None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:49:14.035521 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39223436-7dcb-4691-9cf3-906016cf75bb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87ff96222a7c4baea31fc1bebf4d89a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:49:14.036262 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39223436-7dcb-4691-9cf3-906016cf75bb service swift] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:49:14.036644 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39223436-7dcb-4691-9cf3-906016cf75bb service swift] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:49:14.037050 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39223436-7dcb-4691-9cf3-906016cf75bb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:49:14.046122 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39223436-7dcb-4691-9cf3-906016cf75bb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:49:14.047709 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39223436-7dcb-4691-9cf3-906016cf75bb service swift] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:49:14.055918 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1202/2411] 10.222.0.26 () {60 vars in 1384 bytes} [Wed Aug 24 05:49:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 05:49:23.990190 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=3 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:49:24.052574 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=9 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:49:31.904339 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5859cc08-3e2a-433d-b115-a1fa1a73ee6a None None] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:49:31.904942 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5859cc08-3e2a-433d-b115-a1fa1a73ee6a None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:49:31.904942 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5859cc08-3e2a-433d-b115-a1fa1a73ee6a None None] PATH_INFO: `/` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:49:31.906751 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1210/2412] 10.222.0.26 () {54 vars in 921 bytes} [Wed Aug 24 05:49:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:49:31.913070 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9d2796-efd0-4333-bf37-2b2f60416446 None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:49:31.913562 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9d2796-efd0-4333-bf37-2b2f60416446 None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:49:31.913669 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9d2796-efd0-4333-bf37-2b2f60416446 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:49:31.935628 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-fa9d2796-efd0-4333-bf37-2b2f60416446 None None] MFA Rules not processed for user `7b633e1aec6c4269bce13aa9c89e911a`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:49:31.936861 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-fa9d2796-efd0-4333-bf37-2b2f60416446 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:49:32.007003 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1203/2413] 10.222.0.26 () {58 vars in 1018 bytes} [Wed Aug 24 05:49:31 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:49:32.019413 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5859cc08-3e2a-433d-b115-a1fa1a73ee6a None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:49:32.021109 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-5859cc08-3e2a-433d-b115-a1fa1a73ee6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:49:32.035521 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5859cc08-3e2a-433d-b115-a1fa1a73ee6a None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:49:32.039110 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4c77f7-e2eb-456a-b8c3-feba30f7d0a5 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f856958add7474a989325cea7b1b224', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:49:32.039738 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4c77f7-e2eb-456a-b8c3-feba30f7d0a5 service glance] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:49:32.040021 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4c77f7-e2eb-456a-b8c3-feba30f7d0a5 service glance] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:49:32.040294 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4c77f7-e2eb-456a-b8c3-feba30f7d0a5 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:49:32.051523 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4c77f7-e2eb-456a-b8c3-feba30f7d0a5 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:49:32.052987 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4c77f7-e2eb-456a-b8c3-feba30f7d0a5 service glance] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:49:32.063732 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1211/2414] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 24 05:49:32 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:49:32.131825 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd28bfb-0416-4d3c-a178-40e295daaa0d None None] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:49:32.132063 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd28bfb-0416-4d3c-a178-40e295daaa0d None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:49:32.132340 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd28bfb-0416-4d3c-a178-40e295daaa0d None None] PATH_INFO: `/` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:49:32.133692 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1204/2415] 10.222.0.26 () {54 vars in 921 bytes} [Wed Aug 24 05:49:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:49:32.138552 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7346a8c2-a69a-4963-b72b-ed6a08dc4d18 None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:49:32.138839 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7346a8c2-a69a-4963-b72b-ed6a08dc4d18 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:49:32.139106 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7346a8c2-a69a-4963-b72b-ed6a08dc4d18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:49:32.164099 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-7346a8c2-a69a-4963-b72b-ed6a08dc4d18 None None] MFA Rules not processed for user `874348b647194ac2b5ecbf12c33bf59e`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:49:32.165284 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-7346a8c2-a69a-4963-b72b-ed6a08dc4d18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:49:32.213967 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1212/2416] 10.222.0.26 () {58 vars in 1018 bytes} [Wed Aug 24 05:49:32 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:49:32.226253 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd28bfb-0416-4d3c-a178-40e295daaa0d None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:49:32.237648 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd28bfb-0416-4d3c-a178-40e295daaa0d None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:49:32.241137 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aead66e0-13e3-45e3-b608-fa4758c540d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '874348b647194ac2b5ecbf12c33bf59e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:49:32.241718 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aead66e0-13e3-45e3-b608-fa4758c540d8 service neutron] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:49:32.242027 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aead66e0-13e3-45e3-b608-fa4758c540d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:49:32.242298 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aead66e0-13e3-45e3-b608-fa4758c540d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:49:32.249210 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aead66e0-13e3-45e3-b608-fa4758c540d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:49:32.250646 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aead66e0-13e3-45e3-b608-fa4758c540d8 service neutron] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:49:32.258403 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1205/2417] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 24 05:49:32 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:49:32.393851 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7149399d-b94c-4407-9104-22d3191cae73 None None] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:49:32.394093 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7149399d-b94c-4407-9104-22d3191cae73 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:49:32.394358 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7149399d-b94c-4407-9104-22d3191cae73 None None] PATH_INFO: `/` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:49:32.395756 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1213/2418] 10.222.0.26 () {54 vars in 921 bytes} [Wed Aug 24 05:49:32 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:49:32.402407 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984a492d-de94-434b-9133-e4255e36ea52 None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:49:32.402866 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984a492d-de94-434b-9133-e4255e36ea52 None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:49:32.403251 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984a492d-de94-434b-9133-e4255e36ea52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:49:32.428029 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-984a492d-de94-434b-9133-e4255e36ea52 None None] MFA Rules not processed for user `7b633e1aec6c4269bce13aa9c89e911a`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:49:32.429515 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-984a492d-de94-434b-9133-e4255e36ea52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:49:32.447703 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1206/2419] 10.222.0.26 () {58 vars in 1018 bytes} [Wed Aug 24 05:49:32 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:49:32.460449 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7149399d-b94c-4407-9104-22d3191cae73 None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:49:32.483600 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7149399d-b94c-4407-9104-22d3191cae73 None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:49:32.487320 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ba84e1-7af0-4e5f-89b7-f4274b53944c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '874348b647194ac2b5ecbf12c33bf59e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:49:32.487989 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ba84e1-7af0-4e5f-89b7-f4274b53944c service neutron] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:49:32.488269 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ba84e1-7af0-4e5f-89b7-f4274b53944c service neutron] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:49:32.488540 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ba84e1-7af0-4e5f-89b7-f4274b53944c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:49:32.499135 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ba84e1-7af0-4e5f-89b7-f4274b53944c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:49:32.500574 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ba84e1-7af0-4e5f-89b7-f4274b53944c service neutron] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:49:32.512078 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1214/2420] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 24 05:49:32 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:49:36.788476 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd9753e-a6c9-49a4-9cf8-7c9904ea797b None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:49:36.788945 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd9753e-a6c9-49a4-9cf8-7c9904ea797b None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:49:36.789053 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd9753e-a6c9-49a4-9cf8-7c9904ea797b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:49:36.807492 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-7dd9753e-a6c9-49a4-9cf8-7c9904ea797b None None] MFA Rules not processed for user `6c2c08b27a0f4943b5da908eb7b1cd96`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:49:36.808690 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-7dd9753e-a6c9-49a4-9cf8-7c9904ea797b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:49:36.816008 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1207/2421] 10.222.0.26 () {58 vars in 1009 bytes} [Wed Aug 24 05:49:36 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:49:36.828003 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ba84e1-7af0-4e5f-89b7-f4274b53944c service neutron] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:49:36.839528 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ba84e1-7af0-4e5f-89b7-f4274b53944c service neutron] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:49:36.844375 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a556f5-983f-41b3-8a25-7a4f61b698e6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87ff96222a7c4baea31fc1bebf4d89a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:49:36.845606 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a556f5-983f-41b3-8a25-7a4f61b698e6 service swift] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:49:36.845884 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a556f5-983f-41b3-8a25-7a4f61b698e6 service swift] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:49:36.846183 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a556f5-983f-41b3-8a25-7a4f61b698e6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:49:36.855459 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a556f5-983f-41b3-8a25-7a4f61b698e6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:49:36.857038 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a556f5-983f-41b3-8a25-7a4f61b698e6 service swift] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:49:36.865598 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1215/2422] 10.222.0.26 () {60 vars in 1384 bytes} [Wed Aug 24 05:49:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 05:49:46.802528 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=43 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:49:46.862467 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=41 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:50:04.361882 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f562af-dc4a-4bc5-85cd-39d1eae18b6c None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:50:04.363020 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f562af-dc4a-4bc5-85cd-39d1eae18b6c None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:50:04.363020 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f562af-dc4a-4bc5-85cd-39d1eae18b6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:50:04.382635 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-b8f562af-dc4a-4bc5-85cd-39d1eae18b6c None None] MFA Rules not processed for user `6c2c08b27a0f4943b5da908eb7b1cd96`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:50:04.383850 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-b8f562af-dc4a-4bc5-85cd-39d1eae18b6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:50:04.391051 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1208/2423] 10.222.0.26 () {58 vars in 967 bytes} [Wed Aug 24 05:50:04 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:50:04.413626 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a556f5-983f-41b3-8a25-7a4f61b698e6 service swift] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:50:04.423999 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a556f5-983f-41b3-8a25-7a4f61b698e6 service swift] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:50:04.428905 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126e49ed-4f61-4e9f-b374-c54b3b01fc9d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87ff96222a7c4baea31fc1bebf4d89a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:50:04.429489 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126e49ed-4f61-4e9f-b374-c54b3b01fc9d service swift] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:50:04.429819 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126e49ed-4f61-4e9f-b374-c54b3b01fc9d service swift] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:50:04.430126 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126e49ed-4f61-4e9f-b374-c54b3b01fc9d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:50:04.437873 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126e49ed-4f61-4e9f-b374-c54b3b01fc9d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:50:04.439463 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126e49ed-4f61-4e9f-b374-c54b3b01fc9d service swift] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:50:04.447664 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1216/2424] 10.222.0.26 () {60 vars in 1384 bytes} [Wed Aug 24 05:50:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 05:50:06.941791 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f562af-dc4a-4bc5-85cd-39d1eae18b6c None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:50:06.943234 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-b8f562af-dc4a-4bc5-85cd-39d1eae18b6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:50:06.954789 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f562af-dc4a-4bc5-85cd-39d1eae18b6c None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:50:06.958353 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb2a74b-c940-454c-b784-0d0e1033a86a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '874348b647194ac2b5ecbf12c33bf59e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:50:06.958950 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb2a74b-c940-454c-b784-0d0e1033a86a service neutron] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:50:06.959230 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb2a74b-c940-454c-b784-0d0e1033a86a service neutron] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:50:06.959500 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb2a74b-c940-454c-b784-0d0e1033a86a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:50:06.968395 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb2a74b-c940-454c-b784-0d0e1033a86a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:50:06.969878 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb2a74b-c940-454c-b784-0d0e1033a86a service neutron] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:50:06.979332 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1209/2425] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 24 05:50:06 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:50:14.444206 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=6 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:50:16.975194 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=9 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:50:54.118295 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2889a774-017d-4464-b26a-672e1930b807 None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:50:54.118818 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2889a774-017d-4464-b26a-672e1930b807 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:50:54.118917 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2889a774-017d-4464-b26a-672e1930b807 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:50:54.137250 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-2889a774-017d-4464-b26a-672e1930b807 None None] MFA Rules not processed for user `7ea384c1544c424eb2b524760e1d6d22`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:50:54.138487 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-2889a774-017d-4464-b26a-672e1930b807 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:50:54.196917 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1217/2426] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:50:54 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:50:54.243032 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb2a74b-c940-454c-b784-0d0e1033a86a service neutron] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:50:54.251978 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb2a74b-c940-454c-b784-0d0e1033a86a service neutron] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:50:54.255520 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0d4654-2a07-4174-af58-0c7c509694af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '874348b647194ac2b5ecbf12c33bf59e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:50:54.256109 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0d4654-2a07-4174-af58-0c7c509694af service neutron] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:50:54.256385 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0d4654-2a07-4174-af58-0c7c509694af service neutron] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:50:54.256768 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0d4654-2a07-4174-af58-0c7c509694af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:50:54.258671 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-3f0d4654-2a07-4174-af58-0c7c509694af service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:50:54.272008 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0d4654-2a07-4174-af58-0c7c509694af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:50:54.273472 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0d4654-2a07-4174-af58-0c7c509694af service neutron] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:50:54.284473 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1210/2427] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 24 05:50:54 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 05:50:55.466781 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2889a774-017d-4464-b26a-672e1930b807 None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:50:55.477740 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2889a774-017d-4464-b26a-672e1930b807 None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:50:55.481515 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ac3a61-68bf-4e8c-9249-58315ea8f4a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '874348b647194ac2b5ecbf12c33bf59e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:50:55.488170 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ac3a61-68bf-4e8c-9249-58315ea8f4a4 service neutron] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:50:55.488465 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ac3a61-68bf-4e8c-9249-58315ea8f4a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:50:55.488784 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ac3a61-68bf-4e8c-9249-58315ea8f4a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:50:55.490748 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-d0ac3a61-68bf-4e8c-9249-58315ea8f4a4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:50:55.504755 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ac3a61-68bf-4e8c-9249-58315ea8f4a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:50:55.506231 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ac3a61-68bf-4e8c-9249-58315ea8f4a4 service neutron] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:50:55.517058 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1218/2428] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 24 05:50:55 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 05:51:04.279568 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=6 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:51:05.267615 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0d4654-2a07-4174-af58-0c7c509694af service neutron] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:51:05.269247 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-3f0d4654-2a07-4174-af58-0c7c509694af service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:51:05.282931 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0d4654-2a07-4174-af58-0c7c509694af service neutron] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:51:05.288437 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe74933-f5c6-49ff-9b79-986b78ee1c9d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b633e1aec6c4269bce13aa9c89e911a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:51:05.289069 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe74933-f5c6-49ff-9b79-986b78ee1c9d service nova] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:51:05.289348 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe74933-f5c6-49ff-9b79-986b78ee1c9d service nova] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:51:05.289621 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe74933-f5c6-49ff-9b79-986b78ee1c9d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:51:05.291340 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-fbe74933-f5c6-49ff-9b79-986b78ee1c9d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:51:05.302402 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe74933-f5c6-49ff-9b79-986b78ee1c9d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:51:05.303986 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe74933-f5c6-49ff-9b79-986b78ee1c9d service nova] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:51:05.314018 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1211/2429] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 24 05:51:05 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:51:05.512215 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=31 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:51:12.031442 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198bd118-a2bd-4fe5-aff2-36a1e932c134 None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:51:12.032059 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198bd118-a2bd-4fe5-aff2-36a1e932c134 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:51:12.032059 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198bd118-a2bd-4fe5-aff2-36a1e932c134 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:51:12.051373 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-198bd118-a2bd-4fe5-aff2-36a1e932c134 None None] MFA Rules not processed for user `d2bf5c5fc7a44e9ebcbd48aa4c9ba549`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:51:12.052587 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-198bd118-a2bd-4fe5-aff2-36a1e932c134 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:51:12.108563 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1219/2430] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:51:12 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:51:14.050409 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe74933-f5c6-49ff-9b79-986b78ee1c9d service nova] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:51:14.051844 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-fbe74933-f5c6-49ff-9b79-986b78ee1c9d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:51:14.107519 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe74933-f5c6-49ff-9b79-986b78ee1c9d service nova] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:51:14.111248 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dbdd33-11ce-4a66-8c70-7e10b36b4a98 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17b450afe795495680fc70f522c83750', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:51:14.111810 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dbdd33-11ce-4a66-8c70-7e10b36b4a98 service cinder] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:51:14.112090 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dbdd33-11ce-4a66-8c70-7e10b36b4a98 service cinder] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:51:14.112359 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dbdd33-11ce-4a66-8c70-7e10b36b4a98 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:51:14.114282 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-00dbdd33-11ce-4a66-8c70-7e10b36b4a98 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:51:14.171555 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00dbdd33-11ce-4a66-8c70-7e10b36b4a98 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:51:14.173002 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00dbdd33-11ce-4a66-8c70-7e10b36b4a98 service cinder] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:51:14.182487 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1212/2431] 10.222.0.26 () {60 vars in 1396 bytes} [Wed Aug 24 05:51:14 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3264 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:51:22.101151 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=25 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:51:24.177803 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=54 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:51:24.314459 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e3f55c-24e7-49e2-8307-903102e0762c None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:51:24.314962 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e3f55c-24e7-49e2-8307-903102e0762c None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:51:24.315070 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e3f55c-24e7-49e2-8307-903102e0762c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:51:24.334032 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-f5e3f55c-24e7-49e2-8307-903102e0762c None None] MFA Rules not processed for user `568d477011b84cc89b9285b5172d091f`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:51:24.335233 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-f5e3f55c-24e7-49e2-8307-903102e0762c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:51:24.342235 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1220/2432] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:51:24 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:51:24.639650 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dbdd33-11ce-4a66-8c70-7e10b36b4a98 service cinder] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:51:24.649270 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dbdd33-11ce-4a66-8c70-7e10b36b4a98 service cinder] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:51:24.652810 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05727464-9f3a-47da-852c-c5899f52c2dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '874348b647194ac2b5ecbf12c33bf59e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:51:24.653402 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05727464-9f3a-47da-852c-c5899f52c2dc service neutron] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:51:24.653682 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05727464-9f3a-47da-852c-c5899f52c2dc service neutron] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:51:24.653973 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05727464-9f3a-47da-852c-c5899f52c2dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:51:24.655641 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-05727464-9f3a-47da-852c-c5899f52c2dc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:51:24.665535 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05727464-9f3a-47da-852c-c5899f52c2dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:51:24.666986 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05727464-9f3a-47da-852c-c5899f52c2dc service neutron] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:51:24.674812 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1213/2433] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 24 05:51:24 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:51:24.988343 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e3f55c-24e7-49e2-8307-903102e0762c None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:51:24.989960 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-f5e3f55c-24e7-49e2-8307-903102e0762c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:51:25.004693 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e3f55c-24e7-49e2-8307-903102e0762c None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:51:25.010382 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df3271f-37d8-406b-8f8d-06d4c2aecc19 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '995ebe690b7748c9842bc0696415fc52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:51:25.010987 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df3271f-37d8-406b-8f8d-06d4c2aecc19 service placement] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:51:25.011264 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df3271f-37d8-406b-8f8d-06d4c2aecc19 service placement] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:51:25.011533 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df3271f-37d8-406b-8f8d-06d4c2aecc19 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:51:25.013223 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-5df3271f-37d8-406b-8f8d-06d4c2aecc19 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:51:25.025678 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df3271f-37d8-406b-8f8d-06d4c2aecc19 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:51:25.027312 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df3271f-37d8-406b-8f8d-06d4c2aecc19 service placement] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:51:25.043575 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1221/2434] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 24 05:51:24 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:51:26.932501 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05727464-9f3a-47da-852c-c5899f52c2dc service neutron] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:51:26.941606 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05727464-9f3a-47da-852c-c5899f52c2dc service neutron] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:51:26.946518 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1502e1bf-2b28-4ccf-bc7b-22a45ee64dd5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '874348b647194ac2b5ecbf12c33bf59e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:51:26.947423 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1502e1bf-2b28-4ccf-bc7b-22a45ee64dd5 service neutron] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:51:26.947802 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1502e1bf-2b28-4ccf-bc7b-22a45ee64dd5 service neutron] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:51:26.948177 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1502e1bf-2b28-4ccf-bc7b-22a45ee64dd5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:51:26.950083 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-1502e1bf-2b28-4ccf-bc7b-22a45ee64dd5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:51:26.960694 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1502e1bf-2b28-4ccf-bc7b-22a45ee64dd5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:51:26.962177 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1502e1bf-2b28-4ccf-bc7b-22a45ee64dd5 service neutron] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:51:26.971020 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1214/2435] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 24 05:51:26 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:51:35.038894 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=9 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:51:36.967145 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=12 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:51:37.223872 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df3271f-37d8-406b-8f8d-06d4c2aecc19 service placement] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:51:37.226133 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-5df3271f-37d8-406b-8f8d-06d4c2aecc19 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:51:37.242163 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df3271f-37d8-406b-8f8d-06d4c2aecc19 service placement] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:51:37.248393 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bb1a93-112f-44ae-84ed-32a494822ea2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b633e1aec6c4269bce13aa9c89e911a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:51:37.249119 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bb1a93-112f-44ae-84ed-32a494822ea2 service nova] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:51:37.249509 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bb1a93-112f-44ae-84ed-32a494822ea2 service nova] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:51:37.249879 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bb1a93-112f-44ae-84ed-32a494822ea2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:51:37.251799 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-f8bb1a93-112f-44ae-84ed-32a494822ea2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:51:37.265118 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bb1a93-112f-44ae-84ed-32a494822ea2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:51:37.267212 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bb1a93-112f-44ae-84ed-32a494822ea2 service nova] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:51:37.280161 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1222/2436] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 24 05:51:37 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:51:47.274391 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=6 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:52:24.404980 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1502e1bf-2b28-4ccf-bc7b-22a45ee64dd5 service neutron] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:52:24.414238 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1502e1bf-2b28-4ccf-bc7b-22a45ee64dd5 service neutron] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:52:24.417778 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df681e2-d206-422b-ad15-315e1dbd3503 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17b450afe795495680fc70f522c83750', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:52:24.418420 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df681e2-d206-422b-ad15-315e1dbd3503 service cinder] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:52:24.418702 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df681e2-d206-422b-ad15-315e1dbd3503 service cinder] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:52:24.418985 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df681e2-d206-422b-ad15-315e1dbd3503 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:52:24.420708 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-5df681e2-d206-422b-ad15-315e1dbd3503 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:52:24.431865 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df681e2-d206-422b-ad15-315e1dbd3503 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:52:24.433274 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df681e2-d206-422b-ad15-315e1dbd3503 service cinder] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:52:24.442037 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1215/2437] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 24 05:52:24 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:52:34.438157 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=6 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:52:45.652814 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bb1a93-112f-44ae-84ed-32a494822ea2 service nova] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:52:45.662584 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bb1a93-112f-44ae-84ed-32a494822ea2 service nova] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:52:45.666677 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851a7031-91f7-4288-a144-798aedc8b0c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '874348b647194ac2b5ecbf12c33bf59e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:52:45.667268 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851a7031-91f7-4288-a144-798aedc8b0c3 service neutron] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:52:45.667543 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851a7031-91f7-4288-a144-798aedc8b0c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:52:45.667811 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851a7031-91f7-4288-a144-798aedc8b0c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:52:45.669530 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-851a7031-91f7-4288-a144-798aedc8b0c3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:52:45.732536 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851a7031-91f7-4288-a144-798aedc8b0c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:52:45.733995 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851a7031-91f7-4288-a144-798aedc8b0c3 service neutron] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:52:45.744132 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1223/2438] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 24 05:52:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:52:48.976124 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df681e2-d206-422b-ad15-315e1dbd3503 service cinder] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:52:48.995826 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df681e2-d206-422b-ad15-315e1dbd3503 service cinder] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:52:49.003020 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bc793d-0e3e-4cb9-9720-97127ff20294 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '995ebe690b7748c9842bc0696415fc52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:52:49.005396 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bc793d-0e3e-4cb9-9720-97127ff20294 service placement] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:52:49.005396 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bc793d-0e3e-4cb9-9720-97127ff20294 service placement] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:52:49.005396 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bc793d-0e3e-4cb9-9720-97127ff20294 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:52:49.008158 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-67bc793d-0e3e-4cb9-9720-97127ff20294 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:52:49.034834 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bc793d-0e3e-4cb9-9720-97127ff20294 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:52:49.036457 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bc793d-0e3e-4cb9-9720-97127ff20294 service placement] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:52:49.058820 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1216/2439] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 24 05:52:48 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:52:49.070414 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851a7031-91f7-4288-a144-798aedc8b0c3 service neutron] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:52:49.073071 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-851a7031-91f7-4288-a144-798aedc8b0c3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:52:49.089348 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851a7031-91f7-4288-a144-798aedc8b0c3 service neutron] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:52:49.096315 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8f5920-157a-4992-86bf-0ee11272681e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:52:49.096906 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8f5920-157a-4992-86bf-0ee11272681e admin admin] REQUEST_METHOD: `DELETE` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:52:49.097186 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8f5920-157a-4992-86bf-0ee11272681e admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:52:49.097453 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8f5920-157a-4992-86bf-0ee11272681e admin admin] PATH_INFO: `/v3/users/d2bf5c5fc7a44e9ebcbd48aa4c9ba549` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:52:49.099105 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8f5920-157a-4992-86bf-0ee11272681e admin admin] RBAC: Authorizing `identity:delete_user(user_id=d2bf5c5fc7a44e9ebcbd48aa4c9ba549)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:52:49.101256 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8f5920-157a-4992-86bf-0ee11272681e admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:52:49.187872 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-0a8f5920-157a-4992-86bf-0ee11272681e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd2bf5c5fc7a44e9ebcbd48aa4c9ba549'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:52:49.195647 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-0a8f5920-157a-4992-86bf-0ee11272681e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd2bf5c5fc7a44e9ebcbd48aa4c9ba549'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:52:49.196998 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-0a8f5920-157a-4992-86bf-0ee11272681e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd2bf5c5fc7a44e9ebcbd48aa4c9ba549'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:52:49.210857 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-0a8f5920-157a-4992-86bf-0ee11272681e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd2bf5c5fc7a44e9ebcbd48aa4c9ba549'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:52:49.221662 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-0a8f5920-157a-4992-86bf-0ee11272681e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd2bf5c5fc7a44e9ebcbd48aa4c9ba549'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:52:49.228624 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1224/2440] 10.222.0.26 () {58 vars in 1224 bytes} [Wed Aug 24 05:52:49 2022] DELETE /identity/v3/users/d2bf5c5fc7a44e9ebcbd48aa4c9ba549 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:52:49.426362 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bc793d-0e3e-4cb9-9720-97127ff20294 service placement] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:52:49.439305 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bc793d-0e3e-4cb9-9720-97127ff20294 service placement] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:52:49.509590 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6e36ca-45dd-4e6e-aea6-ab0a00a8bd11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:52:49.510266 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6e36ca-45dd-4e6e-aea6-ab0a00a8bd11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:52:49.510544 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6e36ca-45dd-4e6e-aea6-ab0a00a8bd11 admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:52:49.510814 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6e36ca-45dd-4e6e-aea6-ab0a00a8bd11 admin admin] PATH_INFO: `/v3/projects/f6dc9d99a1d54abeb3cc09d985bd2768` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:52:49.511928 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6e36ca-45dd-4e6e-aea6-ab0a00a8bd11 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f6dc9d99a1d54abeb3cc09d985bd2768)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:52:49.513823 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6e36ca-45dd-4e6e-aea6-ab0a00a8bd11 admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:52:49.562032 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-ba6e36ca-45dd-4e6e-aea6-ab0a00a8bd11 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f6dc9d99a1d54abeb3cc09d985bd2768', 'request_id': 'req-ba6e36ca-45dd-4e6e-aea6-ab0a00a8bd11'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:52:49.569799 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-ba6e36ca-45dd-4e6e-aea6-ab0a00a8bd11 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f6dc9d99a1d54abeb3cc09d985bd2768', 'request_id': 'req-ba6e36ca-45dd-4e6e-aea6-ab0a00a8bd11'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:52:49.576422 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-ba6e36ca-45dd-4e6e-aea6-ab0a00a8bd11 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f6dc9d99a1d54abeb3cc09d985bd2768', 'request_id': 'req-ba6e36ca-45dd-4e6e-aea6-ab0a00a8bd11'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:52:49.587052 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-ba6e36ca-45dd-4e6e-aea6-ab0a00a8bd11 admin admin] The token cache is being invalidate because project f6dc9d99a1d54abeb3cc09d985bd2768 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88112) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:52:49.587276 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-ba6e36ca-45dd-4e6e-aea6-ab0a00a8bd11 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:52:49.587913 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-ba6e36ca-45dd-4e6e-aea6-ab0a00a8bd11 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:52:49.589594 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1217/2441] 10.222.0.26 () {58 vars in 1233 bytes} [Wed Aug 24 05:52:49 2022] DELETE /identity/v3/projects/f6dc9d99a1d54abeb3cc09d985bd2768 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:52:49.594431 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01905d89-49cc-4c2d-b126-ed4203476991 None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:52:49.594724 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01905d89-49cc-4c2d-b126-ed4203476991 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:52:49.595002 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01905d89-49cc-4c2d-b126-ed4203476991 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:52:49.614815 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-01905d89-49cc-4c2d-b126-ed4203476991 None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:52:49.616018 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-01905d89-49cc-4c2d-b126-ed4203476991 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:52:49.684884 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1225/2442] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:52:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:52:49.692932 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c27f40-4f8d-4c94-b26d-c1cda97a9b63 None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:52:49.693261 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c27f40-4f8d-4c94-b26d-c1cda97a9b63 None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:52:49.693665 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c27f40-4f8d-4c94-b26d-c1cda97a9b63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:52:49.714474 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-f7c27f40-4f8d-4c94-b26d-c1cda97a9b63 None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:52:49.715690 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-f7c27f40-4f8d-4c94-b26d-c1cda97a9b63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:52:49.724015 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1218/2443] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:52:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 05:52:49.728787 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01905d89-49cc-4c2d-b126-ed4203476991 None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:52:49.738449 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01905d89-49cc-4c2d-b126-ed4203476991 None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:52:49.743628 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065d5dfe-480c-4189-9cb7-e4404855c110 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:52:49.744226 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065d5dfe-480c-4189-9cb7-e4404855c110 admin admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:52:49.744504 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065d5dfe-480c-4189-9cb7-e4404855c110 admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:52:49.744774 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065d5dfe-480c-4189-9cb7-e4404855c110 admin admin] PATH_INFO: `/v3/domains` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:52:49.745427 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065d5dfe-480c-4189-9cb7-e4404855c110 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:52:49.745724 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065d5dfe-480c-4189-9cb7-e4404855c110 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:52:49.747358 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065d5dfe-480c-4189-9cb7-e4404855c110 admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:52:49.748871 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:52:49.760523 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1226/2444] 10.222.0.26 () {58 vars in 1153 bytes} [Wed Aug 24 05:52:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:52:49.764961 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c27f40-4f8d-4c94-b26d-c1cda97a9b63 None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:52:49.774709 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c27f40-4f8d-4c94-b26d-c1cda97a9b63 None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:52:49.779651 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58485090-4da8-4709-af92-aa5d31cef74e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:52:49.780247 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58485090-4da8-4709-af92-aa5d31cef74e admin admin] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:52:49.780500 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58485090-4da8-4709-af92-aa5d31cef74e admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:52:49.780768 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58485090-4da8-4709-af92-aa5d31cef74e admin admin] PATH_INFO: `/v3/projects` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:52:49.781394 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58485090-4da8-4709-af92-aa5d31cef74e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:52:49.783591 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58485090-4da8-4709-af92-aa5d31cef74e admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:52:49.812394 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1219/2445] 10.222.0.26 () {60 vars in 1153 bytes} [Wed Aug 24 05:52:49 2022] POST /identity/v3/projects => generated 377 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:52:49.816788 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065d5dfe-480c-4189-9cb7-e4404855c110 admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:52:49.827786 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065d5dfe-480c-4189-9cb7-e4404855c110 admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:52:49.893759 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a818db-6352-4a86-8f3e-cac24ee5556a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:52:49.894709 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a818db-6352-4a86-8f3e-cac24ee5556a admin admin] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:52:49.894709 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a818db-6352-4a86-8f3e-cac24ee5556a admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:52:49.894957 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a818db-6352-4a86-8f3e-cac24ee5556a admin admin] PATH_INFO: `/v3/users` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:52:49.895575 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a818db-6352-4a86-8f3e-cac24ee5556a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:52:49.897429 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a818db-6352-4a86-8f3e-cac24ee5556a admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:52:49.923361 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1227/2446] 10.222.0.26 () {60 vars in 1144 bytes} [Wed Aug 24 05:52:49 2022] POST /identity/v3/users => generated 289 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 05:52:49.924647 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58485090-4da8-4709-af92-aa5d31cef74e admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:52:49.936152 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58485090-4da8-4709-af92-aa5d31cef74e admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:52:49.940887 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac99d2c-96df-43ec-9e90-7033ea170f93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:52:49.941524 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac99d2c-96df-43ec-9e90-7033ea170f93 admin admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:52:49.941801 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac99d2c-96df-43ec-9e90-7033ea170f93 admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:52:49.942108 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac99d2c-96df-43ec-9e90-7033ea170f93 admin admin] PATH_INFO: `/v3/roles` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:52:49.942821 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac99d2c-96df-43ec-9e90-7033ea170f93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:52:49.944690 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac99d2c-96df-43ec-9e90-7033ea170f93 admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:52:49.954678 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1220/2447] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Aug 24 05:52:49 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:52:49.958864 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a818db-6352-4a86-8f3e-cac24ee5556a admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:52:49.969591 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a818db-6352-4a86-8f3e-cac24ee5556a admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:52:49.974215 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a2d8fa-6afa-4ee8-b391-7a976960b8c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:52:49.974877 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a2d8fa-6afa-4ee8-b391-7a976960b8c9 admin admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:52:49.975162 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a2d8fa-6afa-4ee8-b391-7a976960b8c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:52:49.975439 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a2d8fa-6afa-4ee8-b391-7a976960b8c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:52:49.976078 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a2d8fa-6afa-4ee8-b391-7a976960b8c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:52:49.978274 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a2d8fa-6afa-4ee8-b391-7a976960b8c9 admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:52:49.988910 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1228/2448] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Aug 24 05:52:49 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 05:52:49.993266 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac99d2c-96df-43ec-9e90-7033ea170f93 admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:52:50.003424 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac99d2c-96df-43ec-9e90-7033ea170f93 admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:52:50.008554 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fa013b-d8fd-4f35-ad0d-dc6bf50c1b0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:52:50.009261 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fa013b-d8fd-4f35-ad0d-dc6bf50c1b0d admin admin] REQUEST_METHOD: `PUT` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:52:50.009703 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fa013b-d8fd-4f35-ad0d-dc6bf50c1b0d admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:52:50.009997 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fa013b-d8fd-4f35-ad0d-dc6bf50c1b0d admin admin] PATH_INFO: `/v3/projects/20a001c4775b42c2b4d8ec5598f942b2/users/810acc57487f4db2b8b1d3d40f4d28d5/roles/f7aa4a2c74c94c1b9ca8ecdcccccda5c` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:52:50.026129 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fa013b-d8fd-4f35-ad0d-dc6bf50c1b0d admin admin] RBAC: Authorizing `identity:create_grant(project_id=20a001c4775b42c2b4d8ec5598f942b2, user_id=810acc57487f4db2b8b1d3d40f4d28d5, role_id=f7aa4a2c74c94c1b9ca8ecdcccccda5c)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:52:50.028769 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fa013b-d8fd-4f35-ad0d-dc6bf50c1b0d admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:52:50.043015 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1221/2449] 10.222.0.26 () {60 vars in 1483 bytes} [Wed Aug 24 05:52:49 2022] PUT /identity/v3/projects/20a001c4775b42c2b4d8ec5598f942b2/users/810acc57487f4db2b8b1d3d40f4d28d5/roles/f7aa4a2c74c94c1b9ca8ecdcccccda5c => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:52:50.047741 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a813ea-cbd6-4a55-a733-6755c4786011 None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:52:50.048024 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a813ea-cbd6-4a55-a733-6755c4786011 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:52:50.048292 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a813ea-cbd6-4a55-a733-6755c4786011 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:52:50.067658 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-f3a813ea-cbd6-4a55-a733-6755c4786011 None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:52:50.069004 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-f3a813ea-cbd6-4a55-a733-6755c4786011 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:52:50.130588 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1229/2450] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:52:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:52:50.140111 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fa013b-d8fd-4f35-ad0d-dc6bf50c1b0d admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:52:50.141872 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-92fa013b-d8fd-4f35-ad0d-dc6bf50c1b0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:52:50.158176 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:52:50.204366 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fa013b-d8fd-4f35-ad0d-dc6bf50c1b0d admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:52:50.208093 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef553b9a-52a3-42f2-8f79-ac3e5c0561cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '874348b647194ac2b5ecbf12c33bf59e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:52:50.208708 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef553b9a-52a3-42f2-8f79-ac3e5c0561cc service neutron] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:52:50.208988 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef553b9a-52a3-42f2-8f79-ac3e5c0561cc service neutron] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:52:50.209253 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef553b9a-52a3-42f2-8f79-ac3e5c0561cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:52:50.218884 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef553b9a-52a3-42f2-8f79-ac3e5c0561cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:52:50.220318 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef553b9a-52a3-42f2-8f79-ac3e5c0561cc service neutron] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:52:50.229721 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1222/2451] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 24 05:52:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:52:50.797656 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3d1caa-cf2a-420d-a2d6-dcbd73aeae61 None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:52:50.798504 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3d1caa-cf2a-420d-a2d6-dcbd73aeae61 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:52:50.798862 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3d1caa-cf2a-420d-a2d6-dcbd73aeae61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:52:50.819749 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-3a3d1caa-cf2a-420d-a2d6-dcbd73aeae61 None None] MFA Rules not processed for user `7ea384c1544c424eb2b524760e1d6d22`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:52:50.821761 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-3a3d1caa-cf2a-420d-a2d6-dcbd73aeae61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:52:50.890357 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1230/2452] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:52:50 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:52:51.485538 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef553b9a-52a3-42f2-8f79-ac3e5c0561cc service neutron] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:52:51.487671 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-ef553b9a-52a3-42f2-8f79-ac3e5c0561cc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:52:51.499454 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef553b9a-52a3-42f2-8f79-ac3e5c0561cc service neutron] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:52:51.504358 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928144ef-43a8-4dec-a059-2e300bc1cb9c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '874348b647194ac2b5ecbf12c33bf59e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:52:51.505243 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928144ef-43a8-4dec-a059-2e300bc1cb9c service neutron] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:52:51.505737 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928144ef-43a8-4dec-a059-2e300bc1cb9c service neutron] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:52:51.506261 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928144ef-43a8-4dec-a059-2e300bc1cb9c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:52:51.508636 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-928144ef-43a8-4dec-a059-2e300bc1cb9c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:52:51.530280 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928144ef-43a8-4dec-a059-2e300bc1cb9c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:52:51.532213 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928144ef-43a8-4dec-a059-2e300bc1cb9c service neutron] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:52:51.542935 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1223/2453] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 24 05:52:51 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 05:52:54.883929 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f8a9bd-575d-4541-b9a0-56847d46ff06 None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:52:54.884447 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f8a9bd-575d-4541-b9a0-56847d46ff06 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:52:54.884794 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f8a9bd-575d-4541-b9a0-56847d46ff06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:52:54.948358 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-c6f8a9bd-575d-4541-b9a0-56847d46ff06 None None] MFA Rules not processed for user `810acc57487f4db2b8b1d3d40f4d28d5`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:52:54.949812 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-c6f8a9bd-575d-4541-b9a0-56847d46ff06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:52:54.955173 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:52:55.042726 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1231/2454] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:52:54 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:52:55.057714 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928144ef-43a8-4dec-a059-2e300bc1cb9c service neutron] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:52:55.059272 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-928144ef-43a8-4dec-a059-2e300bc1cb9c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:52:55.202576 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928144ef-43a8-4dec-a059-2e300bc1cb9c service neutron] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:52:55.210247 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50fc3c7-c3c7-4010-9c03-9e20ccc6a4b1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b633e1aec6c4269bce13aa9c89e911a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:52:55.210891 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50fc3c7-c3c7-4010-9c03-9e20ccc6a4b1 service nova] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:52:55.211717 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50fc3c7-c3c7-4010-9c03-9e20ccc6a4b1 service nova] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:52:55.211994 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50fc3c7-c3c7-4010-9c03-9e20ccc6a4b1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:52:55.221002 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50fc3c7-c3c7-4010-9c03-9e20ccc6a4b1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:52:55.222773 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50fc3c7-c3c7-4010-9c03-9e20ccc6a4b1 service nova] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:52:55.233340 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1224/2455] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 24 05:52:55 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:52:56.681204 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bca6f8-0f52-48c1-bdc3-a475b095b8e7 None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:52:56.681698 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bca6f8-0f52-48c1-bdc3-a475b095b8e7 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:52:56.681803 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bca6f8-0f52-48c1-bdc3-a475b095b8e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:52:56.701915 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-88bca6f8-0f52-48c1-bdc3-a475b095b8e7 None None] MFA Rules not processed for user `810acc57487f4db2b8b1d3d40f4d28d5`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:52:56.703218 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-88bca6f8-0f52-48c1-bdc3-a475b095b8e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:52:56.710738 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1232/2456] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:52:56 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:52:57.777333 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50fc3c7-c3c7-4010-9c03-9e20ccc6a4b1 service nova] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:52:57.789135 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50fc3c7-c3c7-4010-9c03-9e20ccc6a4b1 service nova] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:52:57.807928 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2d72e3-fc9a-4154-a051-6ed39359ad91 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b633e1aec6c4269bce13aa9c89e911a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:52:57.808825 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2d72e3-fc9a-4154-a051-6ed39359ad91 service nova] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:52:57.809655 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2d72e3-fc9a-4154-a051-6ed39359ad91 service nova] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:52:57.811275 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2d72e3-fc9a-4154-a051-6ed39359ad91 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:52:57.817716 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-5a2d72e3-fc9a-4154-a051-6ed39359ad91 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:52:57.838825 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2d72e3-fc9a-4154-a051-6ed39359ad91 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:52:57.846035 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2d72e3-fc9a-4154-a051-6ed39359ad91 service nova] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:52:57.863401 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1225/2457] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 24 05:52:57 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 05:53:01.619403 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bca6f8-0f52-48c1-bdc3-a475b095b8e7 None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:01.621282 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-88bca6f8-0f52-48c1-bdc3-a475b095b8e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:53:01.638315 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bca6f8-0f52-48c1-bdc3-a475b095b8e7 None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:01.644440 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a508082e-75af-4d05-8a88-ba3e3456ceb6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b633e1aec6c4269bce13aa9c89e911a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:01.645068 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a508082e-75af-4d05-8a88-ba3e3456ceb6 service nova] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:01.645347 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a508082e-75af-4d05-8a88-ba3e3456ceb6 service nova] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:01.645618 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a508082e-75af-4d05-8a88-ba3e3456ceb6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:01.647404 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-a508082e-75af-4d05-8a88-ba3e3456ceb6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:53:01.660554 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a508082e-75af-4d05-8a88-ba3e3456ceb6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:01.662198 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a508082e-75af-4d05-8a88-ba3e3456ceb6 service nova] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:01.676352 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1233/2458] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 24 05:53:01 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:53:06.969568 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a9443d-af82-4435-8740-f25406658189 None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:06.970502 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a9443d-af82-4435-8740-f25406658189 None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:06.971660 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a9443d-af82-4435-8740-f25406658189 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:06.995232 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-e3a9443d-af82-4435-8740-f25406658189 None None] MFA Rules not processed for user `6c2c08b27a0f4943b5da908eb7b1cd96`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:53:06.996562 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-e3a9443d-af82-4435-8740-f25406658189 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:53:07.074679 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1226/2459] 10.222.0.26 () {58 vars in 967 bytes} [Wed Aug 24 05:53:06 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:53:07.130430 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a508082e-75af-4d05-8a88-ba3e3456ceb6 service nova] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:07.132510 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-a508082e-75af-4d05-8a88-ba3e3456ceb6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:53:07.206383 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a508082e-75af-4d05-8a88-ba3e3456ceb6 service nova] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:07.217361 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92528e6b-669b-4f39-add5-45be6b7157f8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87ff96222a7c4baea31fc1bebf4d89a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:07.218011 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92528e6b-669b-4f39-add5-45be6b7157f8 service swift] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:07.218298 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92528e6b-669b-4f39-add5-45be6b7157f8 service swift] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:07.218575 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92528e6b-669b-4f39-add5-45be6b7157f8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:07.228234 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92528e6b-669b-4f39-add5-45be6b7157f8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:07.229837 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92528e6b-669b-4f39-add5-45be6b7157f8 service swift] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:07.238220 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1234/2460] 10.222.0.26 () {60 vars in 1384 bytes} [Wed Aug 24 05:53:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 05:53:10.926812 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a9443d-af82-4435-8740-f25406658189 None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:10.928294 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-e3a9443d-af82-4435-8740-f25406658189 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:53:10.954059 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:53:11.025807 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a9443d-af82-4435-8740-f25406658189 None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:11.037451 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae3b4e7-2375-44f9-a5ad-d4cd85607b5f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '995ebe690b7748c9842bc0696415fc52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:11.038054 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae3b4e7-2375-44f9-a5ad-d4cd85607b5f service placement] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:11.038342 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae3b4e7-2375-44f9-a5ad-d4cd85607b5f service placement] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:11.039209 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae3b4e7-2375-44f9-a5ad-d4cd85607b5f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:11.041270 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-aae3b4e7-2375-44f9-a5ad-d4cd85607b5f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:53:11.056911 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae3b4e7-2375-44f9-a5ad-d4cd85607b5f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:11.058584 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae3b4e7-2375-44f9-a5ad-d4cd85607b5f service placement] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:11.077258 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1227/2461] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 24 05:53:10 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:53:15.263779 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92528e6b-669b-4f39-add5-45be6b7157f8 service swift] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:15.265189 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-92528e6b-669b-4f39-add5-45be6b7157f8 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:53:15.279229 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92528e6b-669b-4f39-add5-45be6b7157f8 service swift] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:15.288106 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b32e9e-6027-485e-b410-ecdffdb0a058 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:15.289174 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b32e9e-6027-485e-b410-ecdffdb0a058 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:15.289457 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b32e9e-6027-485e-b410-ecdffdb0a058 admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:15.289756 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b32e9e-6027-485e-b410-ecdffdb0a058 admin admin] PATH_INFO: `/v3/users/58d3b2fe99094a3bab136843fb8f8150` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:15.290940 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b32e9e-6027-485e-b410-ecdffdb0a058 admin admin] RBAC: Authorizing `identity:delete_user(user_id=58d3b2fe99094a3bab136843fb8f8150)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:15.292903 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b32e9e-6027-485e-b410-ecdffdb0a058 admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:15.340972 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-45b32e9e-6027-485e-b410-ecdffdb0a058 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '58d3b2fe99094a3bab136843fb8f8150'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:15.348310 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-45b32e9e-6027-485e-b410-ecdffdb0a058 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '58d3b2fe99094a3bab136843fb8f8150'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:15.349003 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-45b32e9e-6027-485e-b410-ecdffdb0a058 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '58d3b2fe99094a3bab136843fb8f8150'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:15.360228 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:53:15.361507 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-45b32e9e-6027-485e-b410-ecdffdb0a058 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '58d3b2fe99094a3bab136843fb8f8150'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:15.370495 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-45b32e9e-6027-485e-b410-ecdffdb0a058 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '58d3b2fe99094a3bab136843fb8f8150'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:15.376946 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1235/2462] 10.222.0.26 () {58 vars in 1224 bytes} [Wed Aug 24 05:53:15 2022] DELETE /identity/v3/users/58d3b2fe99094a3bab136843fb8f8150 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:53:15.564290 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae3b4e7-2375-44f9-a5ad-d4cd85607b5f service placement] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:15.578258 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae3b4e7-2375-44f9-a5ad-d4cd85607b5f service placement] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:15.643170 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2189b81-5834-4c3c-8f18-b848e319c1c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:15.643834 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2189b81-5834-4c3c-8f18-b848e319c1c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:15.644103 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2189b81-5834-4c3c-8f18-b848e319c1c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:15.644373 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2189b81-5834-4c3c-8f18-b848e319c1c5 admin admin] PATH_INFO: `/v3/projects/eafab246291a4e949728e4ad0fe979af` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:15.645505 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2189b81-5834-4c3c-8f18-b848e319c1c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eafab246291a4e949728e4ad0fe979af)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:15.647455 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2189b81-5834-4c3c-8f18-b848e319c1c5 admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:15.702476 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-f2189b81-5834-4c3c-8f18-b848e319c1c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eafab246291a4e949728e4ad0fe979af', 'request_id': 'req-f2189b81-5834-4c3c-8f18-b848e319c1c5'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:15.711420 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-f2189b81-5834-4c3c-8f18-b848e319c1c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eafab246291a4e949728e4ad0fe979af', 'request_id': 'req-f2189b81-5834-4c3c-8f18-b848e319c1c5'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:15.718064 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-f2189b81-5834-4c3c-8f18-b848e319c1c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eafab246291a4e949728e4ad0fe979af', 'request_id': 'req-f2189b81-5834-4c3c-8f18-b848e319c1c5'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:15.735244 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-f2189b81-5834-4c3c-8f18-b848e319c1c5 admin admin] The token cache is being invalidate because project eafab246291a4e949728e4ad0fe979af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88112) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:53:15.735943 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-f2189b81-5834-4c3c-8f18-b848e319c1c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:15.736679 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-f2189b81-5834-4c3c-8f18-b848e319c1c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:15.739266 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1228/2463] 10.222.0.26 () {58 vars in 1233 bytes} [Wed Aug 24 05:53:15 2022] DELETE /identity/v3/projects/eafab246291a4e949728e4ad0fe979af => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:53:15.743531 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b32e9e-6027-485e-b410-ecdffdb0a058 admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:15.745134 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-45b32e9e-6027-485e-b410-ecdffdb0a058 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:53:15.758383 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b32e9e-6027-485e-b410-ecdffdb0a058 admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:15.826758 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be9e24f-8024-41c2-aed8-2e8af72d365f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:15.827407 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be9e24f-8024-41c2-aed8-2e8af72d365f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:15.827684 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be9e24f-8024-41c2-aed8-2e8af72d365f admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:15.827953 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be9e24f-8024-41c2-aed8-2e8af72d365f admin admin] PATH_INFO: `/v3/users/0007e95465594878947ad95619686a26` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:15.829090 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be9e24f-8024-41c2-aed8-2e8af72d365f admin admin] RBAC: Authorizing `identity:delete_user(user_id=0007e95465594878947ad95619686a26)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:15.831096 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be9e24f-8024-41c2-aed8-2e8af72d365f admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:15.893047 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-2be9e24f-8024-41c2-aed8-2e8af72d365f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0007e95465594878947ad95619686a26'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:15.901395 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-2be9e24f-8024-41c2-aed8-2e8af72d365f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0007e95465594878947ad95619686a26'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:15.902230 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-2be9e24f-8024-41c2-aed8-2e8af72d365f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0007e95465594878947ad95619686a26'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:15.919447 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-2be9e24f-8024-41c2-aed8-2e8af72d365f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0007e95465594878947ad95619686a26'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:15.930449 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-2be9e24f-8024-41c2-aed8-2e8af72d365f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0007e95465594878947ad95619686a26'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:15.937909 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1236/2464] 10.222.0.26 () {58 vars in 1224 bytes} [Wed Aug 24 05:53:15 2022] DELETE /identity/v3/users/0007e95465594878947ad95619686a26 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:53:16.183711 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2189b81-5834-4c3c-8f18-b848e319c1c5 admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:16.185172 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-f2189b81-5834-4c3c-8f18-b848e319c1c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:53:16.201649 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2189b81-5834-4c3c-8f18-b848e319c1c5 admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:16.253283 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:53:16.273835 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d58814-28bc-4ef1-9ff9-0856a304deea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:16.274948 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d58814-28bc-4ef1-9ff9-0856a304deea admin admin] REQUEST_METHOD: `DELETE` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:16.275204 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d58814-28bc-4ef1-9ff9-0856a304deea admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:16.275592 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d58814-28bc-4ef1-9ff9-0856a304deea admin admin] PATH_INFO: `/v3/projects/2d96cc7881964ee8b167581f6a6699d4` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:16.276844 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d58814-28bc-4ef1-9ff9-0856a304deea admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d96cc7881964ee8b167581f6a6699d4)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:16.279242 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d58814-28bc-4ef1-9ff9-0856a304deea admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:16.327897 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-14d58814-28bc-4ef1-9ff9-0856a304deea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d96cc7881964ee8b167581f6a6699d4', 'request_id': 'req-14d58814-28bc-4ef1-9ff9-0856a304deea'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:16.336118 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-14d58814-28bc-4ef1-9ff9-0856a304deea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d96cc7881964ee8b167581f6a6699d4', 'request_id': 'req-14d58814-28bc-4ef1-9ff9-0856a304deea'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:16.342587 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-14d58814-28bc-4ef1-9ff9-0856a304deea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d96cc7881964ee8b167581f6a6699d4', 'request_id': 'req-14d58814-28bc-4ef1-9ff9-0856a304deea'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:16.354131 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-14d58814-28bc-4ef1-9ff9-0856a304deea admin admin] The token cache is being invalidate because project 2d96cc7881964ee8b167581f6a6699d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88112) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:53:16.354997 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-14d58814-28bc-4ef1-9ff9-0856a304deea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:16.355687 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-14d58814-28bc-4ef1-9ff9-0856a304deea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:53:16.357385 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1229/2465] 10.222.0.26 () {58 vars in 1233 bytes} [Wed Aug 24 05:53:16 2022] DELETE /identity/v3/projects/2d96cc7881964ee8b167581f6a6699d4 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:53:25.934132 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=56,keystone:INSERT=2,keystone:DELETE=11 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:53:26.282128 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c712d99-c7a7-4e7d-9384-694691c1104d None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:26.282416 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c712d99-c7a7-4e7d-9384-694691c1104d None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:26.282694 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c712d99-c7a7-4e7d-9384-694691c1104d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:26.301929 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-5c712d99-c7a7-4e7d-9384-694691c1104d None None] MFA Rules not processed for user `6c2c08b27a0f4943b5da908eb7b1cd96`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:53:26.303171 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-5c712d99-c7a7-4e7d-9384-694691c1104d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:53:26.350282 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=33,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:53:26.359193 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1237/2466] 10.222.0.26 () {58 vars in 1009 bytes} [Wed Aug 24 05:53:26 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:53:26.370776 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d58814-28bc-4ef1-9ff9-0856a304deea admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:26.372153 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-14d58814-28bc-4ef1-9ff9-0856a304deea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:53:26.441548 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d58814-28bc-4ef1-9ff9-0856a304deea admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:26.447346 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc51d8ce-9920-40f9-846a-00820bf7d725 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87ff96222a7c4baea31fc1bebf4d89a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:26.447938 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc51d8ce-9920-40f9-846a-00820bf7d725 service swift] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:26.448215 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc51d8ce-9920-40f9-846a-00820bf7d725 service swift] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:26.448484 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc51d8ce-9920-40f9-846a-00820bf7d725 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:26.456316 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc51d8ce-9920-40f9-846a-00820bf7d725 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:26.457877 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc51d8ce-9920-40f9-846a-00820bf7d725 service swift] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:26.466562 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1230/2467] 10.222.0.26 () {60 vars in 1384 bytes} [Wed Aug 24 05:53:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 24 05:53:36.351513 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=25 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:53:36.463388 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=32 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:53:41.209556 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e8e877-bcbd-445b-9fd7-08c47835d4f1 None None] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:41.210167 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e8e877-bcbd-445b-9fd7-08c47835d4f1 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:41.210167 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e8e877-bcbd-445b-9fd7-08c47835d4f1 None None] PATH_INFO: `/` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:41.211686 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1238/2468] 10.222.0.26 () {54 vars in 921 bytes} [Wed Aug 24 05:53:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:53:41.217697 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfa94da-81d4-41a6-b4fc-6f0a5c39d689 None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:41.218190 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfa94da-81d4-41a6-b4fc-6f0a5c39d689 None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:41.218303 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfa94da-81d4-41a6-b4fc-6f0a5c39d689 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:41.238321 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-3cfa94da-81d4-41a6-b4fc-6f0a5c39d689 None None] MFA Rules not processed for user `7b633e1aec6c4269bce13aa9c89e911a`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:53:41.239556 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-3cfa94da-81d4-41a6-b4fc-6f0a5c39d689 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:53:41.308633 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1231/2469] 10.222.0.26 () {58 vars in 1018 bytes} [Wed Aug 24 05:53:41 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:53:41.320852 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e8e877-bcbd-445b-9fd7-08c47835d4f1 None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:41.322634 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-28e8e877-bcbd-445b-9fd7-08c47835d4f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:53:41.381986 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e8e877-bcbd-445b-9fd7-08c47835d4f1 None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:41.385519 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2fcc6f-9c12-4952-957d-5c4db9c2ddf5 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f856958add7474a989325cea7b1b224', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:41.386154 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2fcc6f-9c12-4952-957d-5c4db9c2ddf5 service glance] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:41.386437 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2fcc6f-9c12-4952-957d-5c4db9c2ddf5 service glance] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:41.386708 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2fcc6f-9c12-4952-957d-5c4db9c2ddf5 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:41.397312 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2fcc6f-9c12-4952-957d-5c4db9c2ddf5 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:41.398771 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2fcc6f-9c12-4952-957d-5c4db9c2ddf5 service glance] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:41.409499 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1239/2470] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 24 05:53:41 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:53:41.479317 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b721492-dd8b-4f37-b705-22545bb4fc12 None None] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:41.479542 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b721492-dd8b-4f37-b705-22545bb4fc12 None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:41.479818 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b721492-dd8b-4f37-b705-22545bb4fc12 None None] PATH_INFO: `/` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:41.481169 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1232/2471] 10.222.0.26 () {54 vars in 921 bytes} [Wed Aug 24 05:53:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:53:41.485828 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9616251-e2bd-42a4-baa5-4f07a4119aa7 None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:41.486155 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9616251-e2bd-42a4-baa5-4f07a4119aa7 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:41.486433 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9616251-e2bd-42a4-baa5-4f07a4119aa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:41.506445 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-b9616251-e2bd-42a4-baa5-4f07a4119aa7 None None] MFA Rules not processed for user `874348b647194ac2b5ecbf12c33bf59e`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:53:41.507645 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-b9616251-e2bd-42a4-baa5-4f07a4119aa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:53:41.558499 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1240/2472] 10.222.0.26 () {58 vars in 1018 bytes} [Wed Aug 24 05:53:41 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:53:41.571156 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b721492-dd8b-4f37-b705-22545bb4fc12 None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:41.572861 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-1b721492-dd8b-4f37-b705-22545bb4fc12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:53:41.585757 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b721492-dd8b-4f37-b705-22545bb4fc12 None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:41.589473 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865c6c70-8539-4c68-8e3b-73211f899496 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '874348b647194ac2b5ecbf12c33bf59e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:41.590101 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865c6c70-8539-4c68-8e3b-73211f899496 service neutron] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:41.590378 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865c6c70-8539-4c68-8e3b-73211f899496 service neutron] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:41.590644 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865c6c70-8539-4c68-8e3b-73211f899496 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:41.597571 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865c6c70-8539-4c68-8e3b-73211f899496 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:41.599018 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865c6c70-8539-4c68-8e3b-73211f899496 service neutron] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:41.606738 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1233/2473] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 24 05:53:41 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:53:41.689009 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f797e9e9-1e53-4cb1-a1fd-bb305a43ef58 None None] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:41.689295 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f797e9e9-1e53-4cb1-a1fd-bb305a43ef58 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:41.689569 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f797e9e9-1e53-4cb1-a1fd-bb305a43ef58 None None] PATH_INFO: `/` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:41.690927 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1241/2474] 10.222.0.26 () {54 vars in 921 bytes} [Wed Aug 24 05:53:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:53:41.696761 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142c771a-c3e5-4a9f-8306-a454ade6312c None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:41.697052 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142c771a-c3e5-4a9f-8306-a454ade6312c None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:41.697323 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142c771a-c3e5-4a9f-8306-a454ade6312c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:41.716855 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-142c771a-c3e5-4a9f-8306-a454ade6312c None None] MFA Rules not processed for user `7b633e1aec6c4269bce13aa9c89e911a`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:53:41.718101 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-142c771a-c3e5-4a9f-8306-a454ade6312c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:53:41.727428 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1234/2475] 10.222.0.26 () {58 vars in 1018 bytes} [Wed Aug 24 05:53:41 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:53:41.737661 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f797e9e9-1e53-4cb1-a1fd-bb305a43ef58 None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:41.749334 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f797e9e9-1e53-4cb1-a1fd-bb305a43ef58 None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:41.752929 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afe1459-aa2a-4745-8771-60f4bb2192ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '874348b647194ac2b5ecbf12c33bf59e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:41.753513 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afe1459-aa2a-4745-8771-60f4bb2192ab service neutron] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:41.753791 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afe1459-aa2a-4745-8771-60f4bb2192ab service neutron] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:41.754093 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afe1459-aa2a-4745-8771-60f4bb2192ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:41.764656 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afe1459-aa2a-4745-8771-60f4bb2192ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:41.766124 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afe1459-aa2a-4745-8771-60f4bb2192ab service neutron] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:41.777511 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1242/2476] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 24 05:53:41 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:53:43.434197 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9275a0ad-fe9d-4f2b-bba3-cd21392d3fd4 None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:43.434659 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9275a0ad-fe9d-4f2b-bba3-cd21392d3fd4 None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:43.434757 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9275a0ad-fe9d-4f2b-bba3-cd21392d3fd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:43.454074 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-9275a0ad-fe9d-4f2b-bba3-cd21392d3fd4 None None] MFA Rules not processed for user `6c2c08b27a0f4943b5da908eb7b1cd96`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:53:43.455266 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-9275a0ad-fe9d-4f2b-bba3-cd21392d3fd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:53:43.462861 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1235/2477] 10.222.0.26 () {58 vars in 1009 bytes} [Wed Aug 24 05:53:43 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:53:43.474433 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afe1459-aa2a-4745-8771-60f4bb2192ab service neutron] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:53:43.485607 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afe1459-aa2a-4745-8771-60f4bb2192ab service neutron] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:53:43.490483 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ce547b-4175-415b-9511-77a91799008d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87ff96222a7c4baea31fc1bebf4d89a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:53:43.491071 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ce547b-4175-415b-9511-77a91799008d service swift] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:53:43.491352 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ce547b-4175-415b-9511-77a91799008d service swift] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:53:43.491649 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ce547b-4175-415b-9511-77a91799008d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:53:43.500415 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ce547b-4175-415b-9511-77a91799008d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:53:43.502024 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ce547b-4175-415b-9511-77a91799008d service swift] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:53:43.510694 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1243/2478] 10.222.0.26 () {60 vars in 1384 bytes} [Wed Aug 24 05:53:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 05:53:53.448955 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=43 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:53:53.507324 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=61 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:54:03.713580 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36357edf-688d-4d4a-9127-721e9cd8752d None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:54:03.714098 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36357edf-688d-4d4a-9127-721e9cd8752d None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:54:03.714201 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36357edf-688d-4d4a-9127-721e9cd8752d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:54:03.752341 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-36357edf-688d-4d4a-9127-721e9cd8752d None None] MFA Rules not processed for user `6c2c08b27a0f4943b5da908eb7b1cd96`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:54:03.753565 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-36357edf-688d-4d4a-9127-721e9cd8752d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:54:03.788406 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1236/2479] 10.222.0.26 () {58 vars in 967 bytes} [Wed Aug 24 05:54:03 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:54:03.800992 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ce547b-4175-415b-9511-77a91799008d service swift] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:54:03.843086 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ce547b-4175-415b-9511-77a91799008d service swift] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:54:03.848200 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c08080-6e9f-47e2-b9bd-24b7b40ff94a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87ff96222a7c4baea31fc1bebf4d89a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:54:03.848793 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c08080-6e9f-47e2-b9bd-24b7b40ff94a service swift] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:54:03.849070 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c08080-6e9f-47e2-b9bd-24b7b40ff94a service swift] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:54:03.849340 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c08080-6e9f-47e2-b9bd-24b7b40ff94a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:54:03.858163 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c08080-6e9f-47e2-b9bd-24b7b40ff94a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:54:03.860368 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c08080-6e9f-47e2-b9bd-24b7b40ff94a service swift] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:54:03.868668 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1244/2480] 10.222.0.26 () {60 vars in 1384 bytes} [Wed Aug 24 05:54:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 05:54:06.839329 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36357edf-688d-4d4a-9127-721e9cd8752d None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:54:06.840754 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-36357edf-688d-4d4a-9127-721e9cd8752d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:54:06.927796 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36357edf-688d-4d4a-9127-721e9cd8752d None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:54:06.932772 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68253dac-bc1e-46e1-b2d3-61c3d38fa21e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '995ebe690b7748c9842bc0696415fc52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:54:06.933380 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68253dac-bc1e-46e1-b2d3-61c3d38fa21e service placement] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:54:06.933661 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68253dac-bc1e-46e1-b2d3-61c3d38fa21e service placement] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:54:06.933935 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68253dac-bc1e-46e1-b2d3-61c3d38fa21e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:54:06.935652 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-68253dac-bc1e-46e1-b2d3-61c3d38fa21e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:54:06.947507 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68253dac-bc1e-46e1-b2d3-61c3d38fa21e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:54:06.949067 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68253dac-bc1e-46e1-b2d3-61c3d38fa21e service placement] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:54:06.958754 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1237/2481] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 24 05:54:06 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:54:13.865324 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=20 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:54:16.954627 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=64 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:54:50.771206 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c08080-6e9f-47e2-b9bd-24b7b40ff94a service swift] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:54:50.772606 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-75c08080-6e9f-47e2-b9bd-24b7b40ff94a service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:54:50.806106 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c08080-6e9f-47e2-b9bd-24b7b40ff94a service swift] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:54:50.809666 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07acee70-b1b4-443d-90ae-fd1d138e12f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '874348b647194ac2b5ecbf12c33bf59e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:54:50.810291 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07acee70-b1b4-443d-90ae-fd1d138e12f4 service neutron] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:54:50.810578 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07acee70-b1b4-443d-90ae-fd1d138e12f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:54:50.810849 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07acee70-b1b4-443d-90ae-fd1d138e12f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:54:50.812545 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-07acee70-b1b4-443d-90ae-fd1d138e12f4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:54:50.894631 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07acee70-b1b4-443d-90ae-fd1d138e12f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:54:50.896061 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07acee70-b1b4-443d-90ae-fd1d138e12f4 service neutron] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:54:50.914995 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1245/2482] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 24 05:54:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:54:54.360387 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68253dac-bc1e-46e1-b2d3-61c3d38fa21e service placement] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:54:54.362003 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-68253dac-bc1e-46e1-b2d3-61c3d38fa21e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:54:54.378364 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68253dac-bc1e-46e1-b2d3-61c3d38fa21e service placement] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:54:54.384837 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fa7660-8108-4d13-bf14-593976efcb82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:54:54.385470 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fa7660-8108-4d13-bf14-593976efcb82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:54:54.385753 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fa7660-8108-4d13-bf14-593976efcb82 admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:54:54.386065 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fa7660-8108-4d13-bf14-593976efcb82 admin admin] PATH_INFO: `/v3/users/7ea384c1544c424eb2b524760e1d6d22` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:54:54.387332 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fa7660-8108-4d13-bf14-593976efcb82 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ea384c1544c424eb2b524760e1d6d22)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:54:54.389260 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fa7660-8108-4d13-bf14-593976efcb82 admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:54:54.441678 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-83fa7660-8108-4d13-bf14-593976efcb82 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ea384c1544c424eb2b524760e1d6d22'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:54:54.448846 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-83fa7660-8108-4d13-bf14-593976efcb82 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ea384c1544c424eb2b524760e1d6d22'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:54:54.461463 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-83fa7660-8108-4d13-bf14-593976efcb82 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ea384c1544c424eb2b524760e1d6d22'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:54:54.469603 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-83fa7660-8108-4d13-bf14-593976efcb82 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ea384c1544c424eb2b524760e1d6d22'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:54:54.470262 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-83fa7660-8108-4d13-bf14-593976efcb82 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ea384c1544c424eb2b524760e1d6d22'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:54:54.476310 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1238/2483] 10.222.0.26 () {58 vars in 1224 bytes} [Wed Aug 24 05:54:54 2022] DELETE /identity/v3/users/7ea384c1544c424eb2b524760e1d6d22 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:54:54.644300 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07acee70-b1b4-443d-90ae-fd1d138e12f4 service neutron] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:54:54.656027 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07acee70-b1b4-443d-90ae-fd1d138e12f4 service neutron] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:54:54.713790 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a307078-5276-4902-ae63-85b194fe069e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:54:54.714449 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a307078-5276-4902-ae63-85b194fe069e admin admin] REQUEST_METHOD: `DELETE` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:54:54.714731 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a307078-5276-4902-ae63-85b194fe069e admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:54:54.715626 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a307078-5276-4902-ae63-85b194fe069e admin admin] PATH_INFO: `/v3/projects/2a4d71caaba544369ced7c8272c02eec` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:54:54.716736 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a307078-5276-4902-ae63-85b194fe069e admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a4d71caaba544369ced7c8272c02eec)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:54:54.718679 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a307078-5276-4902-ae63-85b194fe069e admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:54:54.763062 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:54:54.764411 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-0a307078-5276-4902-ae63-85b194fe069e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a4d71caaba544369ced7c8272c02eec', 'request_id': 'req-0a307078-5276-4902-ae63-85b194fe069e'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:54:54.771815 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-0a307078-5276-4902-ae63-85b194fe069e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a4d71caaba544369ced7c8272c02eec', 'request_id': 'req-0a307078-5276-4902-ae63-85b194fe069e'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:54:54.778759 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-0a307078-5276-4902-ae63-85b194fe069e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a4d71caaba544369ced7c8272c02eec', 'request_id': 'req-0a307078-5276-4902-ae63-85b194fe069e'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:54:54.788912 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-0a307078-5276-4902-ae63-85b194fe069e admin admin] The token cache is being invalidate because project 2a4d71caaba544369ced7c8272c02eec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:54:54.789200 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-0a307078-5276-4902-ae63-85b194fe069e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:54:54.789842 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-0a307078-5276-4902-ae63-85b194fe069e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:54:54.791359 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1246/2484] 10.222.0.26 () {58 vars in 1233 bytes} [Wed Aug 24 05:54:54 2022] DELETE /identity/v3/projects/2a4d71caaba544369ced7c8272c02eec => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:54:54.796165 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0a4aa1-adfd-41e8-9dc4-9080a422d0d4 None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:54:54.796561 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0a4aa1-adfd-41e8-9dc4-9080a422d0d4 None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:54:54.797200 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0a4aa1-adfd-41e8-9dc4-9080a422d0d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:54:54.855731 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-0c0a4aa1-adfd-41e8-9dc4-9080a422d0d4 None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:54:54.856965 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-0c0a4aa1-adfd-41e8-9dc4-9080a422d0d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:54:54.917764 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1239/2485] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:54:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 05:54:54.926625 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fe642a-d0ac-4f51-be49-36e279185394 None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:54:54.926935 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fe642a-d0ac-4f51-be49-36e279185394 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:54:54.927209 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fe642a-d0ac-4f51-be49-36e279185394 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:54:54.950852 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-00fe642a-d0ac-4f51-be49-36e279185394 None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:54:54.952076 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-00fe642a-d0ac-4f51-be49-36e279185394 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:54:54.969734 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1247/2486] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:54:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:54:54.970643 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0a4aa1-adfd-41e8-9dc4-9080a422d0d4 None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:54:54.981005 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0a4aa1-adfd-41e8-9dc4-9080a422d0d4 None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:54:54.985683 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d5489f-8b94-41c1-80e5-a1b8e6ff7c6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:54:54.986518 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d5489f-8b94-41c1-80e5-a1b8e6ff7c6c admin admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:54:54.986876 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d5489f-8b94-41c1-80e5-a1b8e6ff7c6c admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:54:54.987225 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d5489f-8b94-41c1-80e5-a1b8e6ff7c6c admin admin] PATH_INFO: `/v3/domains` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:54:54.987941 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d5489f-8b94-41c1-80e5-a1b8e6ff7c6c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:54:54.988330 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d5489f-8b94-41c1-80e5-a1b8e6ff7c6c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:54:54.990051 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d5489f-8b94-41c1-80e5-a1b8e6ff7c6c admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:54:55.006134 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1240/2487] 10.222.0.26 () {58 vars in 1153 bytes} [Wed Aug 24 05:54:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:54:55.007283 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fe642a-d0ac-4f51-be49-36e279185394 None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:54:55.017276 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fe642a-d0ac-4f51-be49-36e279185394 None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:54:55.022052 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d527de7-4e19-4147-83a5-aac2e4dde22c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:54:55.022650 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d527de7-4e19-4147-83a5-aac2e4dde22c admin admin] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:54:55.022928 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d527de7-4e19-4147-83a5-aac2e4dde22c admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:54:55.023199 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d527de7-4e19-4147-83a5-aac2e4dde22c admin admin] PATH_INFO: `/v3/projects` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:54:55.023820 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d527de7-4e19-4147-83a5-aac2e4dde22c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:54:55.026086 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d527de7-4e19-4147-83a5-aac2e4dde22c admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:54:55.063648 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1248/2488] 10.222.0.26 () {60 vars in 1153 bytes} [Wed Aug 24 05:54:55 2022] POST /identity/v3/projects => generated 381 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:54:55.064777 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d5489f-8b94-41c1-80e5-a1b8e6ff7c6c admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:54:55.080068 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d5489f-8b94-41c1-80e5-a1b8e6ff7c6c admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:54:55.111124 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:54:55.146929 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cb1fc3-7d24-43a6-b356-a7128c9d1d18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:54:55.147692 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cb1fc3-7d24-43a6-b356-a7128c9d1d18 admin admin] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:54:55.148050 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cb1fc3-7d24-43a6-b356-a7128c9d1d18 admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:54:55.148398 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cb1fc3-7d24-43a6-b356-a7128c9d1d18 admin admin] PATH_INFO: `/v3/users` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:54:55.149280 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cb1fc3-7d24-43a6-b356-a7128c9d1d18 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:54:55.151501 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cb1fc3-7d24-43a6-b356-a7128c9d1d18 admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:54:55.178724 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1241/2489] 10.222.0.26 () {60 vars in 1144 bytes} [Wed Aug 24 05:54:55 2022] POST /identity/v3/users => generated 291 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 05:54:55.182768 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d527de7-4e19-4147-83a5-aac2e4dde22c admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:54:55.194353 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d527de7-4e19-4147-83a5-aac2e4dde22c admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:54:55.199088 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3115df0-262b-426f-b76c-d1b3aa9b77d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:54:55.199765 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3115df0-262b-426f-b76c-d1b3aa9b77d9 admin admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:54:55.200123 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3115df0-262b-426f-b76c-d1b3aa9b77d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:54:55.200400 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3115df0-262b-426f-b76c-d1b3aa9b77d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:54:55.201049 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3115df0-262b-426f-b76c-d1b3aa9b77d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:54:55.202709 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3115df0-262b-426f-b76c-d1b3aa9b77d9 admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:54:55.213299 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1249/2490] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Aug 24 05:54:55 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:54:55.217574 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cb1fc3-7d24-43a6-b356-a7128c9d1d18 admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:54:55.228439 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cb1fc3-7d24-43a6-b356-a7128c9d1d18 admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:54:55.233701 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b4983e-9965-4358-ae22-17e4de56f742 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:54:55.234348 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b4983e-9965-4358-ae22-17e4de56f742 admin admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:54:55.234630 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b4983e-9965-4358-ae22-17e4de56f742 admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:54:55.234905 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b4983e-9965-4358-ae22-17e4de56f742 admin admin] PATH_INFO: `/v3/roles` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:54:55.235559 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b4983e-9965-4358-ae22-17e4de56f742 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:54:55.237185 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b4983e-9965-4358-ae22-17e4de56f742 admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:54:55.248717 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1242/2491] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Aug 24 05:54:55 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:54:55.252980 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3115df0-262b-426f-b76c-d1b3aa9b77d9 admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:54:55.262970 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3115df0-262b-426f-b76c-d1b3aa9b77d9 admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:54:55.267592 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cf672f-72bf-48df-b1c2-ecdb78b447d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:54:55.268227 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cf672f-72bf-48df-b1c2-ecdb78b447d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:54:55.268509 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cf672f-72bf-48df-b1c2-ecdb78b447d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:54:55.268789 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cf672f-72bf-48df-b1c2-ecdb78b447d0 admin admin] PATH_INFO: `/v3/projects/2c03185777864eb2859866d872d78802/users/c6b57bba2344414589239f33069be8dd/roles/f7aa4a2c74c94c1b9ca8ecdcccccda5c` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:54:55.283147 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cf672f-72bf-48df-b1c2-ecdb78b447d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c03185777864eb2859866d872d78802, user_id=c6b57bba2344414589239f33069be8dd, role_id=f7aa4a2c74c94c1b9ca8ecdcccccda5c)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:54:55.285783 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cf672f-72bf-48df-b1c2-ecdb78b447d0 admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:54:55.298483 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1250/2492] 10.222.0.26 () {60 vars in 1483 bytes} [Wed Aug 24 05:54:55 2022] PUT /identity/v3/projects/2c03185777864eb2859866d872d78802/users/c6b57bba2344414589239f33069be8dd/roles/f7aa4a2c74c94c1b9ca8ecdcccccda5c => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 05:54:55.309216 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198f9212-1841-4f29-8a4a-3d739c085414 None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:54:55.309639 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198f9212-1841-4f29-8a4a-3d739c085414 None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:54:55.309921 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198f9212-1841-4f29-8a4a-3d739c085414 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:54:55.339206 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-198f9212-1841-4f29-8a4a-3d739c085414 None None] MFA Rules not processed for user `c6b57bba2344414589239f33069be8dd`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:54:55.340412 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-198f9212-1841-4f29-8a4a-3d739c085414 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:54:55.411902 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1243/2493] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:54:55 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:54:55.416341 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cf672f-72bf-48df-b1c2-ecdb78b447d0 admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:54:55.492397 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cf672f-72bf-48df-b1c2-ecdb78b447d0 admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:54:55.497523 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fbd765-fed2-4a8d-b21a-3e9b96763b8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:54:55.498162 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fbd765-fed2-4a8d-b21a-3e9b96763b8a admin admin] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:54:55.498449 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fbd765-fed2-4a8d-b21a-3e9b96763b8a admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:54:55.498731 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fbd765-fed2-4a8d-b21a-3e9b96763b8a admin admin] PATH_INFO: `/v3/projects` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:54:55.499371 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fbd765-fed2-4a8d-b21a-3e9b96763b8a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:54:55.501319 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fbd765-fed2-4a8d-b21a-3e9b96763b8a admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:54:55.537903 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1251/2494] 10.222.0.26 () {60 vars in 1153 bytes} [Wed Aug 24 05:54:55 2022] POST /identity/v3/projects => generated 379 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:54:55.539385 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198f9212-1841-4f29-8a4a-3d739c085414 None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:54:55.554042 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198f9212-1841-4f29-8a4a-3d739c085414 None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:54:55.614460 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5814ede-8153-4352-9005-7f4f87ce3637 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:54:55.615081 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5814ede-8153-4352-9005-7f4f87ce3637 admin admin] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:54:55.615363 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5814ede-8153-4352-9005-7f4f87ce3637 admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:54:55.615636 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5814ede-8153-4352-9005-7f4f87ce3637 admin admin] PATH_INFO: `/v3/users` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:54:55.616286 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5814ede-8153-4352-9005-7f4f87ce3637 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:54:55.618236 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5814ede-8153-4352-9005-7f4f87ce3637 admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:54:55.640408 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1244/2495] 10.222.0.26 () {60 vars in 1144 bytes} [Wed Aug 24 05:54:55 2022] POST /identity/v3/users => generated 296 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:54:55.644525 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fbd765-fed2-4a8d-b21a-3e9b96763b8a admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:54:55.655003 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fbd765-fed2-4a8d-b21a-3e9b96763b8a admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:54:55.660486 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1ac664-76d7-4038-930e-4eef0bcfdcc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:54:55.661085 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1ac664-76d7-4038-930e-4eef0bcfdcc3 admin admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:54:55.661365 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1ac664-76d7-4038-930e-4eef0bcfdcc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:54:55.661637 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1ac664-76d7-4038-930e-4eef0bcfdcc3 admin admin] PATH_INFO: `/v3/roles` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:54:55.662369 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1ac664-76d7-4038-930e-4eef0bcfdcc3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:54:55.663924 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1ac664-76d7-4038-930e-4eef0bcfdcc3 admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:54:55.678679 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1252/2496] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Aug 24 05:54:55 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:54:55.683178 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5814ede-8153-4352-9005-7f4f87ce3637 admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:54:55.694092 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5814ede-8153-4352-9005-7f4f87ce3637 admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:54:55.698936 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6996edb-60f3-4471-96f1-9b9ead2f82a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:54:55.700145 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6996edb-60f3-4471-96f1-9b9ead2f82a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:54:55.700444 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6996edb-60f3-4471-96f1-9b9ead2f82a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:54:55.700716 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6996edb-60f3-4471-96f1-9b9ead2f82a0 admin admin] PATH_INFO: `/v3/projects/bccbf7e990934128933616fb0104f993/users/9e45446090af4dfca24af901cef7e9b9/roles/640bda0879494e60b72680ee505285f0` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:54:55.716103 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6996edb-60f3-4471-96f1-9b9ead2f82a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bccbf7e990934128933616fb0104f993, user_id=9e45446090af4dfca24af901cef7e9b9, role_id=640bda0879494e60b72680ee505285f0)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:54:55.718797 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6996edb-60f3-4471-96f1-9b9ead2f82a0 admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:54:55.731653 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1245/2497] 10.222.0.26 () {60 vars in 1483 bytes} [Wed Aug 24 05:54:55 2022] PUT /identity/v3/projects/bccbf7e990934128933616fb0104f993/users/9e45446090af4dfca24af901cef7e9b9/roles/640bda0879494e60b72680ee505285f0 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:54:55.735702 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1ac664-76d7-4038-930e-4eef0bcfdcc3 admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:54:55.745532 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1ac664-76d7-4038-930e-4eef0bcfdcc3 admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:54:55.789930 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:54:55.805445 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9c29c4-b56e-4d5e-aa40-1880ac90eea7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:54:55.806075 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9c29c4-b56e-4d5e-aa40-1880ac90eea7 admin admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:54:55.806349 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9c29c4-b56e-4d5e-aa40-1880ac90eea7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:54:55.806615 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9c29c4-b56e-4d5e-aa40-1880ac90eea7 admin admin] PATH_INFO: `/v3/roles` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:54:55.807243 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9c29c4-b56e-4d5e-aa40-1880ac90eea7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:54:55.809419 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9c29c4-b56e-4d5e-aa40-1880ac90eea7 admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:54:55.819232 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1253/2498] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Aug 24 05:54:55 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:54:55.823429 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6996edb-60f3-4471-96f1-9b9ead2f82a0 admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:54:55.829606 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:54:55.835897 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6996edb-60f3-4471-96f1-9b9ead2f82a0 admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:54:55.840878 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c20ed0-dde9-4198-90d4-73a6d9a1f9f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:54:55.841528 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c20ed0-dde9-4198-90d4-73a6d9a1f9f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:54:55.841816 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c20ed0-dde9-4198-90d4-73a6d9a1f9f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:54:55.842129 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c20ed0-dde9-4198-90d4-73a6d9a1f9f7 admin admin] PATH_INFO: `/v3/projects/bccbf7e990934128933616fb0104f993/users/9e45446090af4dfca24af901cef7e9b9/roles/640bda0879494e60b72680ee505285f0` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:54:55.844040 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c20ed0-dde9-4198-90d4-73a6d9a1f9f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bccbf7e990934128933616fb0104f993, user_id=9e45446090af4dfca24af901cef7e9b9, role_id=640bda0879494e60b72680ee505285f0)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:54:55.846712 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c20ed0-dde9-4198-90d4-73a6d9a1f9f7 admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:54:55.856772 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1246/2499] 10.222.0.26 () {60 vars in 1483 bytes} [Wed Aug 24 05:54:55 2022] PUT /identity/v3/projects/bccbf7e990934128933616fb0104f993/users/9e45446090af4dfca24af901cef7e9b9/roles/640bda0879494e60b72680ee505285f0 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:54:55.866977 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0180c3a9-bc60-43d0-bd8a-ad3352991cc1 None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:54:55.867263 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0180c3a9-bc60-43d0-bd8a-ad3352991cc1 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:54:55.867539 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0180c3a9-bc60-43d0-bd8a-ad3352991cc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:54:55.895568 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-0180c3a9-bc60-43d0-bd8a-ad3352991cc1 None None] MFA Rules not processed for user `9e45446090af4dfca24af901cef7e9b9`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:54:55.896717 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-0180c3a9-bc60-43d0-bd8a-ad3352991cc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:54:55.969405 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1254/2500] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:54:55 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:54:55.983004 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c20ed0-dde9-4198-90d4-73a6d9a1f9f7 admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:54:55.984863 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-b6c20ed0-dde9-4198-90d4-73a6d9a1f9f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:54:56.064593 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c20ed0-dde9-4198-90d4-73a6d9a1f9f7 admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:54:56.068786 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c672f937-a817-492a-b776-d2731f3d2a7c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17b450afe795495680fc70f522c83750', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:54:56.069400 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c672f937-a817-492a-b776-d2731f3d2a7c service cinder] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:54:56.069679 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c672f937-a817-492a-b776-d2731f3d2a7c service cinder] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:54:56.069974 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c672f937-a817-492a-b776-d2731f3d2a7c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:54:56.079622 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c672f937-a817-492a-b776-d2731f3d2a7c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:54:56.081050 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c672f937-a817-492a-b776-d2731f3d2a7c service cinder] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:54:56.090846 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1247/2501] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 24 05:54:55 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:54:56.393679 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0180c3a9-bc60-43d0-bd8a-ad3352991cc1 None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:54:56.403509 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0180c3a9-bc60-43d0-bd8a-ad3352991cc1 None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:54:56.408378 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be637b2-b3be-4279-b666-64bfe88c9630 tempest-VolumeQuotaClassesTest-986033639 tempest-VolumeQuotaClassesTest-986033639-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e45446090af4dfca24af901cef7e9b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bccbf7e990934128933616fb0104f993', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:54:56.408973 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be637b2-b3be-4279-b666-64bfe88c9630 tempest-VolumeQuotaClassesTest-986033639 tempest-VolumeQuotaClassesTest-986033639-project-admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:54:56.409269 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be637b2-b3be-4279-b666-64bfe88c9630 tempest-VolumeQuotaClassesTest-986033639 tempest-VolumeQuotaClassesTest-986033639-project-admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:54:56.409547 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be637b2-b3be-4279-b666-64bfe88c9630 tempest-VolumeQuotaClassesTest-986033639 tempest-VolumeQuotaClassesTest-986033639-project-admin] PATH_INFO: `/v3/domains` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:54:56.410253 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be637b2-b3be-4279-b666-64bfe88c9630 tempest-VolumeQuotaClassesTest-986033639 tempest-VolumeQuotaClassesTest-986033639-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=88113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:54:56.410617 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be637b2-b3be-4279-b666-64bfe88c9630 tempest-VolumeQuotaClassesTest-986033639 tempest-VolumeQuotaClassesTest-986033639-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:54:56.412161 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be637b2-b3be-4279-b666-64bfe88c9630 tempest-VolumeQuotaClassesTest-986033639 tempest-VolumeQuotaClassesTest-986033639-project-admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:54:56.424762 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1255/2502] 10.222.0.26 () {58 vars in 1153 bytes} [Wed Aug 24 05:54:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:54:56.429216 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c672f937-a817-492a-b776-d2731f3d2a7c service cinder] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:54:56.438453 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c672f937-a817-492a-b776-d2731f3d2a7c service cinder] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:54:56.443237 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d4f9ab-e555-455d-b6ee-0a18dacf27b3 tempest-VolumeQuotaClassesTest-986033639 tempest-VolumeQuotaClassesTest-986033639-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e45446090af4dfca24af901cef7e9b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bccbf7e990934128933616fb0104f993', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:54:56.443817 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d4f9ab-e555-455d-b6ee-0a18dacf27b3 tempest-VolumeQuotaClassesTest-986033639 tempest-VolumeQuotaClassesTest-986033639-project-admin] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:54:56.444095 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d4f9ab-e555-455d-b6ee-0a18dacf27b3 tempest-VolumeQuotaClassesTest-986033639 tempest-VolumeQuotaClassesTest-986033639-project-admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:54:56.444366 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d4f9ab-e555-455d-b6ee-0a18dacf27b3 tempest-VolumeQuotaClassesTest-986033639 tempest-VolumeQuotaClassesTest-986033639-project-admin] PATH_INFO: `/v3/projects` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:54:56.444982 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d4f9ab-e555-455d-b6ee-0a18dacf27b3 tempest-VolumeQuotaClassesTest-986033639 tempest-VolumeQuotaClassesTest-986033639-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:54:56.446895 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d4f9ab-e555-455d-b6ee-0a18dacf27b3 tempest-VolumeQuotaClassesTest-986033639 tempest-VolumeQuotaClassesTest-986033639-project-admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:54:56.472789 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1248/2503] 10.222.0.26 () {60 vars in 1153 bytes} [Wed Aug 24 05:54:56 2022] POST /identity/v3/projects => generated 353 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:54:56.476923 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be637b2-b3be-4279-b666-64bfe88c9630 tempest-VolumeQuotaClassesTest-986033639 tempest-VolumeQuotaClassesTest-986033639-project-admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:54:56.487460 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be637b2-b3be-4279-b666-64bfe88c9630 tempest-VolumeQuotaClassesTest-986033639 tempest-VolumeQuotaClassesTest-986033639-project-admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:54:56.551093 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc667ce-48be-4a5d-a40a-127a3f8afdba tempest-VolumeQuotaClassesTest-986033639 tempest-VolumeQuotaClassesTest-986033639-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e45446090af4dfca24af901cef7e9b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bccbf7e990934128933616fb0104f993', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:54:56.551702 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc667ce-48be-4a5d-a40a-127a3f8afdba tempest-VolumeQuotaClassesTest-986033639 tempest-VolumeQuotaClassesTest-986033639-project-admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:54:56.551982 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc667ce-48be-4a5d-a40a-127a3f8afdba tempest-VolumeQuotaClassesTest-986033639 tempest-VolumeQuotaClassesTest-986033639-project-admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:54:56.552253 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc667ce-48be-4a5d-a40a-127a3f8afdba tempest-VolumeQuotaClassesTest-986033639 tempest-VolumeQuotaClassesTest-986033639-project-admin] PATH_INFO: `/v3/domains` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:54:56.552922 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc667ce-48be-4a5d-a40a-127a3f8afdba tempest-VolumeQuotaClassesTest-986033639 tempest-VolumeQuotaClassesTest-986033639-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=88113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:54:56.553224 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc667ce-48be-4a5d-a40a-127a3f8afdba tempest-VolumeQuotaClassesTest-986033639 tempest-VolumeQuotaClassesTest-986033639-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:54:56.554843 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc667ce-48be-4a5d-a40a-127a3f8afdba tempest-VolumeQuotaClassesTest-986033639 tempest-VolumeQuotaClassesTest-986033639-project-admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:54:56.566545 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1256/2504] 10.222.0.26 () {58 vars in 1153 bytes} [Wed Aug 24 05:54:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:54:56.603080 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d4f9ab-e555-455d-b6ee-0a18dacf27b3 tempest-VolumeQuotaClassesTest-986033639 tempest-VolumeQuotaClassesTest-986033639-project-admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:54:56.613684 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d4f9ab-e555-455d-b6ee-0a18dacf27b3 tempest-VolumeQuotaClassesTest-986033639 tempest-VolumeQuotaClassesTest-986033639-project-admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:54:56.618140 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2348879d-1b7f-4427-b659-2155f49958fe tempest-VolumeQuotaClassesTest-986033639 tempest-VolumeQuotaClassesTest-986033639-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e45446090af4dfca24af901cef7e9b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bccbf7e990934128933616fb0104f993', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:54:56.618768 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2348879d-1b7f-4427-b659-2155f49958fe tempest-VolumeQuotaClassesTest-986033639 tempest-VolumeQuotaClassesTest-986033639-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:54:56.619031 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2348879d-1b7f-4427-b659-2155f49958fe tempest-VolumeQuotaClassesTest-986033639 tempest-VolumeQuotaClassesTest-986033639-project-admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:54:56.619300 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2348879d-1b7f-4427-b659-2155f49958fe tempest-VolumeQuotaClassesTest-986033639 tempest-VolumeQuotaClassesTest-986033639-project-admin] PATH_INFO: `/v3/projects/58418876672844b282b9f54f0f191e64` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:54:56.620406 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2348879d-1b7f-4427-b659-2155f49958fe tempest-VolumeQuotaClassesTest-986033639 tempest-VolumeQuotaClassesTest-986033639-project-admin] RBAC: Authorizing `identity:delete_project(project_id=58418876672844b282b9f54f0f191e64)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:54:56.622357 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2348879d-1b7f-4427-b659-2155f49958fe tempest-VolumeQuotaClassesTest-986033639 tempest-VolumeQuotaClassesTest-986033639-project-admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:54:56.666882 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-2348879d-1b7f-4427-b659-2155f49958fe tempest-VolumeQuotaClassesTest-986033639 tempest-VolumeQuotaClassesTest-986033639-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '58418876672844b282b9f54f0f191e64', 'request_id': 'req-2348879d-1b7f-4427-b659-2155f49958fe'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:54:56.674853 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-2348879d-1b7f-4427-b659-2155f49958fe tempest-VolumeQuotaClassesTest-986033639 tempest-VolumeQuotaClassesTest-986033639-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '58418876672844b282b9f54f0f191e64', 'request_id': 'req-2348879d-1b7f-4427-b659-2155f49958fe'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:54:56.681770 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-2348879d-1b7f-4427-b659-2155f49958fe tempest-VolumeQuotaClassesTest-986033639 tempest-VolumeQuotaClassesTest-986033639-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '58418876672844b282b9f54f0f191e64', 'request_id': 'req-2348879d-1b7f-4427-b659-2155f49958fe'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:54:56.695426 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-2348879d-1b7f-4427-b659-2155f49958fe tempest-VolumeQuotaClassesTest-986033639 tempest-VolumeQuotaClassesTest-986033639-project-admin] The token cache is being invalidate because project 58418876672844b282b9f54f0f191e64 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88112) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:54:56.695715 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-2348879d-1b7f-4427-b659-2155f49958fe tempest-VolumeQuotaClassesTest-986033639 tempest-VolumeQuotaClassesTest-986033639-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:54:56.696384 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-2348879d-1b7f-4427-b659-2155f49958fe tempest-VolumeQuotaClassesTest-986033639 tempest-VolumeQuotaClassesTest-986033639-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:54:56.697923 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1249/2505] 10.222.0.26 () {58 vars in 1233 bytes} [Wed Aug 24 05:54:56 2022] DELETE /identity/v3/projects/58418876672844b282b9f54f0f191e64 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:54:56.885441 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc667ce-48be-4a5d-a40a-127a3f8afdba tempest-VolumeQuotaClassesTest-986033639 tempest-VolumeQuotaClassesTest-986033639-project-admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:54:56.887666 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-8cc667ce-48be-4a5d-a40a-127a3f8afdba tempest-VolumeQuotaClassesTest-986033639 tempest-VolumeQuotaClassesTest-986033639-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:54:56.937438 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=100 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:54:56.953237 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc667ce-48be-4a5d-a40a-127a3f8afdba tempest-VolumeQuotaClassesTest-986033639 tempest-VolumeQuotaClassesTest-986033639-project-admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:54:57.008160 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa69e4d-456c-41ce-8108-aa1ba08e53c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:54:57.008786 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa69e4d-456c-41ce-8108-aa1ba08e53c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:54:57.009067 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa69e4d-456c-41ce-8108-aa1ba08e53c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:54:57.009339 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa69e4d-456c-41ce-8108-aa1ba08e53c0 admin admin] PATH_INFO: `/v3/users/c6b57bba2344414589239f33069be8dd` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:54:57.010498 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa69e4d-456c-41ce-8108-aa1ba08e53c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c6b57bba2344414589239f33069be8dd)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:54:57.012465 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa69e4d-456c-41ce-8108-aa1ba08e53c0 admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:54:57.062535 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-6aa69e4d-456c-41ce-8108-aa1ba08e53c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c6b57bba2344414589239f33069be8dd'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:54:57.069469 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-6aa69e4d-456c-41ce-8108-aa1ba08e53c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c6b57bba2344414589239f33069be8dd'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:54:57.070277 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-6aa69e4d-456c-41ce-8108-aa1ba08e53c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c6b57bba2344414589239f33069be8dd'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:54:57.081657 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-6aa69e4d-456c-41ce-8108-aa1ba08e53c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c6b57bba2344414589239f33069be8dd'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:54:57.088850 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-6aa69e4d-456c-41ce-8108-aa1ba08e53c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c6b57bba2344414589239f33069be8dd'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:54:57.095474 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1257/2506] 10.222.0.26 () {58 vars in 1224 bytes} [Wed Aug 24 05:54:56 2022] DELETE /identity/v3/users/c6b57bba2344414589239f33069be8dd => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:54:57.100273 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0904e811-5ebb-4686-856d-cb08770d667d None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:54:57.100723 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0904e811-5ebb-4686-856d-cb08770d667d None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:54:57.101001 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0904e811-5ebb-4686-856d-cb08770d667d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:54:57.120362 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-0904e811-5ebb-4686-856d-cb08770d667d None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:54:57.121592 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-0904e811-5ebb-4686-856d-cb08770d667d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:54:57.150495 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:54:57.186364 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1250/2507] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:54:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:54:57.196545 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa69e4d-456c-41ce-8108-aa1ba08e53c0 admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:54:57.198041 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-6aa69e4d-456c-41ce-8108-aa1ba08e53c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:54:57.257445 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa69e4d-456c-41ce-8108-aa1ba08e53c0 admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:54:57.261139 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d268e446-1c96-40ac-9b78-9a5fb16f9650 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '874348b647194ac2b5ecbf12c33bf59e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:54:57.261765 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d268e446-1c96-40ac-9b78-9a5fb16f9650 service neutron] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:54:57.262082 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d268e446-1c96-40ac-9b78-9a5fb16f9650 service neutron] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:54:57.262376 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d268e446-1c96-40ac-9b78-9a5fb16f9650 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:54:57.271380 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d268e446-1c96-40ac-9b78-9a5fb16f9650 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:54:57.272829 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d268e446-1c96-40ac-9b78-9a5fb16f9650 service neutron] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:54:57.282941 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1258/2508] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 24 05:54:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:54:57.546327 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0904e811-5ebb-4686-856d-cb08770d667d None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:54:57.547756 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-0904e811-5ebb-4686-856d-cb08770d667d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:54:57.560313 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0904e811-5ebb-4686-856d-cb08770d667d None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:54:57.565368 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c71d02-9bc2-49a3-974b-67af0d8c7ad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:54:57.566036 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c71d02-9bc2-49a3-974b-67af0d8c7ad6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:54:57.566324 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c71d02-9bc2-49a3-974b-67af0d8c7ad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:54:57.566597 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c71d02-9bc2-49a3-974b-67af0d8c7ad6 admin admin] PATH_INFO: `/v3/projects/2c03185777864eb2859866d872d78802` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:54:57.568057 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c71d02-9bc2-49a3-974b-67af0d8c7ad6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c03185777864eb2859866d872d78802)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:54:57.569988 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c71d02-9bc2-49a3-974b-67af0d8c7ad6 admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:54:57.619541 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-d2c71d02-9bc2-49a3-974b-67af0d8c7ad6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c03185777864eb2859866d872d78802', 'request_id': 'req-d2c71d02-9bc2-49a3-974b-67af0d8c7ad6'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:54:57.627826 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-d2c71d02-9bc2-49a3-974b-67af0d8c7ad6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c03185777864eb2859866d872d78802', 'request_id': 'req-d2c71d02-9bc2-49a3-974b-67af0d8c7ad6'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:54:57.634602 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-d2c71d02-9bc2-49a3-974b-67af0d8c7ad6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c03185777864eb2859866d872d78802', 'request_id': 'req-d2c71d02-9bc2-49a3-974b-67af0d8c7ad6'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:54:57.645797 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-d2c71d02-9bc2-49a3-974b-67af0d8c7ad6 admin admin] The token cache is being invalidate because project 2c03185777864eb2859866d872d78802 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88112) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:54:57.646114 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-d2c71d02-9bc2-49a3-974b-67af0d8c7ad6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:54:57.646752 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-d2c71d02-9bc2-49a3-974b-67af0d8c7ad6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:54:57.648243 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1251/2509] 10.222.0.26 () {58 vars in 1233 bytes} [Wed Aug 24 05:54:57 2022] DELETE /identity/v3/projects/2c03185777864eb2859866d872d78802 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:54:57.652996 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d268e446-1c96-40ac-9b78-9a5fb16f9650 service neutron] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:54:57.663023 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d268e446-1c96-40ac-9b78-9a5fb16f9650 service neutron] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:54:57.674844 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:54:57.731481 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22107bd-828e-4e14-8b94-37620f7ba415 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:54:57.732142 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22107bd-828e-4e14-8b94-37620f7ba415 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:54:57.732418 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22107bd-828e-4e14-8b94-37620f7ba415 admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:54:57.732741 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22107bd-828e-4e14-8b94-37620f7ba415 admin admin] PATH_INFO: `/v3/users/9e45446090af4dfca24af901cef7e9b9` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:54:57.733868 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22107bd-828e-4e14-8b94-37620f7ba415 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e45446090af4dfca24af901cef7e9b9)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:54:57.735845 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22107bd-828e-4e14-8b94-37620f7ba415 admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:54:57.787528 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-e22107bd-828e-4e14-8b94-37620f7ba415 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e45446090af4dfca24af901cef7e9b9'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:54:57.794586 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-e22107bd-828e-4e14-8b94-37620f7ba415 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e45446090af4dfca24af901cef7e9b9'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:54:57.795460 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-e22107bd-828e-4e14-8b94-37620f7ba415 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e45446090af4dfca24af901cef7e9b9'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:54:57.808264 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-e22107bd-828e-4e14-8b94-37620f7ba415 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e45446090af4dfca24af901cef7e9b9'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:54:57.816170 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-e22107bd-828e-4e14-8b94-37620f7ba415 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e45446090af4dfca24af901cef7e9b9'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:54:57.822714 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1259/2510] 10.222.0.26 () {58 vars in 1224 bytes} [Wed Aug 24 05:54:57 2022] DELETE /identity/v3/users/9e45446090af4dfca24af901cef7e9b9 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:54:58.095905 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c71d02-9bc2-49a3-974b-67af0d8c7ad6 admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:54:58.098480 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-d2c71d02-9bc2-49a3-974b-67af0d8c7ad6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:54:58.113729 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c71d02-9bc2-49a3-974b-67af0d8c7ad6 admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:54:58.175713 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea878d11-20bb-4e61-ba6a-d0198d0a21ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:54:58.176353 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea878d11-20bb-4e61-ba6a-d0198d0a21ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:54:58.176631 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea878d11-20bb-4e61-ba6a-d0198d0a21ee admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:54:58.176902 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea878d11-20bb-4e61-ba6a-d0198d0a21ee admin admin] PATH_INFO: `/v3/projects/bccbf7e990934128933616fb0104f993` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:54:58.178049 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea878d11-20bb-4e61-ba6a-d0198d0a21ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=bccbf7e990934128933616fb0104f993)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:54:58.179970 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea878d11-20bb-4e61-ba6a-d0198d0a21ee admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:54:58.228147 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-ea878d11-20bb-4e61-ba6a-d0198d0a21ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bccbf7e990934128933616fb0104f993', 'request_id': 'req-ea878d11-20bb-4e61-ba6a-d0198d0a21ee'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:54:58.235962 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-ea878d11-20bb-4e61-ba6a-d0198d0a21ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bccbf7e990934128933616fb0104f993', 'request_id': 'req-ea878d11-20bb-4e61-ba6a-d0198d0a21ee'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:54:58.243520 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:54:58.249604 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-ea878d11-20bb-4e61-ba6a-d0198d0a21ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bccbf7e990934128933616fb0104f993', 'request_id': 'req-ea878d11-20bb-4e61-ba6a-d0198d0a21ee'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:54:58.263008 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-ea878d11-20bb-4e61-ba6a-d0198d0a21ee admin admin] The token cache is being invalidate because project bccbf7e990934128933616fb0104f993 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88112) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:54:58.263294 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-ea878d11-20bb-4e61-ba6a-d0198d0a21ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:54:58.263939 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-ea878d11-20bb-4e61-ba6a-d0198d0a21ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:54:58.265430 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1252/2511] 10.222.0.26 () {58 vars in 1233 bytes} [Wed Aug 24 05:54:58 2022] DELETE /identity/v3/projects/bccbf7e990934128933616fb0104f993 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:54:58.270290 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdb5ea3-0c40-4080-aeae-050b0219e561 None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:54:58.270788 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdb5ea3-0c40-4080-aeae-050b0219e561 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:54:58.270897 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdb5ea3-0c40-4080-aeae-050b0219e561 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:54:58.290239 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-acdb5ea3-0c40-4080-aeae-050b0219e561 None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:54:58.291431 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-acdb5ea3-0c40-4080-aeae-050b0219e561 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:54:58.351330 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1260/2512] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:54:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:54:58.360896 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c532a6a0-de58-4c72-9ebd-2e4595b621a8 None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:54:58.361180 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c532a6a0-de58-4c72-9ebd-2e4595b621a8 None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:54:58.361451 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c532a6a0-de58-4c72-9ebd-2e4595b621a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:54:58.381867 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-c532a6a0-de58-4c72-9ebd-2e4595b621a8 None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:54:58.383044 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-c532a6a0-de58-4c72-9ebd-2e4595b621a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:54:58.390814 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1253/2513] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:54:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:54:58.395082 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdb5ea3-0c40-4080-aeae-050b0219e561 None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:54:58.406057 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdb5ea3-0c40-4080-aeae-050b0219e561 None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:54:58.411326 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3c5777-4407-4afd-9606-59df2683c2ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:54:58.412042 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3c5777-4407-4afd-9606-59df2683c2ef admin admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:54:58.412204 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3c5777-4407-4afd-9606-59df2683c2ef admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:54:58.412475 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3c5777-4407-4afd-9606-59df2683c2ef admin admin] PATH_INFO: `/v3/domains` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:54:58.413134 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3c5777-4407-4afd-9606-59df2683c2ef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:54:58.413572 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3c5777-4407-4afd-9606-59df2683c2ef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:54:58.415223 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3c5777-4407-4afd-9606-59df2683c2ef admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:54:58.428110 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1261/2514] 10.222.0.26 () {58 vars in 1153 bytes} [Wed Aug 24 05:54:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:54:58.432431 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c532a6a0-de58-4c72-9ebd-2e4595b621a8 None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:54:58.442877 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c532a6a0-de58-4c72-9ebd-2e4595b621a8 None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:54:58.447867 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da55b3e-1414-4157-8965-7e6803ad963e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:54:58.448478 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da55b3e-1414-4157-8965-7e6803ad963e admin admin] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:54:58.448758 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da55b3e-1414-4157-8965-7e6803ad963e admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:54:58.449025 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da55b3e-1414-4157-8965-7e6803ad963e admin admin] PATH_INFO: `/v3/projects` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:54:58.449645 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da55b3e-1414-4157-8965-7e6803ad963e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:54:58.451588 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da55b3e-1414-4157-8965-7e6803ad963e admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:54:58.485256 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1254/2515] 10.222.0.26 () {60 vars in 1153 bytes} [Wed Aug 24 05:54:58 2022] POST /identity/v3/projects => generated 385 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:54:58.486632 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3c5777-4407-4afd-9606-59df2683c2ef admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:54:58.497404 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3c5777-4407-4afd-9606-59df2683c2ef admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:54:58.517883 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:54:58.555759 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5827550-e2ec-42e9-846f-89b0c60c3854 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:54:58.556360 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5827550-e2ec-42e9-846f-89b0c60c3854 admin admin] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:54:58.556646 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5827550-e2ec-42e9-846f-89b0c60c3854 admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:54:58.556916 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5827550-e2ec-42e9-846f-89b0c60c3854 admin admin] PATH_INFO: `/v3/users` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:54:58.557543 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5827550-e2ec-42e9-846f-89b0c60c3854 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:54:58.560148 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5827550-e2ec-42e9-846f-89b0c60c3854 admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:54:58.580733 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1262/2516] 10.222.0.26 () {60 vars in 1144 bytes} [Wed Aug 24 05:54:58 2022] POST /identity/v3/users => generated 293 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:54:58.584871 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da55b3e-1414-4157-8965-7e6803ad963e admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:54:58.595675 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da55b3e-1414-4157-8965-7e6803ad963e admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:54:58.600300 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad7d086-489d-4efa-bb16-c967913f1a59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:54:58.600897 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad7d086-489d-4efa-bb16-c967913f1a59 admin admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:54:58.601178 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad7d086-489d-4efa-bb16-c967913f1a59 admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:54:58.601450 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad7d086-489d-4efa-bb16-c967913f1a59 admin admin] PATH_INFO: `/v3/roles` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:54:58.602135 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad7d086-489d-4efa-bb16-c967913f1a59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:54:58.603731 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad7d086-489d-4efa-bb16-c967913f1a59 admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:54:58.614075 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1255/2517] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Aug 24 05:54:58 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:54:58.617797 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5827550-e2ec-42e9-846f-89b0c60c3854 admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:54:58.627754 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5827550-e2ec-42e9-846f-89b0c60c3854 admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:54:58.632427 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88e7a7d-3115-42b6-8116-99ffc19a9268 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:54:58.632959 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88e7a7d-3115-42b6-8116-99ffc19a9268 admin admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:54:58.633243 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88e7a7d-3115-42b6-8116-99ffc19a9268 admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:54:58.633519 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88e7a7d-3115-42b6-8116-99ffc19a9268 admin admin] PATH_INFO: `/v3/roles` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:54:58.634189 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88e7a7d-3115-42b6-8116-99ffc19a9268 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:54:58.635801 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88e7a7d-3115-42b6-8116-99ffc19a9268 admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:54:58.646160 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1263/2518] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Aug 24 05:54:58 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:54:58.650056 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad7d086-489d-4efa-bb16-c967913f1a59 admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:54:58.660353 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad7d086-489d-4efa-bb16-c967913f1a59 admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:54:58.664980 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424b8d52-7a2b-448d-8399-c6528346a703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:54:58.665616 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424b8d52-7a2b-448d-8399-c6528346a703 admin admin] REQUEST_METHOD: `PUT` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:54:58.665896 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424b8d52-7a2b-448d-8399-c6528346a703 admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:54:58.666202 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424b8d52-7a2b-448d-8399-c6528346a703 admin admin] PATH_INFO: `/v3/projects/b11a88e6e806493893931246eb2807c6/users/047d2601293041f7827c76c649fe071a/roles/f7aa4a2c74c94c1b9ca8ecdcccccda5c` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:54:58.682604 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424b8d52-7a2b-448d-8399-c6528346a703 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b11a88e6e806493893931246eb2807c6, user_id=047d2601293041f7827c76c649fe071a, role_id=f7aa4a2c74c94c1b9ca8ecdcccccda5c)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:54:58.685291 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424b8d52-7a2b-448d-8399-c6528346a703 admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:54:58.700646 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1256/2519] 10.222.0.26 () {60 vars in 1483 bytes} [Wed Aug 24 05:54:58 2022] PUT /identity/v3/projects/b11a88e6e806493893931246eb2807c6/users/047d2601293041f7827c76c649fe071a/roles/f7aa4a2c74c94c1b9ca8ecdcccccda5c => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:54:58.710943 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90e0f81-1ff8-454d-9718-41cf2a56bbf5 None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:54:58.711229 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90e0f81-1ff8-454d-9718-41cf2a56bbf5 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:54:58.711526 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90e0f81-1ff8-454d-9718-41cf2a56bbf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:54:58.740139 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-f90e0f81-1ff8-454d-9718-41cf2a56bbf5 None None] MFA Rules not processed for user `047d2601293041f7827c76c649fe071a`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:54:58.741350 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-f90e0f81-1ff8-454d-9718-41cf2a56bbf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:54:58.806590 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1264/2520] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:54:58 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:54:58.811087 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424b8d52-7a2b-448d-8399-c6528346a703 admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:54:58.871882 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424b8d52-7a2b-448d-8399-c6528346a703 admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:54:58.876524 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8319e45-1ecb-4020-8008-ed60eddecff0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:54:58.877122 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8319e45-1ecb-4020-8008-ed60eddecff0 admin admin] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:54:58.877405 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8319e45-1ecb-4020-8008-ed60eddecff0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:54:58.877674 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8319e45-1ecb-4020-8008-ed60eddecff0 admin admin] PATH_INFO: `/v3/projects` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:54:58.878337 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8319e45-1ecb-4020-8008-ed60eddecff0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:54:58.880265 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8319e45-1ecb-4020-8008-ed60eddecff0 admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:54:58.906118 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1257/2521] 10.222.0.26 () {60 vars in 1153 bytes} [Wed Aug 24 05:54:58 2022] POST /identity/v3/projects => generated 385 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 05:54:58.910019 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90e0f81-1ff8-454d-9718-41cf2a56bbf5 None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:54:58.921346 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90e0f81-1ff8-454d-9718-41cf2a56bbf5 None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:54:58.976617 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908208e5-92cf-4611-aa83-332a350c0128 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:54:58.977232 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908208e5-92cf-4611-aa83-332a350c0128 admin admin] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:54:58.977497 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908208e5-92cf-4611-aa83-332a350c0128 admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:54:58.977772 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908208e5-92cf-4611-aa83-332a350c0128 admin admin] PATH_INFO: `/v3/users` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:54:58.978424 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908208e5-92cf-4611-aa83-332a350c0128 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:54:58.980336 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908208e5-92cf-4611-aa83-332a350c0128 admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:54:59.000621 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1265/2522] 10.222.0.26 () {60 vars in 1144 bytes} [Wed Aug 24 05:54:58 2022] POST /identity/v3/users => generated 299 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:54:59.004685 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8319e45-1ecb-4020-8008-ed60eddecff0 admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:54:59.015564 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8319e45-1ecb-4020-8008-ed60eddecff0 admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:54:59.020169 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7acd0d-94c4-4bbb-a6f2-3af0d879d2db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:54:59.020765 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7acd0d-94c4-4bbb-a6f2-3af0d879d2db admin admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:54:59.021042 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7acd0d-94c4-4bbb-a6f2-3af0d879d2db admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:54:59.021316 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7acd0d-94c4-4bbb-a6f2-3af0d879d2db admin admin] PATH_INFO: `/v3/roles` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:54:59.022010 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7acd0d-94c4-4bbb-a6f2-3af0d879d2db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:54:59.023706 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7acd0d-94c4-4bbb-a6f2-3af0d879d2db admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:54:59.034709 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1258/2523] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Aug 24 05:54:59 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:54:59.038719 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908208e5-92cf-4611-aa83-332a350c0128 admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:54:59.048686 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908208e5-92cf-4611-aa83-332a350c0128 admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:54:59.053342 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f446ea-7dc7-48f7-b17c-2d9bb1379215 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:54:59.054067 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f446ea-7dc7-48f7-b17c-2d9bb1379215 admin admin] REQUEST_METHOD: `PUT` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:54:59.054263 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f446ea-7dc7-48f7-b17c-2d9bb1379215 admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:54:59.054544 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f446ea-7dc7-48f7-b17c-2d9bb1379215 admin admin] PATH_INFO: `/v3/projects/3916d4516e5a457f8cf2214086d86c7c/users/db88fc4040274c9599da6b37a948f4e9/roles/640bda0879494e60b72680ee505285f0` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:54:59.069578 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f446ea-7dc7-48f7-b17c-2d9bb1379215 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3916d4516e5a457f8cf2214086d86c7c, user_id=db88fc4040274c9599da6b37a948f4e9, role_id=640bda0879494e60b72680ee505285f0)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:54:59.072270 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f446ea-7dc7-48f7-b17c-2d9bb1379215 admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:54:59.080622 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:54:59.086474 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1266/2524] 10.222.0.26 () {60 vars in 1483 bytes} [Wed Aug 24 05:54:59 2022] PUT /identity/v3/projects/3916d4516e5a457f8cf2214086d86c7c/users/db88fc4040274c9599da6b37a948f4e9/roles/640bda0879494e60b72680ee505285f0 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:54:59.091168 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7acd0d-94c4-4bbb-a6f2-3af0d879d2db admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:54:59.101237 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7acd0d-94c4-4bbb-a6f2-3af0d879d2db admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:54:59.150826 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:54:59.158548 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5c24af-e940-4d97-a833-0ddf7977bb30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:54:59.159420 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5c24af-e940-4d97-a833-0ddf7977bb30 admin admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:54:59.159710 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5c24af-e940-4d97-a833-0ddf7977bb30 admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:54:59.160157 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5c24af-e940-4d97-a833-0ddf7977bb30 admin admin] PATH_INFO: `/v3/roles` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:54:59.161016 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5c24af-e940-4d97-a833-0ddf7977bb30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:54:59.162842 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5c24af-e940-4d97-a833-0ddf7977bb30 admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:54:59.172554 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1259/2525] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Aug 24 05:54:59 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:54:59.176719 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f446ea-7dc7-48f7-b17c-2d9bb1379215 admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:54:59.187024 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f446ea-7dc7-48f7-b17c-2d9bb1379215 admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:54:59.191789 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe3e557-279d-43db-8a9e-762280a0da5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:54:59.192718 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe3e557-279d-43db-8a9e-762280a0da5b admin admin] REQUEST_METHOD: `PUT` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:54:59.193000 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe3e557-279d-43db-8a9e-762280a0da5b admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:54:59.193274 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe3e557-279d-43db-8a9e-762280a0da5b admin admin] PATH_INFO: `/v3/projects/3916d4516e5a457f8cf2214086d86c7c/users/db88fc4040274c9599da6b37a948f4e9/roles/640bda0879494e60b72680ee505285f0` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:54:59.195261 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe3e557-279d-43db-8a9e-762280a0da5b admin admin] RBAC: Authorizing `identity:create_grant(project_id=3916d4516e5a457f8cf2214086d86c7c, user_id=db88fc4040274c9599da6b37a948f4e9, role_id=640bda0879494e60b72680ee505285f0)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:54:59.197884 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe3e557-279d-43db-8a9e-762280a0da5b admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:54:59.208249 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1267/2526] 10.222.0.26 () {60 vars in 1483 bytes} [Wed Aug 24 05:54:59 2022] PUT /identity/v3/projects/3916d4516e5a457f8cf2214086d86c7c/users/db88fc4040274c9599da6b37a948f4e9/roles/640bda0879494e60b72680ee505285f0 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:54:59.218693 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dcb123-f54e-4ce2-a062-d4cdd16a98ee None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:54:59.218980 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dcb123-f54e-4ce2-a062-d4cdd16a98ee None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:54:59.219255 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dcb123-f54e-4ce2-a062-d4cdd16a98ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:54:59.245607 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-c6dcb123-f54e-4ce2-a062-d4cdd16a98ee None None] MFA Rules not processed for user `db88fc4040274c9599da6b37a948f4e9`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:54:59.246834 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-c6dcb123-f54e-4ce2-a062-d4cdd16a98ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:54:59.312042 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1260/2527] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:54:59 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:54:59.323493 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe3e557-279d-43db-8a9e-762280a0da5b admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:54:59.325783 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-2fe3e557-279d-43db-8a9e-762280a0da5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:54:59.383908 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe3e557-279d-43db-8a9e-762280a0da5b admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:54:59.388102 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8de7561-5493-4cdd-9107-ee7cf84d7f4e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17b450afe795495680fc70f522c83750', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:54:59.388689 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8de7561-5493-4cdd-9107-ee7cf84d7f4e service cinder] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:54:59.388962 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8de7561-5493-4cdd-9107-ee7cf84d7f4e service cinder] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:54:59.389226 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8de7561-5493-4cdd-9107-ee7cf84d7f4e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:54:59.398227 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8de7561-5493-4cdd-9107-ee7cf84d7f4e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:54:59.399647 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8de7561-5493-4cdd-9107-ee7cf84d7f4e service cinder] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:54:59.408890 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1268/2528] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 24 05:54:59 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:54:59.953286 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dcb123-f54e-4ce2-a062-d4cdd16a98ee None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:55:00.017639 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dcb123-f54e-4ce2-a062-d4cdd16a98ee None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:55:00.022209 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc7ff12-6a0e-4c13-ab37-a1dd0586fda5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:55:00.022847 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc7ff12-6a0e-4c13-ab37-a1dd0586fda5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:55:00.023126 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc7ff12-6a0e-4c13-ab37-a1dd0586fda5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:55:00.023397 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc7ff12-6a0e-4c13-ab37-a1dd0586fda5 admin admin] PATH_INFO: `/v3/users/047d2601293041f7827c76c649fe071a` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:55:00.024548 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc7ff12-6a0e-4c13-ab37-a1dd0586fda5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=047d2601293041f7827c76c649fe071a)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:55:00.026516 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc7ff12-6a0e-4c13-ab37-a1dd0586fda5 admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:55:00.075476 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-4fc7ff12-6a0e-4c13-ab37-a1dd0586fda5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '047d2601293041f7827c76c649fe071a'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:55:00.082549 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-4fc7ff12-6a0e-4c13-ab37-a1dd0586fda5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '047d2601293041f7827c76c649fe071a'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:55:00.095092 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-4fc7ff12-6a0e-4c13-ab37-a1dd0586fda5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '047d2601293041f7827c76c649fe071a'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:55:00.102159 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-4fc7ff12-6a0e-4c13-ab37-a1dd0586fda5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '047d2601293041f7827c76c649fe071a'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:55:00.102879 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-4fc7ff12-6a0e-4c13-ab37-a1dd0586fda5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '047d2601293041f7827c76c649fe071a'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:55:00.104441 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:55:00.110821 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1261/2529] 10.222.0.26 () {58 vars in 1224 bytes} [Wed Aug 24 05:54:59 2022] DELETE /identity/v3/users/047d2601293041f7827c76c649fe071a => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:55:00.115683 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c78019-a211-45e3-ac72-9af4bf6371b8 None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:55:00.116008 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c78019-a211-45e3-ac72-9af4bf6371b8 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:55:00.116281 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c78019-a211-45e3-ac72-9af4bf6371b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:55:00.135771 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-17c78019-a211-45e3-ac72-9af4bf6371b8 None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:55:00.137585 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-17c78019-a211-45e3-ac72-9af4bf6371b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:55:00.207535 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1269/2530] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:55:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 05:55:00.217491 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc7ff12-6a0e-4c13-ab37-a1dd0586fda5 admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:55:00.219013 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-4fc7ff12-6a0e-4c13-ab37-a1dd0586fda5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:55:00.283131 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc7ff12-6a0e-4c13-ab37-a1dd0586fda5 admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:55:00.286877 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67310134-3663-4e45-b770-5dc022a907e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '874348b647194ac2b5ecbf12c33bf59e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:55:00.287487 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67310134-3663-4e45-b770-5dc022a907e4 service neutron] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:55:00.287766 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67310134-3663-4e45-b770-5dc022a907e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:55:00.288033 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67310134-3663-4e45-b770-5dc022a907e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:55:00.297156 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67310134-3663-4e45-b770-5dc022a907e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:55:00.298635 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67310134-3663-4e45-b770-5dc022a907e4 service neutron] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:55:00.309666 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1262/2531] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 24 05:55:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:55:00.623265 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c78019-a211-45e3-ac72-9af4bf6371b8 None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:55:00.624846 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-17c78019-a211-45e3-ac72-9af4bf6371b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:55:00.638036 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c78019-a211-45e3-ac72-9af4bf6371b8 None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:55:00.642743 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b28f783-4e85-44b3-9837-26808f9fb3ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:55:00.643467 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b28f783-4e85-44b3-9837-26808f9fb3ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:55:00.643752 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b28f783-4e85-44b3-9837-26808f9fb3ee admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:55:00.644021 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b28f783-4e85-44b3-9837-26808f9fb3ee admin admin] PATH_INFO: `/v3/projects/b11a88e6e806493893931246eb2807c6` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:55:00.645191 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b28f783-4e85-44b3-9837-26808f9fb3ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=b11a88e6e806493893931246eb2807c6)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:55:00.647854 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b28f783-4e85-44b3-9837-26808f9fb3ee admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:55:00.697873 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-6b28f783-4e85-44b3-9837-26808f9fb3ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b11a88e6e806493893931246eb2807c6', 'request_id': 'req-6b28f783-4e85-44b3-9837-26808f9fb3ee'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:55:00.706281 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-6b28f783-4e85-44b3-9837-26808f9fb3ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b11a88e6e806493893931246eb2807c6', 'request_id': 'req-6b28f783-4e85-44b3-9837-26808f9fb3ee'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:55:00.712766 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-6b28f783-4e85-44b3-9837-26808f9fb3ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b11a88e6e806493893931246eb2807c6', 'request_id': 'req-6b28f783-4e85-44b3-9837-26808f9fb3ee'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:55:00.724412 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-6b28f783-4e85-44b3-9837-26808f9fb3ee admin admin] The token cache is being invalidate because project b11a88e6e806493893931246eb2807c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:55:00.724697 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-6b28f783-4e85-44b3-9837-26808f9fb3ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:55:00.725345 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-6b28f783-4e85-44b3-9837-26808f9fb3ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:55:00.726885 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1270/2532] 10.222.0.26 () {58 vars in 1233 bytes} [Wed Aug 24 05:55:00 2022] DELETE /identity/v3/projects/b11a88e6e806493893931246eb2807c6 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:55:00.731701 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67310134-3663-4e45-b770-5dc022a907e4 service neutron] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:55:00.741737 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67310134-3663-4e45-b770-5dc022a907e4 service neutron] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:55:00.803135 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb971f2-3a1f-4241-b385-7fcdbc72a593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:55:00.804053 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb971f2-3a1f-4241-b385-7fcdbc72a593 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:55:00.804300 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb971f2-3a1f-4241-b385-7fcdbc72a593 admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:55:00.804580 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb971f2-3a1f-4241-b385-7fcdbc72a593 admin admin] PATH_INFO: `/v3/users/db88fc4040274c9599da6b37a948f4e9` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:55:00.806353 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb971f2-3a1f-4241-b385-7fcdbc72a593 admin admin] RBAC: Authorizing `identity:delete_user(user_id=db88fc4040274c9599da6b37a948f4e9)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:55:00.808461 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb971f2-3a1f-4241-b385-7fcdbc72a593 admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:55:00.856557 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-acb971f2-3a1f-4241-b385-7fcdbc72a593 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db88fc4040274c9599da6b37a948f4e9'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:55:00.864143 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-acb971f2-3a1f-4241-b385-7fcdbc72a593 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db88fc4040274c9599da6b37a948f4e9'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:55:00.877439 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-acb971f2-3a1f-4241-b385-7fcdbc72a593 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db88fc4040274c9599da6b37a948f4e9'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:55:00.885476 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-acb971f2-3a1f-4241-b385-7fcdbc72a593 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db88fc4040274c9599da6b37a948f4e9'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:55:00.886143 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-acb971f2-3a1f-4241-b385-7fcdbc72a593 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db88fc4040274c9599da6b37a948f4e9'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:55:00.892867 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1263/2533] 10.222.0.26 () {58 vars in 1224 bytes} [Wed Aug 24 05:55:00 2022] DELETE /identity/v3/users/db88fc4040274c9599da6b37a948f4e9 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:55:01.215885 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b28f783-4e85-44b3-9837-26808f9fb3ee admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:55:01.217354 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-6b28f783-4e85-44b3-9837-26808f9fb3ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:55:01.235171 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b28f783-4e85-44b3-9837-26808f9fb3ee admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:55:01.247947 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:55:01.307228 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ebd7a3-fc4e-4da6-baf7-2802e333151b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:55:01.307868 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ebd7a3-fc4e-4da6-baf7-2802e333151b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:55:01.308153 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ebd7a3-fc4e-4da6-baf7-2802e333151b admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:55:01.309035 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ebd7a3-fc4e-4da6-baf7-2802e333151b admin admin] PATH_INFO: `/v3/projects/3916d4516e5a457f8cf2214086d86c7c` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:55:01.310217 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ebd7a3-fc4e-4da6-baf7-2802e333151b admin admin] RBAC: Authorizing `identity:delete_project(project_id=3916d4516e5a457f8cf2214086d86c7c)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:55:01.312138 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ebd7a3-fc4e-4da6-baf7-2802e333151b admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:55:01.358698 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-90ebd7a3-fc4e-4da6-baf7-2802e333151b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3916d4516e5a457f8cf2214086d86c7c', 'request_id': 'req-90ebd7a3-fc4e-4da6-baf7-2802e333151b'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:55:01.366192 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-90ebd7a3-fc4e-4da6-baf7-2802e333151b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3916d4516e5a457f8cf2214086d86c7c', 'request_id': 'req-90ebd7a3-fc4e-4da6-baf7-2802e333151b'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:55:01.373181 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-90ebd7a3-fc4e-4da6-baf7-2802e333151b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3916d4516e5a457f8cf2214086d86c7c', 'request_id': 'req-90ebd7a3-fc4e-4da6-baf7-2802e333151b'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:55:01.384308 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-90ebd7a3-fc4e-4da6-baf7-2802e333151b admin admin] The token cache is being invalidate because project 3916d4516e5a457f8cf2214086d86c7c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:55:01.384607 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-90ebd7a3-fc4e-4da6-baf7-2802e333151b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:55:01.385308 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-90ebd7a3-fc4e-4da6-baf7-2802e333151b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:55:01.387157 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1271/2534] 10.222.0.26 () {58 vars in 1233 bytes} [Wed Aug 24 05:55:01 2022] DELETE /identity/v3/projects/3916d4516e5a457f8cf2214086d86c7c => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:55:01.391789 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19620ea-5e23-40d4-bfa3-18c7b88a2c50 None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:55:01.392261 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19620ea-5e23-40d4-bfa3-18c7b88a2c50 None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:55:01.392360 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19620ea-5e23-40d4-bfa3-18c7b88a2c50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:55:01.412205 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-e19620ea-5e23-40d4-bfa3-18c7b88a2c50 None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:55:01.413439 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-e19620ea-5e23-40d4-bfa3-18c7b88a2c50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:55:01.427326 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:55:01.475731 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1264/2535] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:55:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:55:01.484343 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e575b802-e80f-4741-94f6-f5f4f1d62eb4 None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:55:01.484795 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e575b802-e80f-4741-94f6-f5f4f1d62eb4 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:55:01.485143 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e575b802-e80f-4741-94f6-f5f4f1d62eb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:55:01.507911 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-e575b802-e80f-4741-94f6-f5f4f1d62eb4 None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:55:01.509064 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-e575b802-e80f-4741-94f6-f5f4f1d62eb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:55:01.517228 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1272/2536] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:55:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:55:01.521601 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19620ea-5e23-40d4-bfa3-18c7b88a2c50 None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:55:01.531431 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19620ea-5e23-40d4-bfa3-18c7b88a2c50 None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:55:01.537195 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0093ff-1e5d-4790-ae4b-76ca38207dad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:55:01.537819 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0093ff-1e5d-4790-ae4b-76ca38207dad admin admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:55:01.538142 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0093ff-1e5d-4790-ae4b-76ca38207dad admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:55:01.538419 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0093ff-1e5d-4790-ae4b-76ca38207dad admin admin] PATH_INFO: `/v3/domains` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:55:01.539078 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0093ff-1e5d-4790-ae4b-76ca38207dad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:55:01.539879 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0093ff-1e5d-4790-ae4b-76ca38207dad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:55:01.542057 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0093ff-1e5d-4790-ae4b-76ca38207dad admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:55:01.554976 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1265/2537] 10.222.0.26 () {58 vars in 1153 bytes} [Wed Aug 24 05:55:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:55:01.559972 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e575b802-e80f-4741-94f6-f5f4f1d62eb4 None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:55:01.569829 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e575b802-e80f-4741-94f6-f5f4f1d62eb4 None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:55:01.574947 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a65fd3b-052b-4d82-84b0-37cbdfb30565 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:55:01.575467 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a65fd3b-052b-4d82-84b0-37cbdfb30565 admin admin] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:55:01.575750 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a65fd3b-052b-4d82-84b0-37cbdfb30565 admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:55:01.576025 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a65fd3b-052b-4d82-84b0-37cbdfb30565 admin admin] PATH_INFO: `/v3/projects` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:55:01.576667 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a65fd3b-052b-4d82-84b0-37cbdfb30565 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:55:01.578626 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a65fd3b-052b-4d82-84b0-37cbdfb30565 admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:55:01.606605 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1273/2538] 10.222.0.26 () {60 vars in 1153 bytes} [Wed Aug 24 05:55:01 2022] POST /identity/v3/projects => generated 377 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:55:01.610786 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0093ff-1e5d-4790-ae4b-76ca38207dad admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:55:01.621340 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0093ff-1e5d-4790-ae4b-76ca38207dad admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:55:01.678939 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd4be47-c240-48bd-bcc4-64ae8cfadd90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:55:01.679545 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd4be47-c240-48bd-bcc4-64ae8cfadd90 admin admin] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:55:01.679823 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd4be47-c240-48bd-bcc4-64ae8cfadd90 admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:55:01.680093 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd4be47-c240-48bd-bcc4-64ae8cfadd90 admin admin] PATH_INFO: `/v3/users` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:55:01.680710 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd4be47-c240-48bd-bcc4-64ae8cfadd90 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:55:01.682690 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd4be47-c240-48bd-bcc4-64ae8cfadd90 admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:55:01.703520 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1266/2539] 10.222.0.26 () {60 vars in 1144 bytes} [Wed Aug 24 05:55:01 2022] POST /identity/v3/users => generated 289 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:55:01.707768 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a65fd3b-052b-4d82-84b0-37cbdfb30565 admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:55:01.718805 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a65fd3b-052b-4d82-84b0-37cbdfb30565 admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:55:01.723448 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ba2b08-aa23-41ee-b0c4-5ca3ad22406a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:55:01.724044 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ba2b08-aa23-41ee-b0c4-5ca3ad22406a admin admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:55:01.724327 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ba2b08-aa23-41ee-b0c4-5ca3ad22406a admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:55:01.724604 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ba2b08-aa23-41ee-b0c4-5ca3ad22406a admin admin] PATH_INFO: `/v3/roles` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:55:01.725249 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ba2b08-aa23-41ee-b0c4-5ca3ad22406a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:55:01.726884 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ba2b08-aa23-41ee-b0c4-5ca3ad22406a admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:55:01.737289 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1274/2540] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Aug 24 05:55:01 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:55:01.741260 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd4be47-c240-48bd-bcc4-64ae8cfadd90 admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:55:01.751284 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd4be47-c240-48bd-bcc4-64ae8cfadd90 admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:55:01.755899 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098d9056-9af3-406a-9d17-c03b367567b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:55:01.756519 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098d9056-9af3-406a-9d17-c03b367567b9 admin admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:55:01.756808 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098d9056-9af3-406a-9d17-c03b367567b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:55:01.757081 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098d9056-9af3-406a-9d17-c03b367567b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:55:01.757722 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098d9056-9af3-406a-9d17-c03b367567b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:55:01.759400 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098d9056-9af3-406a-9d17-c03b367567b9 admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:55:01.769823 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1267/2541] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Aug 24 05:55:01 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 05:55:01.773742 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ba2b08-aa23-41ee-b0c4-5ca3ad22406a admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:55:01.784136 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ba2b08-aa23-41ee-b0c4-5ca3ad22406a admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:55:01.788772 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004270dd-fe1a-4435-b553-fb8d38862812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:55:01.789405 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004270dd-fe1a-4435-b553-fb8d38862812 admin admin] REQUEST_METHOD: `PUT` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:55:01.789688 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004270dd-fe1a-4435-b553-fb8d38862812 admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:55:01.789984 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004270dd-fe1a-4435-b553-fb8d38862812 admin admin] PATH_INFO: `/v3/projects/1e50a1f8131e49a79569b8f003cc28f7/users/3a74f48808fb4e83ac5ddfe98224c530/roles/f7aa4a2c74c94c1b9ca8ecdcccccda5c` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:55:01.805190 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004270dd-fe1a-4435-b553-fb8d38862812 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e50a1f8131e49a79569b8f003cc28f7, user_id=3a74f48808fb4e83ac5ddfe98224c530, role_id=f7aa4a2c74c94c1b9ca8ecdcccccda5c)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:55:01.807944 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004270dd-fe1a-4435-b553-fb8d38862812 admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:55:01.820077 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1275/2542] 10.222.0.26 () {60 vars in 1483 bytes} [Wed Aug 24 05:55:01 2022] PUT /identity/v3/projects/1e50a1f8131e49a79569b8f003cc28f7/users/3a74f48808fb4e83ac5ddfe98224c530/roles/f7aa4a2c74c94c1b9ca8ecdcccccda5c => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:55:01.830511 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9983c1-c9aa-4cc8-b208-17aebb8e4e70 None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:55:01.830798 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9983c1-c9aa-4cc8-b208-17aebb8e4e70 None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:55:01.831074 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9983c1-c9aa-4cc8-b208-17aebb8e4e70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:55:01.858766 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-1d9983c1-c9aa-4cc8-b208-17aebb8e4e70 None None] MFA Rules not processed for user `3a74f48808fb4e83ac5ddfe98224c530`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:55:01.859996 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-1d9983c1-c9aa-4cc8-b208-17aebb8e4e70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:55:01.922323 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1268/2543] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:55:01 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:55:01.934133 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004270dd-fe1a-4435-b553-fb8d38862812 admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:55:01.935848 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-004270dd-fe1a-4435-b553-fb8d38862812 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:55:01.978147 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:55:01.994433 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004270dd-fe1a-4435-b553-fb8d38862812 admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:55:01.998232 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24656631-0a6e-437d-a7d7-01ead7c260b8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f856958add7474a989325cea7b1b224', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:55:01.998830 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24656631-0a6e-437d-a7d7-01ead7c260b8 service glance] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:55:01.999144 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24656631-0a6e-437d-a7d7-01ead7c260b8 service glance] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:55:01.999393 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24656631-0a6e-437d-a7d7-01ead7c260b8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:55:02.007609 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24656631-0a6e-437d-a7d7-01ead7c260b8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:55:02.009041 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24656631-0a6e-437d-a7d7-01ead7c260b8 service glance] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:55:02.018394 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1276/2544] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 24 05:55:01 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:55:11.919356 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=90,keystone:INSERT=3 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:55:12.014746 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=9 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:55:14.674179 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9983c1-c9aa-4cc8-b208-17aebb8e4e70 None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:55:14.675592 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-1d9983c1-c9aa-4cc8-b208-17aebb8e4e70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:55:14.731605 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9983c1-c9aa-4cc8-b208-17aebb8e4e70 None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:55:14.735171 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed65554-802e-414a-a425-b9e1db8dbbad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '874348b647194ac2b5ecbf12c33bf59e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:55:14.735781 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed65554-802e-414a-a425-b9e1db8dbbad service neutron] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:55:14.736067 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed65554-802e-414a-a425-b9e1db8dbbad service neutron] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:55:14.736343 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed65554-802e-414a-a425-b9e1db8dbbad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:55:14.738102 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-9ed65554-802e-414a-a425-b9e1db8dbbad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:55:14.798527 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed65554-802e-414a-a425-b9e1db8dbbad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:55:14.799884 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed65554-802e-414a-a425-b9e1db8dbbad service neutron] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:55:14.809648 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1269/2545] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 24 05:55:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:55:17.905048 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24656631-0a6e-437d-a7d7-01ead7c260b8 service glance] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:55:17.906691 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-24656631-0a6e-437d-a7d7-01ead7c260b8 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:55:17.924466 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24656631-0a6e-437d-a7d7-01ead7c260b8 service glance] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:55:17.929229 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1164e08-5333-4d38-966d-3ac18fffeabb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:55:17.929850 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1164e08-5333-4d38-966d-3ac18fffeabb admin admin] REQUEST_METHOD: `DELETE` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:55:17.930162 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1164e08-5333-4d38-966d-3ac18fffeabb admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:55:17.930567 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1164e08-5333-4d38-966d-3ac18fffeabb admin admin] PATH_INFO: `/v3/users/568d477011b84cc89b9285b5172d091f` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:55:17.931801 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1164e08-5333-4d38-966d-3ac18fffeabb admin admin] RBAC: Authorizing `identity:delete_user(user_id=568d477011b84cc89b9285b5172d091f)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:55:17.933862 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1164e08-5333-4d38-966d-3ac18fffeabb admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:55:17.987144 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-f1164e08-5333-4d38-966d-3ac18fffeabb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '568d477011b84cc89b9285b5172d091f'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:55:17.994381 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-f1164e08-5333-4d38-966d-3ac18fffeabb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '568d477011b84cc89b9285b5172d091f'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:55:17.995053 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-f1164e08-5333-4d38-966d-3ac18fffeabb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '568d477011b84cc89b9285b5172d091f'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:55:18.012822 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-f1164e08-5333-4d38-966d-3ac18fffeabb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '568d477011b84cc89b9285b5172d091f'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:55:18.022695 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-f1164e08-5333-4d38-966d-3ac18fffeabb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '568d477011b84cc89b9285b5172d091f'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:55:18.030414 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1277/2546] 10.222.0.26 () {58 vars in 1224 bytes} [Wed Aug 24 05:55:17 2022] DELETE /identity/v3/users/568d477011b84cc89b9285b5172d091f => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:55:18.203469 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed65554-802e-414a-a425-b9e1db8dbbad service neutron] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:55:18.215657 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed65554-802e-414a-a425-b9e1db8dbbad service neutron] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:55:18.276303 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1937d48-4d85-448f-ae9b-59d82d4635aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:55:18.276937 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1937d48-4d85-448f-ae9b-59d82d4635aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:55:18.277213 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1937d48-4d85-448f-ae9b-59d82d4635aa admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:55:18.277483 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1937d48-4d85-448f-ae9b-59d82d4635aa admin admin] PATH_INFO: `/v3/projects/70285544fbc045ea8c685e7f84309fdc` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:55:18.279901 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1937d48-4d85-448f-ae9b-59d82d4635aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=70285544fbc045ea8c685e7f84309fdc)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:55:18.282270 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1937d48-4d85-448f-ae9b-59d82d4635aa admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:55:18.329277 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-a1937d48-4d85-448f-ae9b-59d82d4635aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '70285544fbc045ea8c685e7f84309fdc', 'request_id': 'req-a1937d48-4d85-448f-ae9b-59d82d4635aa'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:55:18.331753 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:55:18.336955 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-a1937d48-4d85-448f-ae9b-59d82d4635aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '70285544fbc045ea8c685e7f84309fdc', 'request_id': 'req-a1937d48-4d85-448f-ae9b-59d82d4635aa'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:55:18.345115 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-a1937d48-4d85-448f-ae9b-59d82d4635aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '70285544fbc045ea8c685e7f84309fdc', 'request_id': 'req-a1937d48-4d85-448f-ae9b-59d82d4635aa'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:55:18.355671 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-a1937d48-4d85-448f-ae9b-59d82d4635aa admin admin] The token cache is being invalidate because project 70285544fbc045ea8c685e7f84309fdc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88112) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:55:18.355962 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-a1937d48-4d85-448f-ae9b-59d82d4635aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:55:18.356588 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-a1937d48-4d85-448f-ae9b-59d82d4635aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:55:18.358080 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1270/2547] 10.222.0.26 () {58 vars in 1233 bytes} [Wed Aug 24 05:55:18 2022] DELETE /identity/v3/projects/70285544fbc045ea8c685e7f84309fdc => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:55:18.363041 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741d6de5-6e95-4457-8c5a-5568bf423fe8 None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:55:18.363330 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741d6de5-6e95-4457-8c5a-5568bf423fe8 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:55:18.363608 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741d6de5-6e95-4457-8c5a-5568bf423fe8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:55:18.384259 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-741d6de5-6e95-4457-8c5a-5568bf423fe8 None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:55:18.385405 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-741d6de5-6e95-4457-8c5a-5568bf423fe8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:55:18.443575 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1278/2548] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:55:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:55:18.452776 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b4ada0-5580-4c2a-a77b-020c5eaad9ee None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:55:18.453064 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b4ada0-5580-4c2a-a77b-020c5eaad9ee None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:55:18.453338 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b4ada0-5580-4c2a-a77b-020c5eaad9ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:55:18.473497 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-54b4ada0-5580-4c2a-a77b-020c5eaad9ee None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:55:18.474728 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-54b4ada0-5580-4c2a-a77b-020c5eaad9ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:55:18.483091 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1271/2549] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:55:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:55:18.487238 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741d6de5-6e95-4457-8c5a-5568bf423fe8 None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:55:18.497472 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741d6de5-6e95-4457-8c5a-5568bf423fe8 None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:55:18.502067 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bd8a03-7ca7-4b94-a9ed-42a13bb8c164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:55:18.502661 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bd8a03-7ca7-4b94-a9ed-42a13bb8c164 admin admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:55:18.502938 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bd8a03-7ca7-4b94-a9ed-42a13bb8c164 admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:55:18.503207 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bd8a03-7ca7-4b94-a9ed-42a13bb8c164 admin admin] PATH_INFO: `/v3/domains` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:55:18.503848 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bd8a03-7ca7-4b94-a9ed-42a13bb8c164 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:55:18.504148 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bd8a03-7ca7-4b94-a9ed-42a13bb8c164 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:55:18.505751 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bd8a03-7ca7-4b94-a9ed-42a13bb8c164 admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:55:18.517900 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1279/2550] 10.222.0.26 () {58 vars in 1153 bytes} [Wed Aug 24 05:55:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:55:18.522096 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b4ada0-5580-4c2a-a77b-020c5eaad9ee None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:55:18.531291 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b4ada0-5580-4c2a-a77b-020c5eaad9ee None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:55:18.536024 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e97263-9b67-4f10-af70-344c74a85f8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:55:18.536619 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e97263-9b67-4f10-af70-344c74a85f8f admin admin] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:55:18.536893 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e97263-9b67-4f10-af70-344c74a85f8f admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:55:18.537159 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e97263-9b67-4f10-af70-344c74a85f8f admin admin] PATH_INFO: `/v3/projects` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:55:18.537775 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e97263-9b67-4f10-af70-344c74a85f8f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:55:18.539698 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e97263-9b67-4f10-af70-344c74a85f8f admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:55:18.568188 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1272/2551] 10.222.0.26 () {60 vars in 1153 bytes} [Wed Aug 24 05:55:18 2022] POST /identity/v3/projects => generated 365 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:55:18.571239 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bd8a03-7ca7-4b94-a9ed-42a13bb8c164 admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:55:18.581036 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bd8a03-7ca7-4b94-a9ed-42a13bb8c164 admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:55:18.637360 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096b83fa-b6f8-46b9-ae35-3797fadaeefb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:55:18.637973 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096b83fa-b6f8-46b9-ae35-3797fadaeefb admin admin] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:55:18.638259 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096b83fa-b6f8-46b9-ae35-3797fadaeefb admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:55:18.638530 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096b83fa-b6f8-46b9-ae35-3797fadaeefb admin admin] PATH_INFO: `/v3/users` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:55:18.639182 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096b83fa-b6f8-46b9-ae35-3797fadaeefb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:55:18.641086 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096b83fa-b6f8-46b9-ae35-3797fadaeefb admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:55:18.649217 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:55:18.663991 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1280/2552] 10.222.0.26 () {60 vars in 1144 bytes} [Wed Aug 24 05:55:18 2022] POST /identity/v3/users => generated 283 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:55:18.668870 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e97263-9b67-4f10-af70-344c74a85f8f admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:55:18.679600 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e97263-9b67-4f10-af70-344c74a85f8f admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:55:18.684840 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9a134a-7946-48a2-bc05-705ee8c03fc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:55:18.685468 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9a134a-7946-48a2-bc05-705ee8c03fc7 admin admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:55:18.685725 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9a134a-7946-48a2-bc05-705ee8c03fc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:55:18.686025 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9a134a-7946-48a2-bc05-705ee8c03fc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:55:18.686673 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9a134a-7946-48a2-bc05-705ee8c03fc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:55:18.688253 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9a134a-7946-48a2-bc05-705ee8c03fc7 admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:55:18.698815 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1273/2553] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Aug 24 05:55:18 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:55:18.702729 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096b83fa-b6f8-46b9-ae35-3797fadaeefb admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:55:18.712548 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096b83fa-b6f8-46b9-ae35-3797fadaeefb admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:55:18.717113 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac99fbcc-dfc9-45c2-9636-587f60006a00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:55:18.717706 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac99fbcc-dfc9-45c2-9636-587f60006a00 admin admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:55:18.718012 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac99fbcc-dfc9-45c2-9636-587f60006a00 admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:55:18.718290 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac99fbcc-dfc9-45c2-9636-587f60006a00 admin admin] PATH_INFO: `/v3/roles` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:55:18.718928 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac99fbcc-dfc9-45c2-9636-587f60006a00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:55:18.720512 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac99fbcc-dfc9-45c2-9636-587f60006a00 admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:55:18.731441 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1281/2554] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Aug 24 05:55:18 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:55:18.735657 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9a134a-7946-48a2-bc05-705ee8c03fc7 admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:55:18.745551 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9a134a-7946-48a2-bc05-705ee8c03fc7 admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:55:18.750927 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62a23c0-5a5e-413a-a208-dfbf5b36d2b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:55:18.751575 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62a23c0-5a5e-413a-a208-dfbf5b36d2b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:55:18.751856 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62a23c0-5a5e-413a-a208-dfbf5b36d2b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:55:18.752123 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62a23c0-5a5e-413a-a208-dfbf5b36d2b8 admin admin] PATH_INFO: `/v3/projects/813900eb3b1c4f8ca04768433d459dcf/users/dd3c2f58d2bf4e8c85ad702a69f07750/roles/f7aa4a2c74c94c1b9ca8ecdcccccda5c` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:55:18.766435 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62a23c0-5a5e-413a-a208-dfbf5b36d2b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=813900eb3b1c4f8ca04768433d459dcf, user_id=dd3c2f58d2bf4e8c85ad702a69f07750, role_id=f7aa4a2c74c94c1b9ca8ecdcccccda5c)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:55:18.769065 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62a23c0-5a5e-413a-a208-dfbf5b36d2b8 admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:55:18.781514 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1274/2555] 10.222.0.26 () {60 vars in 1483 bytes} [Wed Aug 24 05:55:18 2022] PUT /identity/v3/projects/813900eb3b1c4f8ca04768433d459dcf/users/dd3c2f58d2bf4e8c85ad702a69f07750/roles/f7aa4a2c74c94c1b9ca8ecdcccccda5c => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:55:18.792061 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41194810-5453-4157-a4ed-9335a7c32e0a None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:55:18.792386 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41194810-5453-4157-a4ed-9335a7c32e0a None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:55:18.793182 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41194810-5453-4157-a4ed-9335a7c32e0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:55:18.821306 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-41194810-5453-4157-a4ed-9335a7c32e0a None None] MFA Rules not processed for user `dd3c2f58d2bf4e8c85ad702a69f07750`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:55:18.822553 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-41194810-5453-4157-a4ed-9335a7c32e0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:55:18.884880 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1282/2556] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:55:18 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:55:18.895718 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62a23c0-5a5e-413a-a208-dfbf5b36d2b8 admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:55:18.897378 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-d62a23c0-5a5e-413a-a208-dfbf5b36d2b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:55:18.953708 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62a23c0-5a5e-413a-a208-dfbf5b36d2b8 admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:55:18.957358 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affbc80b-8d7d-4346-b5cf-bcccf966e09a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17b450afe795495680fc70f522c83750', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:55:18.957976 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affbc80b-8d7d-4346-b5cf-bcccf966e09a service cinder] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:55:18.958269 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affbc80b-8d7d-4346-b5cf-bcccf966e09a service cinder] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:55:18.958545 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affbc80b-8d7d-4346-b5cf-bcccf966e09a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:55:18.967366 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affbc80b-8d7d-4346-b5cf-bcccf966e09a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:55:18.968794 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affbc80b-8d7d-4346-b5cf-bcccf966e09a service cinder] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:55:18.977545 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1275/2557] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 24 05:55:18 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:55:20.711117 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41194810-5453-4157-a4ed-9335a7c32e0a None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:55:20.712516 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-41194810-5453-4157-a4ed-9335a7c32e0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:55:20.776626 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41194810-5453-4157-a4ed-9335a7c32e0a None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:55:20.781666 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3747c696-da10-4240-90ce-45b437c55a61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:55:20.782324 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3747c696-da10-4240-90ce-45b437c55a61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:55:20.782605 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3747c696-da10-4240-90ce-45b437c55a61 admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:55:20.782880 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3747c696-da10-4240-90ce-45b437c55a61 admin admin] PATH_INFO: `/v3/users/3a74f48808fb4e83ac5ddfe98224c530` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:55:20.784061 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3747c696-da10-4240-90ce-45b437c55a61 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a74f48808fb4e83ac5ddfe98224c530)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:55:20.785932 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3747c696-da10-4240-90ce-45b437c55a61 admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:55:20.830302 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-3747c696-da10-4240-90ce-45b437c55a61 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a74f48808fb4e83ac5ddfe98224c530'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:55:20.837081 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-3747c696-da10-4240-90ce-45b437c55a61 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a74f48808fb4e83ac5ddfe98224c530'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:55:20.837742 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-3747c696-da10-4240-90ce-45b437c55a61 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a74f48808fb4e83ac5ddfe98224c530'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:55:20.848413 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:INSERT=3,keystone:SELECT=89,keystone:DELETE=8 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:55:20.851104 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-3747c696-da10-4240-90ce-45b437c55a61 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a74f48808fb4e83ac5ddfe98224c530'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:55:20.859415 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-3747c696-da10-4240-90ce-45b437c55a61 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a74f48808fb4e83ac5ddfe98224c530'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:55:20.865191 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1283/2558] 10.222.0.26 () {58 vars in 1224 bytes} [Wed Aug 24 05:55:20 2022] DELETE /identity/v3/users/3a74f48808fb4e83ac5ddfe98224c530 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:55:20.869881 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa724e40-f834-4bcf-aa58-1d7495d8449a None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:55:20.870383 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa724e40-f834-4bcf-aa58-1d7495d8449a None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:55:20.870604 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa724e40-f834-4bcf-aa58-1d7495d8449a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:55:20.889443 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-aa724e40-f834-4bcf-aa58-1d7495d8449a None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:55:20.890681 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-aa724e40-f834-4bcf-aa58-1d7495d8449a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:55:20.947842 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1276/2559] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:55:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:55:20.957850 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3747c696-da10-4240-90ce-45b437c55a61 admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:55:20.959373 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-3747c696-da10-4240-90ce-45b437c55a61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:55:21.015091 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3747c696-da10-4240-90ce-45b437c55a61 admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:55:21.018715 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9815cbac-40fd-45c4-9600-e2c0e7324e8b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '874348b647194ac2b5ecbf12c33bf59e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:55:21.019311 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9815cbac-40fd-45c4-9600-e2c0e7324e8b service neutron] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:55:21.019591 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9815cbac-40fd-45c4-9600-e2c0e7324e8b service neutron] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:55:21.019863 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9815cbac-40fd-45c4-9600-e2c0e7324e8b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:55:21.029114 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9815cbac-40fd-45c4-9600-e2c0e7324e8b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:55:21.030579 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9815cbac-40fd-45c4-9600-e2c0e7324e8b service neutron] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:55:21.039932 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1284/2560] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 24 05:55:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 05:55:21.315129 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa724e40-f834-4bcf-aa58-1d7495d8449a None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:55:21.316546 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-aa724e40-f834-4bcf-aa58-1d7495d8449a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:55:21.329870 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa724e40-f834-4bcf-aa58-1d7495d8449a None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:55:21.334590 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2332feb7-d2f7-4927-b4a3-fd29f8249e56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:55:21.335252 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2332feb7-d2f7-4927-b4a3-fd29f8249e56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:55:21.335531 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2332feb7-d2f7-4927-b4a3-fd29f8249e56 admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:55:21.335807 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2332feb7-d2f7-4927-b4a3-fd29f8249e56 admin admin] PATH_INFO: `/v3/projects/1e50a1f8131e49a79569b8f003cc28f7` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:55:21.336957 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2332feb7-d2f7-4927-b4a3-fd29f8249e56 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e50a1f8131e49a79569b8f003cc28f7)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:55:21.338887 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2332feb7-d2f7-4927-b4a3-fd29f8249e56 admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:55:21.356460 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:DELETE=3,keystone:SELECT=95,keystone:INSERT=2 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:55:21.386280 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-2332feb7-d2f7-4927-b4a3-fd29f8249e56 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e50a1f8131e49a79569b8f003cc28f7', 'request_id': 'req-2332feb7-d2f7-4927-b4a3-fd29f8249e56'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:55:21.393442 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-2332feb7-d2f7-4927-b4a3-fd29f8249e56 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e50a1f8131e49a79569b8f003cc28f7', 'request_id': 'req-2332feb7-d2f7-4927-b4a3-fd29f8249e56'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:55:21.399641 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-2332feb7-d2f7-4927-b4a3-fd29f8249e56 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e50a1f8131e49a79569b8f003cc28f7', 'request_id': 'req-2332feb7-d2f7-4927-b4a3-fd29f8249e56'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:55:21.410323 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-2332feb7-d2f7-4927-b4a3-fd29f8249e56 admin admin] The token cache is being invalidate because project 1e50a1f8131e49a79569b8f003cc28f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88112) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:55:21.410607 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-2332feb7-d2f7-4927-b4a3-fd29f8249e56 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:55:21.411223 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-2332feb7-d2f7-4927-b4a3-fd29f8249e56 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:55:21.412703 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1277/2561] 10.222.0.26 () {58 vars in 1233 bytes} [Wed Aug 24 05:55:21 2022] DELETE /identity/v3/projects/1e50a1f8131e49a79569b8f003cc28f7 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:55:21.418190 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f430b1f-6b5c-4acb-9e70-438d7c7095a7 None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:55:21.418478 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f430b1f-6b5c-4acb-9e70-438d7c7095a7 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:55:21.418751 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f430b1f-6b5c-4acb-9e70-438d7c7095a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:55:21.437737 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-2f430b1f-6b5c-4acb-9e70-438d7c7095a7 None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:55:21.438961 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-2f430b1f-6b5c-4acb-9e70-438d7c7095a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:55:21.496174 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1285/2562] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:55:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:55:21.504967 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b0a13f-7f16-46d5-a70a-50d44cb815bc None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:55:21.505253 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b0a13f-7f16-46d5-a70a-50d44cb815bc None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:55:21.505526 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b0a13f-7f16-46d5-a70a-50d44cb815bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:55:21.525403 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-73b0a13f-7f16-46d5-a70a-50d44cb815bc None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:55:21.526625 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-73b0a13f-7f16-46d5-a70a-50d44cb815bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:55:21.535073 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1278/2563] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:55:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:55:21.539285 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f430b1f-6b5c-4acb-9e70-438d7c7095a7 None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:55:21.548960 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f430b1f-6b5c-4acb-9e70-438d7c7095a7 None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:55:21.553570 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7604f79a-ab66-4b82-be50-ce9b771a5c51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:55:21.554197 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7604f79a-ab66-4b82-be50-ce9b771a5c51 admin admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:55:21.554475 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7604f79a-ab66-4b82-be50-ce9b771a5c51 admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:55:21.554745 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7604f79a-ab66-4b82-be50-ce9b771a5c51 admin admin] PATH_INFO: `/v3/domains` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:55:21.555388 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7604f79a-ab66-4b82-be50-ce9b771a5c51 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:55:21.555690 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7604f79a-ab66-4b82-be50-ce9b771a5c51 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:55:21.557282 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7604f79a-ab66-4b82-be50-ce9b771a5c51 admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:55:21.569121 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1286/2564] 10.222.0.26 () {58 vars in 1153 bytes} [Wed Aug 24 05:55:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:55:21.573088 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b0a13f-7f16-46d5-a70a-50d44cb815bc None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:55:21.582840 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b0a13f-7f16-46d5-a70a-50d44cb815bc None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:55:21.587449 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32ad7bd-e757-49af-a8dc-9d19d28c20e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:55:21.588043 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32ad7bd-e757-49af-a8dc-9d19d28c20e4 admin admin] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:55:21.588324 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32ad7bd-e757-49af-a8dc-9d19d28c20e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:55:21.588595 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32ad7bd-e757-49af-a8dc-9d19d28c20e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:55:21.589210 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32ad7bd-e757-49af-a8dc-9d19d28c20e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:55:21.591701 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32ad7bd-e757-49af-a8dc-9d19d28c20e4 admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:55:21.617484 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1279/2565] 10.222.0.26 () {60 vars in 1153 bytes} [Wed Aug 24 05:55:21 2022] POST /identity/v3/projects => generated 383 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:55:21.621504 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7604f79a-ab66-4b82-be50-ce9b771a5c51 admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:55:21.631598 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7604f79a-ab66-4b82-be50-ce9b771a5c51 admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:55:21.690807 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9042093b-774e-4b0b-ae76-d2999e252cf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:55:21.691498 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9042093b-774e-4b0b-ae76-d2999e252cf8 admin admin] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:55:21.692196 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9042093b-774e-4b0b-ae76-d2999e252cf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:55:21.692495 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9042093b-774e-4b0b-ae76-d2999e252cf8 admin admin] PATH_INFO: `/v3/users` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:55:21.693123 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9042093b-774e-4b0b-ae76-d2999e252cf8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:55:21.695064 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9042093b-774e-4b0b-ae76-d2999e252cf8 admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:55:21.717578 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1287/2566] 10.222.0.26 () {60 vars in 1144 bytes} [Wed Aug 24 05:55:21 2022] POST /identity/v3/users => generated 292 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:55:21.721555 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32ad7bd-e757-49af-a8dc-9d19d28c20e4 admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:55:21.733063 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32ad7bd-e757-49af-a8dc-9d19d28c20e4 admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:55:21.738400 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7383287a-56df-4f4b-88ce-126fc0d8252c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:55:21.739152 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7383287a-56df-4f4b-88ce-126fc0d8252c admin admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:55:21.739504 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7383287a-56df-4f4b-88ce-126fc0d8252c admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:55:21.740007 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7383287a-56df-4f4b-88ce-126fc0d8252c admin admin] PATH_INFO: `/v3/roles` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:55:21.740735 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7383287a-56df-4f4b-88ce-126fc0d8252c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:55:21.742427 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7383287a-56df-4f4b-88ce-126fc0d8252c admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:55:21.753983 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1280/2567] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Aug 24 05:55:21 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:55:21.757244 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9042093b-774e-4b0b-ae76-d2999e252cf8 admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:55:21.771230 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9042093b-774e-4b0b-ae76-d2999e252cf8 admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:55:21.775986 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1110fc56-208d-4d3b-a77b-8cde7bb978c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:55:21.776594 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1110fc56-208d-4d3b-a77b-8cde7bb978c8 admin admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:55:21.776997 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1110fc56-208d-4d3b-a77b-8cde7bb978c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:55:21.777144 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1110fc56-208d-4d3b-a77b-8cde7bb978c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:55:21.777780 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1110fc56-208d-4d3b-a77b-8cde7bb978c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:55:21.779445 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1110fc56-208d-4d3b-a77b-8cde7bb978c8 admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:55:21.780839 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:DELETE=2,keystone:SELECT=94,keystone:INSERT=4 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:55:21.793360 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1288/2568] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Aug 24 05:55:21 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:55:21.797368 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7383287a-56df-4f4b-88ce-126fc0d8252c admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:55:21.810295 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7383287a-56df-4f4b-88ce-126fc0d8252c admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:55:21.815438 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60412339-47cf-4b93-a0e2-97f3fde4f63c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:55:21.816102 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60412339-47cf-4b93-a0e2-97f3fde4f63c admin admin] REQUEST_METHOD: `PUT` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:55:21.816386 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60412339-47cf-4b93-a0e2-97f3fde4f63c admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:55:21.816657 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60412339-47cf-4b93-a0e2-97f3fde4f63c admin admin] PATH_INFO: `/v3/projects/5208f5a4fa8840a08d2ae2efe3880134/users/c856f4f9a99a45c099fef0cb8073d7fd/roles/f7aa4a2c74c94c1b9ca8ecdcccccda5c` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:55:21.832105 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60412339-47cf-4b93-a0e2-97f3fde4f63c admin admin] RBAC: Authorizing `identity:create_grant(project_id=5208f5a4fa8840a08d2ae2efe3880134, user_id=c856f4f9a99a45c099fef0cb8073d7fd, role_id=f7aa4a2c74c94c1b9ca8ecdcccccda5c)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:55:21.834721 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60412339-47cf-4b93-a0e2-97f3fde4f63c admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:55:21.849010 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1281/2569] 10.222.0.26 () {60 vars in 1483 bytes} [Wed Aug 24 05:55:21 2022] PUT /identity/v3/projects/5208f5a4fa8840a08d2ae2efe3880134/users/c856f4f9a99a45c099fef0cb8073d7fd/roles/f7aa4a2c74c94c1b9ca8ecdcccccda5c => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 05:55:21.859868 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c00e8a-4d2b-4dfc-a98d-4ae964207de2 None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:55:21.860167 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c00e8a-4d2b-4dfc-a98d-4ae964207de2 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:55:21.860442 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c00e8a-4d2b-4dfc-a98d-4ae964207de2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:55:21.887660 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-18c00e8a-4d2b-4dfc-a98d-4ae964207de2 None None] MFA Rules not processed for user `c856f4f9a99a45c099fef0cb8073d7fd`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:55:21.888883 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-18c00e8a-4d2b-4dfc-a98d-4ae964207de2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:55:21.956886 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1289/2570] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:55:21 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:55:21.969047 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60412339-47cf-4b93-a0e2-97f3fde4f63c admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:55:21.971053 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-60412339-47cf-4b93-a0e2-97f3fde4f63c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:55:22.041009 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60412339-47cf-4b93-a0e2-97f3fde4f63c admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:55:22.049386 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9f0e43-4ee3-406f-8ff5-04ba9f86107a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17b450afe795495680fc70f522c83750', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:55:22.049995 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9f0e43-4ee3-406f-8ff5-04ba9f86107a service cinder] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:55:22.050291 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9f0e43-4ee3-406f-8ff5-04ba9f86107a service cinder] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:55:22.050566 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9f0e43-4ee3-406f-8ff5-04ba9f86107a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:55:22.062320 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9f0e43-4ee3-406f-8ff5-04ba9f86107a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:55:22.064566 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9f0e43-4ee3-406f-8ff5-04ba9f86107a service cinder] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:55:22.076740 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1282/2571] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 24 05:55:21 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:55:24.621634 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c00e8a-4d2b-4dfc-a98d-4ae964207de2 None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:55:24.688819 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c00e8a-4d2b-4dfc-a98d-4ae964207de2 None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:55:24.693619 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b4c27e-f508-47a9-a297-4b66d1a9ab57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:55:24.694279 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b4c27e-f508-47a9-a297-4b66d1a9ab57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:55:24.694562 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b4c27e-f508-47a9-a297-4b66d1a9ab57 admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:55:24.694857 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b4c27e-f508-47a9-a297-4b66d1a9ab57 admin admin] PATH_INFO: `/v3/users/c856f4f9a99a45c099fef0cb8073d7fd` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:55:24.696044 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b4c27e-f508-47a9-a297-4b66d1a9ab57 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c856f4f9a99a45c099fef0cb8073d7fd)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:55:24.697975 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b4c27e-f508-47a9-a297-4b66d1a9ab57 admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:55:24.743563 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-88b4c27e-f508-47a9-a297-4b66d1a9ab57 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c856f4f9a99a45c099fef0cb8073d7fd'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:55:24.750519 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-88b4c27e-f508-47a9-a297-4b66d1a9ab57 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c856f4f9a99a45c099fef0cb8073d7fd'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:55:24.751182 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-88b4c27e-f508-47a9-a297-4b66d1a9ab57 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c856f4f9a99a45c099fef0cb8073d7fd'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:55:24.763387 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-88b4c27e-f508-47a9-a297-4b66d1a9ab57 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c856f4f9a99a45c099fef0cb8073d7fd'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:55:24.770774 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-88b4c27e-f508-47a9-a297-4b66d1a9ab57 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c856f4f9a99a45c099fef0cb8073d7fd'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:55:24.776751 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1290/2572] 10.222.0.26 () {58 vars in 1224 bytes} [Wed Aug 24 05:55:24 2022] DELETE /identity/v3/users/c856f4f9a99a45c099fef0cb8073d7fd => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:55:24.781740 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c19e54-4544-4c0c-a348-08baf3cfacac None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:55:24.782237 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c19e54-4544-4c0c-a348-08baf3cfacac None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:55:24.782335 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c19e54-4544-4c0c-a348-08baf3cfacac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:55:24.800644 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-49c19e54-4544-4c0c-a348-08baf3cfacac None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:55:24.801784 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-49c19e54-4544-4c0c-a348-08baf3cfacac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:55:24.840102 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:55:24.861356 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1283/2573] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:55:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:55:24.871019 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b4c27e-f508-47a9-a297-4b66d1a9ab57 admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:55:24.873054 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-88b4c27e-f508-47a9-a297-4b66d1a9ab57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:55:24.879680 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:55:24.931879 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b4c27e-f508-47a9-a297-4b66d1a9ab57 admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:55:24.936003 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d753670b-a5f2-4d87-9c8b-50336578d970 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '874348b647194ac2b5ecbf12c33bf59e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:55:24.936593 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d753670b-a5f2-4d87-9c8b-50336578d970 service neutron] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:55:24.936868 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d753670b-a5f2-4d87-9c8b-50336578d970 service neutron] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:55:24.937135 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d753670b-a5f2-4d87-9c8b-50336578d970 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:55:24.946586 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d753670b-a5f2-4d87-9c8b-50336578d970 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:55:24.948009 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d753670b-a5f2-4d87-9c8b-50336578d970 service neutron] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:55:24.958062 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1291/2574] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 24 05:55:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:55:25.238833 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c19e54-4544-4c0c-a348-08baf3cfacac None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:55:25.240329 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-49c19e54-4544-4c0c-a348-08baf3cfacac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:55:25.256273 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c19e54-4544-4c0c-a348-08baf3cfacac None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:55:25.261067 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d498fe-f42e-4f3e-ae35-e343738ca520 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:55:25.261610 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d498fe-f42e-4f3e-ae35-e343738ca520 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:55:25.261978 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d498fe-f42e-4f3e-ae35-e343738ca520 admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:55:25.262221 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d498fe-f42e-4f3e-ae35-e343738ca520 admin admin] PATH_INFO: `/v3/projects/5208f5a4fa8840a08d2ae2efe3880134` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:55:25.263438 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d498fe-f42e-4f3e-ae35-e343738ca520 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5208f5a4fa8840a08d2ae2efe3880134)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:55:25.265345 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d498fe-f42e-4f3e-ae35-e343738ca520 admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:55:25.313921 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-01d498fe-f42e-4f3e-ae35-e343738ca520 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5208f5a4fa8840a08d2ae2efe3880134', 'request_id': 'req-01d498fe-f42e-4f3e-ae35-e343738ca520'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:55:25.321525 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-01d498fe-f42e-4f3e-ae35-e343738ca520 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5208f5a4fa8840a08d2ae2efe3880134', 'request_id': 'req-01d498fe-f42e-4f3e-ae35-e343738ca520'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:55:25.328061 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-01d498fe-f42e-4f3e-ae35-e343738ca520 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5208f5a4fa8840a08d2ae2efe3880134', 'request_id': 'req-01d498fe-f42e-4f3e-ae35-e343738ca520'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:55:25.339137 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-01d498fe-f42e-4f3e-ae35-e343738ca520 admin admin] The token cache is being invalidate because project 5208f5a4fa8840a08d2ae2efe3880134 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88112) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:55:25.339439 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-01d498fe-f42e-4f3e-ae35-e343738ca520 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:55:25.340180 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-01d498fe-f42e-4f3e-ae35-e343738ca520 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:55:25.341816 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1284/2575] 10.222.0.26 () {58 vars in 1233 bytes} [Wed Aug 24 05:55:25 2022] DELETE /identity/v3/projects/5208f5a4fa8840a08d2ae2efe3880134 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:55:25.346929 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d01e5e-0ab9-4609-99c7-13461431c9bc None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:55:25.347214 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d01e5e-0ab9-4609-99c7-13461431c9bc None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:55:25.347480 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d01e5e-0ab9-4609-99c7-13461431c9bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:55:25.368691 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-d3d01e5e-0ab9-4609-99c7-13461431c9bc None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:55:25.370065 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-d3d01e5e-0ab9-4609-99c7-13461431c9bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:55:25.428979 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1292/2576] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:55:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:55:25.437858 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817a4c49-e2b5-48ba-805a-a5de4ea5deb6 None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:55:25.438192 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817a4c49-e2b5-48ba-805a-a5de4ea5deb6 None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:55:25.438468 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817a4c49-e2b5-48ba-805a-a5de4ea5deb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:55:25.459724 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-817a4c49-e2b5-48ba-805a-a5de4ea5deb6 None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:55:25.460914 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-817a4c49-e2b5-48ba-805a-a5de4ea5deb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:55:25.468764 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1285/2577] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:55:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:55:25.473061 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d01e5e-0ab9-4609-99c7-13461431c9bc None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:55:25.483094 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d01e5e-0ab9-4609-99c7-13461431c9bc None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:55:25.487526 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d6ea49-72bc-4ae0-ad35-220a27c101cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:55:25.488112 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d6ea49-72bc-4ae0-ad35-220a27c101cf admin admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:55:25.488390 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d6ea49-72bc-4ae0-ad35-220a27c101cf admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:55:25.488664 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d6ea49-72bc-4ae0-ad35-220a27c101cf admin admin] PATH_INFO: `/v3/domains` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:55:25.489298 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d6ea49-72bc-4ae0-ad35-220a27c101cf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:55:25.489593 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d6ea49-72bc-4ae0-ad35-220a27c101cf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:55:25.491203 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d6ea49-72bc-4ae0-ad35-220a27c101cf admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:55:25.503385 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1293/2578] 10.222.0.26 () {58 vars in 1153 bytes} [Wed Aug 24 05:55:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:55:25.507676 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817a4c49-e2b5-48ba-805a-a5de4ea5deb6 None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:55:25.516984 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817a4c49-e2b5-48ba-805a-a5de4ea5deb6 None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:55:25.521542 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb92ee33-b7db-41a7-a934-1086d7869aba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:55:25.522174 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb92ee33-b7db-41a7-a934-1086d7869aba admin admin] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:55:25.522453 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb92ee33-b7db-41a7-a934-1086d7869aba admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:55:25.522723 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb92ee33-b7db-41a7-a934-1086d7869aba admin admin] PATH_INFO: `/v3/projects` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:55:25.523347 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb92ee33-b7db-41a7-a934-1086d7869aba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:55:25.525222 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb92ee33-b7db-41a7-a934-1086d7869aba admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:55:25.556232 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1286/2579] 10.222.0.26 () {60 vars in 1153 bytes} [Wed Aug 24 05:55:25 2022] POST /identity/v3/projects => generated 373 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:55:25.560520 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d6ea49-72bc-4ae0-ad35-220a27c101cf admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:55:25.571264 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d6ea49-72bc-4ae0-ad35-220a27c101cf admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:55:25.627375 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336989bd-1cfb-4796-8f2c-19ee27f8d107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:55:25.628018 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336989bd-1cfb-4796-8f2c-19ee27f8d107 admin admin] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:55:25.628241 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336989bd-1cfb-4796-8f2c-19ee27f8d107 admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:55:25.628509 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336989bd-1cfb-4796-8f2c-19ee27f8d107 admin admin] PATH_INFO: `/v3/users` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:55:25.629131 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336989bd-1cfb-4796-8f2c-19ee27f8d107 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:55:25.631066 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336989bd-1cfb-4796-8f2c-19ee27f8d107 admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:55:25.651319 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1294/2580] 10.222.0.26 () {60 vars in 1144 bytes} [Wed Aug 24 05:55:25 2022] POST /identity/v3/users => generated 287 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:55:25.655915 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb92ee33-b7db-41a7-a934-1086d7869aba admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:55:25.666133 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb92ee33-b7db-41a7-a934-1086d7869aba admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:55:25.671312 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e1a963-2368-4288-a36d-cc453acb0adb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:55:25.671909 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e1a963-2368-4288-a36d-cc453acb0adb admin admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:55:25.672191 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e1a963-2368-4288-a36d-cc453acb0adb admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:55:25.672487 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e1a963-2368-4288-a36d-cc453acb0adb admin admin] PATH_INFO: `/v3/roles` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:55:25.673127 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e1a963-2368-4288-a36d-cc453acb0adb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:55:25.674779 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e1a963-2368-4288-a36d-cc453acb0adb admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:55:25.684531 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1287/2581] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Aug 24 05:55:25 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:55:25.688288 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336989bd-1cfb-4796-8f2c-19ee27f8d107 admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:55:25.698501 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336989bd-1cfb-4796-8f2c-19ee27f8d107 admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:55:25.703120 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102445ab-d5c2-47d5-a890-6d279c56365f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:55:25.703705 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102445ab-d5c2-47d5-a890-6d279c56365f admin admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:55:25.703991 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102445ab-d5c2-47d5-a890-6d279c56365f admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:55:25.704266 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102445ab-d5c2-47d5-a890-6d279c56365f admin admin] PATH_INFO: `/v3/roles` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:55:25.704902 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102445ab-d5c2-47d5-a890-6d279c56365f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:55:25.706548 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102445ab-d5c2-47d5-a890-6d279c56365f admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:55:25.717708 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1295/2582] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Aug 24 05:55:25 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 05:55:25.721528 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e1a963-2368-4288-a36d-cc453acb0adb admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:55:25.731842 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e1a963-2368-4288-a36d-cc453acb0adb admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:55:25.736437 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad8fbda-c155-4992-892f-e78925f60099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:55:25.737069 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad8fbda-c155-4992-892f-e78925f60099 admin admin] REQUEST_METHOD: `PUT` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:55:25.737499 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad8fbda-c155-4992-892f-e78925f60099 admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:55:25.737671 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad8fbda-c155-4992-892f-e78925f60099 admin admin] PATH_INFO: `/v3/projects/e33ca2048bd64bd2a82dc18366feeba3/users/27c72980e0b149b086ce2613d90a0888/roles/f7aa4a2c74c94c1b9ca8ecdcccccda5c` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:55:25.752171 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad8fbda-c155-4992-892f-e78925f60099 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e33ca2048bd64bd2a82dc18366feeba3, user_id=27c72980e0b149b086ce2613d90a0888, role_id=f7aa4a2c74c94c1b9ca8ecdcccccda5c)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:55:25.754856 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad8fbda-c155-4992-892f-e78925f60099 admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:55:25.767495 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1288/2583] 10.222.0.26 () {60 vars in 1483 bytes} [Wed Aug 24 05:55:25 2022] PUT /identity/v3/projects/e33ca2048bd64bd2a82dc18366feeba3/users/27c72980e0b149b086ce2613d90a0888/roles/f7aa4a2c74c94c1b9ca8ecdcccccda5c => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:55:25.779296 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7757d17a-2dfe-4867-96bb-98bb55d0b412 None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:55:25.779582 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7757d17a-2dfe-4867-96bb-98bb55d0b412 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:55:25.779858 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7757d17a-2dfe-4867-96bb-98bb55d0b412 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:55:25.804938 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:55:25.808149 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-7757d17a-2dfe-4867-96bb-98bb55d0b412 None None] MFA Rules not processed for user `27c72980e0b149b086ce2613d90a0888`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:55:25.809931 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-7757d17a-2dfe-4867-96bb-98bb55d0b412 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:55:25.873852 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1296/2584] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:55:25 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:55:25.884810 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad8fbda-c155-4992-892f-e78925f60099 admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:55:25.886651 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-5ad8fbda-c155-4992-892f-e78925f60099 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:55:25.951303 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad8fbda-c155-4992-892f-e78925f60099 admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:55:25.955072 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309b903c-ac41-4972-bb57-fae20b7b8024 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17b450afe795495680fc70f522c83750', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:55:25.955687 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309b903c-ac41-4972-bb57-fae20b7b8024 service cinder] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:55:25.955967 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309b903c-ac41-4972-bb57-fae20b7b8024 service cinder] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:55:25.956240 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309b903c-ac41-4972-bb57-fae20b7b8024 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:55:25.964732 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309b903c-ac41-4972-bb57-fae20b7b8024 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:55:25.966832 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309b903c-ac41-4972-bb57-fae20b7b8024 service cinder] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:55:25.975565 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1289/2585] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 24 05:55:25 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:55:25.999780 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7757d17a-2dfe-4867-96bb-98bb55d0b412 None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:55:26.062613 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7757d17a-2dfe-4867-96bb-98bb55d0b412 None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:55:26.067418 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9598461f-88eb-4dce-b75e-f88f7a10d451 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:55:26.068039 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9598461f-88eb-4dce-b75e-f88f7a10d451 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:55:26.068315 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9598461f-88eb-4dce-b75e-f88f7a10d451 admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:55:26.068589 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9598461f-88eb-4dce-b75e-f88f7a10d451 admin admin] PATH_INFO: `/v3/users/27c72980e0b149b086ce2613d90a0888` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:55:26.069717 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9598461f-88eb-4dce-b75e-f88f7a10d451 admin admin] RBAC: Authorizing `identity:delete_user(user_id=27c72980e0b149b086ce2613d90a0888)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:55:26.071706 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9598461f-88eb-4dce-b75e-f88f7a10d451 admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:55:26.117106 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-9598461f-88eb-4dce-b75e-f88f7a10d451 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '27c72980e0b149b086ce2613d90a0888'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:55:26.123748 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-9598461f-88eb-4dce-b75e-f88f7a10d451 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '27c72980e0b149b086ce2613d90a0888'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:55:26.124471 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-9598461f-88eb-4dce-b75e-f88f7a10d451 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '27c72980e0b149b086ce2613d90a0888'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:55:26.136056 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-9598461f-88eb-4dce-b75e-f88f7a10d451 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '27c72980e0b149b086ce2613d90a0888'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:55:26.143712 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-9598461f-88eb-4dce-b75e-f88f7a10d451 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '27c72980e0b149b086ce2613d90a0888'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:55:26.149772 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1297/2586] 10.222.0.26 () {58 vars in 1224 bytes} [Wed Aug 24 05:55:25 2022] DELETE /identity/v3/users/27c72980e0b149b086ce2613d90a0888 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:55:26.154876 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1173bb-4188-437d-8326-5584d6b3636b None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:55:26.155162 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1173bb-4188-437d-8326-5584d6b3636b None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:55:26.155438 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1173bb-4188-437d-8326-5584d6b3636b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:55:26.163368 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:55:26.175230 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-8a1173bb-4188-437d-8326-5584d6b3636b None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:55:26.176431 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-8a1173bb-4188-437d-8326-5584d6b3636b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:55:26.234652 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1290/2587] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:55:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:55:26.244681 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9598461f-88eb-4dce-b75e-f88f7a10d451 admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:55:26.246441 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-9598461f-88eb-4dce-b75e-f88f7a10d451 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:55:26.273808 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:55:26.308284 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9598461f-88eb-4dce-b75e-f88f7a10d451 admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:55:26.312811 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbed1c16-7b5d-41a2-9c2f-672b400374ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '874348b647194ac2b5ecbf12c33bf59e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:55:26.313565 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbed1c16-7b5d-41a2-9c2f-672b400374ed service neutron] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:55:26.313991 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbed1c16-7b5d-41a2-9c2f-672b400374ed service neutron] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:55:26.314381 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbed1c16-7b5d-41a2-9c2f-672b400374ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:55:26.324957 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbed1c16-7b5d-41a2-9c2f-672b400374ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:55:26.326488 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbed1c16-7b5d-41a2-9c2f-672b400374ed service neutron] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:55:26.336508 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1298/2588] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 24 05:55:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:55:26.618404 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1173bb-4188-437d-8326-5584d6b3636b None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:55:26.619825 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-8a1173bb-4188-437d-8326-5584d6b3636b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:55:26.632242 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1173bb-4188-437d-8326-5584d6b3636b None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:55:26.637694 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21398f9-8a19-4b8b-af14-3d63495d29d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:55:26.638396 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21398f9-8a19-4b8b-af14-3d63495d29d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:55:26.638727 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21398f9-8a19-4b8b-af14-3d63495d29d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:55:26.639014 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21398f9-8a19-4b8b-af14-3d63495d29d5 admin admin] PATH_INFO: `/v3/projects/e33ca2048bd64bd2a82dc18366feeba3` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:55:26.640145 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21398f9-8a19-4b8b-af14-3d63495d29d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e33ca2048bd64bd2a82dc18366feeba3)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:55:26.642076 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21398f9-8a19-4b8b-af14-3d63495d29d5 admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:55:26.688552 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-f21398f9-8a19-4b8b-af14-3d63495d29d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e33ca2048bd64bd2a82dc18366feeba3', 'request_id': 'req-f21398f9-8a19-4b8b-af14-3d63495d29d5'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:55:26.697399 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-f21398f9-8a19-4b8b-af14-3d63495d29d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e33ca2048bd64bd2a82dc18366feeba3', 'request_id': 'req-f21398f9-8a19-4b8b-af14-3d63495d29d5'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:55:26.705828 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-f21398f9-8a19-4b8b-af14-3d63495d29d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e33ca2048bd64bd2a82dc18366feeba3', 'request_id': 'req-f21398f9-8a19-4b8b-af14-3d63495d29d5'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:55:26.716196 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-f21398f9-8a19-4b8b-af14-3d63495d29d5 admin admin] The token cache is being invalidate because project e33ca2048bd64bd2a82dc18366feeba3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88112) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:55:26.716602 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-f21398f9-8a19-4b8b-af14-3d63495d29d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:55:26.717253 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-f21398f9-8a19-4b8b-af14-3d63495d29d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:55:26.718802 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1291/2589] 10.222.0.26 () {58 vars in 1233 bytes} [Wed Aug 24 05:55:26 2022] DELETE /identity/v3/projects/e33ca2048bd64bd2a82dc18366feeba3 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:55:26.723639 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e0aa91-ae7c-4e03-9204-d41f957e4d51 None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:55:26.724108 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e0aa91-ae7c-4e03-9204-d41f957e4d51 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:55:26.724220 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e0aa91-ae7c-4e03-9204-d41f957e4d51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:55:26.743997 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-c7e0aa91-ae7c-4e03-9204-d41f957e4d51 None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:55:26.745190 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-c7e0aa91-ae7c-4e03-9204-d41f957e4d51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:55:26.803157 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1299/2590] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:55:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:55:26.811716 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9b0d6b-d5e3-4aaa-8e88-910ec1fd538d None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:55:26.812261 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9b0d6b-d5e3-4aaa-8e88-910ec1fd538d None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:55:26.812545 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9b0d6b-d5e3-4aaa-8e88-910ec1fd538d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:55:26.832141 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-8e9b0d6b-d5e3-4aaa-8e88-910ec1fd538d None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:55:26.833356 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-8e9b0d6b-d5e3-4aaa-8e88-910ec1fd538d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:55:26.841274 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1292/2591] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:55:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:55:26.845328 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e0aa91-ae7c-4e03-9204-d41f957e4d51 None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:55:26.854948 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e0aa91-ae7c-4e03-9204-d41f957e4d51 None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:55:26.860053 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8d38dc-5a0b-46f8-a9b0-6bb8b1f3b85b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:55:26.860647 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8d38dc-5a0b-46f8-a9b0-6bb8b1f3b85b admin admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:55:26.860931 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8d38dc-5a0b-46f8-a9b0-6bb8b1f3b85b admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:55:26.861203 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8d38dc-5a0b-46f8-a9b0-6bb8b1f3b85b admin admin] PATH_INFO: `/v3/domains` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:55:26.861847 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8d38dc-5a0b-46f8-a9b0-6bb8b1f3b85b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:55:26.862182 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8d38dc-5a0b-46f8-a9b0-6bb8b1f3b85b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:55:26.863780 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8d38dc-5a0b-46f8-a9b0-6bb8b1f3b85b admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:55:26.875734 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1300/2592] 10.222.0.26 () {58 vars in 1153 bytes} [Wed Aug 24 05:55:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:55:26.880112 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9b0d6b-d5e3-4aaa-8e88-910ec1fd538d None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:55:26.889268 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9b0d6b-d5e3-4aaa-8e88-910ec1fd538d None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:55:26.893868 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9be1c6-91dd-4be3-9d87-e25382f5dbdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:55:26.894482 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9be1c6-91dd-4be3-9d87-e25382f5dbdf admin admin] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:55:26.894760 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9be1c6-91dd-4be3-9d87-e25382f5dbdf admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:55:26.895029 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9be1c6-91dd-4be3-9d87-e25382f5dbdf admin admin] PATH_INFO: `/v3/projects` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:55:26.895670 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9be1c6-91dd-4be3-9d87-e25382f5dbdf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:55:26.897584 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9be1c6-91dd-4be3-9d87-e25382f5dbdf admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:55:26.924294 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1293/2593] 10.222.0.26 () {60 vars in 1153 bytes} [Wed Aug 24 05:55:26 2022] POST /identity/v3/projects => generated 391 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:55:26.928429 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8d38dc-5a0b-46f8-a9b0-6bb8b1f3b85b admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:55:26.939280 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8d38dc-5a0b-46f8-a9b0-6bb8b1f3b85b admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:55:26.994659 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d7e8f6-d282-4a3e-90fa-cedb316ea77e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:55:26.995254 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d7e8f6-d282-4a3e-90fa-cedb316ea77e admin admin] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:55:26.995532 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d7e8f6-d282-4a3e-90fa-cedb316ea77e admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:55:26.995800 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d7e8f6-d282-4a3e-90fa-cedb316ea77e admin admin] PATH_INFO: `/v3/users` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:55:26.997032 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d7e8f6-d282-4a3e-90fa-cedb316ea77e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:55:26.999033 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d7e8f6-d282-4a3e-90fa-cedb316ea77e admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:55:27.019975 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1301/2594] 10.222.0.26 () {60 vars in 1144 bytes} [Wed Aug 24 05:55:26 2022] POST /identity/v3/users => generated 296 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:55:27.024134 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9be1c6-91dd-4be3-9d87-e25382f5dbdf admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:55:27.034761 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9be1c6-91dd-4be3-9d87-e25382f5dbdf admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:55:27.039355 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d079653c-ad97-48fe-81a9-9a69f82f67b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:55:27.039935 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d079653c-ad97-48fe-81a9-9a69f82f67b5 admin admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:55:27.040213 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d079653c-ad97-48fe-81a9-9a69f82f67b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:55:27.040483 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d079653c-ad97-48fe-81a9-9a69f82f67b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:55:27.041148 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d079653c-ad97-48fe-81a9-9a69f82f67b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:55:27.042888 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d079653c-ad97-48fe-81a9-9a69f82f67b5 admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:55:27.053184 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1294/2595] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Aug 24 05:55:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:55:27.057751 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d7e8f6-d282-4a3e-90fa-cedb316ea77e admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:55:27.069202 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d7e8f6-d282-4a3e-90fa-cedb316ea77e admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:55:27.074231 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5f4dbb-97e0-4475-a02f-a67c2734b0d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:55:27.074861 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5f4dbb-97e0-4475-a02f-a67c2734b0d5 admin admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:55:27.075141 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5f4dbb-97e0-4475-a02f-a67c2734b0d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:55:27.075409 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5f4dbb-97e0-4475-a02f-a67c2734b0d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:55:27.076050 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5f4dbb-97e0-4475-a02f-a67c2734b0d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:55:27.077675 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5f4dbb-97e0-4475-a02f-a67c2734b0d5 admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:55:27.088223 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1302/2596] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Aug 24 05:55:27 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 05:55:27.092903 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d079653c-ad97-48fe-81a9-9a69f82f67b5 admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:55:27.102660 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d079653c-ad97-48fe-81a9-9a69f82f67b5 admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:55:27.107704 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b79c2e0-4e87-4a38-97b3-e0a9b3f2445a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:55:27.108341 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b79c2e0-4e87-4a38-97b3-e0a9b3f2445a admin admin] REQUEST_METHOD: `PUT` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:55:27.108624 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b79c2e0-4e87-4a38-97b3-e0a9b3f2445a admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:55:27.108893 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b79c2e0-4e87-4a38-97b3-e0a9b3f2445a admin admin] PATH_INFO: `/v3/projects/d7238c33a1834970b30e4fb3dbf5e9df/users/8cbf99ec41464abd8e725a0a34c492ea/roles/f7aa4a2c74c94c1b9ca8ecdcccccda5c` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:55:27.123469 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b79c2e0-4e87-4a38-97b3-e0a9b3f2445a admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7238c33a1834970b30e4fb3dbf5e9df, user_id=8cbf99ec41464abd8e725a0a34c492ea, role_id=f7aa4a2c74c94c1b9ca8ecdcccccda5c)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:55:27.126138 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b79c2e0-4e87-4a38-97b3-e0a9b3f2445a admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:55:27.139470 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1295/2597] 10.222.0.26 () {60 vars in 1483 bytes} [Wed Aug 24 05:55:27 2022] PUT /identity/v3/projects/d7238c33a1834970b30e4fb3dbf5e9df/users/8cbf99ec41464abd8e725a0a34c492ea/roles/f7aa4a2c74c94c1b9ca8ecdcccccda5c => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:55:27.149808 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75eb5b7-9e5f-448b-a516-72020d190e4c None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:55:27.150148 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75eb5b7-9e5f-448b-a516-72020d190e4c None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:55:27.150427 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75eb5b7-9e5f-448b-a516-72020d190e4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:55:27.180471 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-a75eb5b7-9e5f-448b-a516-72020d190e4c None None] MFA Rules not processed for user `8cbf99ec41464abd8e725a0a34c492ea`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:55:27.181685 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-a75eb5b7-9e5f-448b-a516-72020d190e4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:55:27.200357 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:55:27.246741 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1303/2598] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:55:27 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:55:27.257942 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b79c2e0-4e87-4a38-97b3-e0a9b3f2445a admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:55:27.259636 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-4b79c2e0-4e87-4a38-97b3-e0a9b3f2445a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:55:27.288442 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:55:27.319512 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b79c2e0-4e87-4a38-97b3-e0a9b3f2445a admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:55:27.323075 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db0624d-3226-43c0-a1f6-e14b7d245814 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17b450afe795495680fc70f522c83750', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:55:27.323670 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db0624d-3226-43c0-a1f6-e14b7d245814 service cinder] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:55:27.323945 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db0624d-3226-43c0-a1f6-e14b7d245814 service cinder] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:55:27.324264 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db0624d-3226-43c0-a1f6-e14b7d245814 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:55:27.332236 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db0624d-3226-43c0-a1f6-e14b7d245814 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:55:27.333644 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db0624d-3226-43c0-a1f6-e14b7d245814 service cinder] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:55:27.342703 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1296/2599] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 24 05:55:27 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:55:27.376615 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75eb5b7-9e5f-448b-a516-72020d190e4c None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:55:27.378033 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-a75eb5b7-9e5f-448b-a516-72020d190e4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:55:27.445314 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75eb5b7-9e5f-448b-a516-72020d190e4c None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:55:27.450512 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c35103-6078-42c8-8105-c3fe8c81ef79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:55:27.451182 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c35103-6078-42c8-8105-c3fe8c81ef79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:55:27.451467 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c35103-6078-42c8-8105-c3fe8c81ef79 admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:55:27.451745 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c35103-6078-42c8-8105-c3fe8c81ef79 admin admin] PATH_INFO: `/v3/users/dd3c2f58d2bf4e8c85ad702a69f07750` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:55:27.452886 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c35103-6078-42c8-8105-c3fe8c81ef79 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd3c2f58d2bf4e8c85ad702a69f07750)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:55:27.454856 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c35103-6078-42c8-8105-c3fe8c81ef79 admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:55:27.513024 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-31c35103-6078-42c8-8105-c3fe8c81ef79 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd3c2f58d2bf4e8c85ad702a69f07750'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:55:27.520285 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-31c35103-6078-42c8-8105-c3fe8c81ef79 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd3c2f58d2bf4e8c85ad702a69f07750'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:55:27.521005 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-31c35103-6078-42c8-8105-c3fe8c81ef79 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd3c2f58d2bf4e8c85ad702a69f07750'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:55:27.533739 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-31c35103-6078-42c8-8105-c3fe8c81ef79 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd3c2f58d2bf4e8c85ad702a69f07750'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:55:27.543274 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-31c35103-6078-42c8-8105-c3fe8c81ef79 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd3c2f58d2bf4e8c85ad702a69f07750'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:55:27.549885 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1304/2600] 10.222.0.26 () {58 vars in 1224 bytes} [Wed Aug 24 05:55:27 2022] DELETE /identity/v3/users/dd3c2f58d2bf4e8c85ad702a69f07750 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:55:27.554633 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90707bc4-4b46-453f-8314-4e03a8bdd952 None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:55:27.554924 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90707bc4-4b46-453f-8314-4e03a8bdd952 None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:55:27.555198 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90707bc4-4b46-453f-8314-4e03a8bdd952 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:55:27.700622 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-90707bc4-4b46-453f-8314-4e03a8bdd952 None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:55:27.701830 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-90707bc4-4b46-453f-8314-4e03a8bdd952 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:55:27.758753 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1297/2601] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:55:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 05:55:27.768996 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c35103-6078-42c8-8105-c3fe8c81ef79 admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:55:27.770410 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-31c35103-6078-42c8-8105-c3fe8c81ef79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:55:27.813536 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:55:27.828858 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c35103-6078-42c8-8105-c3fe8c81ef79 admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:55:27.832407 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75551b5-01f1-48ea-a04a-8aa76b28ef3e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '874348b647194ac2b5ecbf12c33bf59e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:55:27.833000 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75551b5-01f1-48ea-a04a-8aa76b28ef3e service neutron] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:55:27.833282 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75551b5-01f1-48ea-a04a-8aa76b28ef3e service neutron] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:55:27.833554 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75551b5-01f1-48ea-a04a-8aa76b28ef3e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:55:27.842319 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75551b5-01f1-48ea-a04a-8aa76b28ef3e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:55:27.843750 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75551b5-01f1-48ea-a04a-8aa76b28ef3e service neutron] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:55:27.852956 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1305/2602] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 24 05:55:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:55:28.115345 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90707bc4-4b46-453f-8314-4e03a8bdd952 None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:55:28.116907 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-90707bc4-4b46-453f-8314-4e03a8bdd952 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:55:28.132408 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90707bc4-4b46-453f-8314-4e03a8bdd952 None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:55:28.139211 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0208ccd5-8e52-4032-828b-54689721801e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:55:28.139929 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0208ccd5-8e52-4032-828b-54689721801e admin admin] REQUEST_METHOD: `DELETE` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:55:28.140281 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0208ccd5-8e52-4032-828b-54689721801e admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:55:28.140624 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0208ccd5-8e52-4032-828b-54689721801e admin admin] PATH_INFO: `/v3/projects/813900eb3b1c4f8ca04768433d459dcf` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:55:28.141979 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0208ccd5-8e52-4032-828b-54689721801e admin admin] RBAC: Authorizing `identity:delete_project(project_id=813900eb3b1c4f8ca04768433d459dcf)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:55:28.144520 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0208ccd5-8e52-4032-828b-54689721801e admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:55:28.191583 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-0208ccd5-8e52-4032-828b-54689721801e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '813900eb3b1c4f8ca04768433d459dcf', 'request_id': 'req-0208ccd5-8e52-4032-828b-54689721801e'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:55:28.198952 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-0208ccd5-8e52-4032-828b-54689721801e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '813900eb3b1c4f8ca04768433d459dcf', 'request_id': 'req-0208ccd5-8e52-4032-828b-54689721801e'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:55:28.205081 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-0208ccd5-8e52-4032-828b-54689721801e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '813900eb3b1c4f8ca04768433d459dcf', 'request_id': 'req-0208ccd5-8e52-4032-828b-54689721801e'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:55:28.215418 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-0208ccd5-8e52-4032-828b-54689721801e admin admin] The token cache is being invalidate because project 813900eb3b1c4f8ca04768433d459dcf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88112) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:55:28.215709 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-0208ccd5-8e52-4032-828b-54689721801e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:55:28.216348 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-0208ccd5-8e52-4032-828b-54689721801e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:55:28.217893 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1298/2603] 10.222.0.26 () {58 vars in 1233 bytes} [Wed Aug 24 05:55:28 2022] DELETE /identity/v3/projects/813900eb3b1c4f8ca04768433d459dcf => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:55:28.222803 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b8290f-248f-4aed-b1f2-d5ea74bf1755 None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:55:28.223174 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b8290f-248f-4aed-b1f2-d5ea74bf1755 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:55:28.223366 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b8290f-248f-4aed-b1f2-d5ea74bf1755 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:55:28.244535 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-f4b8290f-248f-4aed-b1f2-d5ea74bf1755 None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:55:28.245654 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-f4b8290f-248f-4aed-b1f2-d5ea74bf1755 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:55:28.304743 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1306/2604] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:55:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:55:28.314272 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea3b603-c472-429e-86ac-b7b905d5e4e7 None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:55:28.314579 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea3b603-c472-429e-86ac-b7b905d5e4e7 None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:55:28.314850 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea3b603-c472-429e-86ac-b7b905d5e4e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:55:28.334831 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-bea3b603-c472-429e-86ac-b7b905d5e4e7 None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:55:28.336021 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-bea3b603-c472-429e-86ac-b7b905d5e4e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:55:28.344599 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1299/2605] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:55:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:55:28.348766 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b8290f-248f-4aed-b1f2-d5ea74bf1755 None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:55:28.358647 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b8290f-248f-4aed-b1f2-d5ea74bf1755 None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:55:28.363243 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6875cc9-a038-4633-b52a-8050f1bc7f08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:55:28.363831 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6875cc9-a038-4633-b52a-8050f1bc7f08 admin admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:55:28.364110 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6875cc9-a038-4633-b52a-8050f1bc7f08 admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:55:28.364380 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6875cc9-a038-4633-b52a-8050f1bc7f08 admin admin] PATH_INFO: `/v3/domains` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:55:28.365017 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6875cc9-a038-4633-b52a-8050f1bc7f08 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:55:28.365322 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6875cc9-a038-4633-b52a-8050f1bc7f08 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:55:28.366935 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6875cc9-a038-4633-b52a-8050f1bc7f08 admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:55:28.378212 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1307/2606] 10.222.0.26 () {58 vars in 1153 bytes} [Wed Aug 24 05:55:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:55:28.382272 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea3b603-c472-429e-86ac-b7b905d5e4e7 None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:55:28.391904 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea3b603-c472-429e-86ac-b7b905d5e4e7 None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:55:28.396445 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216820f8-940c-48b2-b1c6-043a5b43ab57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:55:28.397030 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216820f8-940c-48b2-b1c6-043a5b43ab57 admin admin] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:55:28.397306 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216820f8-940c-48b2-b1c6-043a5b43ab57 admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:55:28.397577 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216820f8-940c-48b2-b1c6-043a5b43ab57 admin admin] PATH_INFO: `/v3/projects` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:55:28.398228 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216820f8-940c-48b2-b1c6-043a5b43ab57 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:55:28.400104 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216820f8-940c-48b2-b1c6-043a5b43ab57 admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:55:28.426646 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1300/2607] 10.222.0.26 () {60 vars in 1153 bytes} [Wed Aug 24 05:55:28 2022] POST /identity/v3/projects => generated 375 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:55:28.430689 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6875cc9-a038-4633-b52a-8050f1bc7f08 admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:55:28.440677 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6875cc9-a038-4633-b52a-8050f1bc7f08 admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:55:28.499039 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667bc74e-1c2e-4ad7-bb3e-7e64dd96e572 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:55:28.499039 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667bc74e-1c2e-4ad7-bb3e-7e64dd96e572 admin admin] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:55:28.499039 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667bc74e-1c2e-4ad7-bb3e-7e64dd96e572 admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:55:28.499039 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667bc74e-1c2e-4ad7-bb3e-7e64dd96e572 admin admin] PATH_INFO: `/v3/users` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:55:28.499495 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667bc74e-1c2e-4ad7-bb3e-7e64dd96e572 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:55:28.499588 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667bc74e-1c2e-4ad7-bb3e-7e64dd96e572 admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:55:28.520618 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1308/2608] 10.222.0.26 () {60 vars in 1144 bytes} [Wed Aug 24 05:55:28 2022] POST /identity/v3/users => generated 288 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:55:28.524832 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216820f8-940c-48b2-b1c6-043a5b43ab57 admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:55:28.535723 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216820f8-940c-48b2-b1c6-043a5b43ab57 admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:55:28.540359 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49344f4d-ddc5-4b9d-8e78-ecf6536cd20f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:55:28.540965 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49344f4d-ddc5-4b9d-8e78-ecf6536cd20f admin admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:55:28.541242 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49344f4d-ddc5-4b9d-8e78-ecf6536cd20f admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:55:28.541509 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49344f4d-ddc5-4b9d-8e78-ecf6536cd20f admin admin] PATH_INFO: `/v3/roles` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:55:28.542175 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49344f4d-ddc5-4b9d-8e78-ecf6536cd20f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:55:28.543763 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49344f4d-ddc5-4b9d-8e78-ecf6536cd20f admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:55:28.553730 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1301/2609] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Aug 24 05:55:28 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:55:28.557756 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667bc74e-1c2e-4ad7-bb3e-7e64dd96e572 admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:55:28.568474 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667bc74e-1c2e-4ad7-bb3e-7e64dd96e572 admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:55:28.573167 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f03741c-e421-4bae-99e1-c9a788b88090 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:55:28.573756 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f03741c-e421-4bae-99e1-c9a788b88090 admin admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:55:28.574064 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f03741c-e421-4bae-99e1-c9a788b88090 admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:55:28.574989 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f03741c-e421-4bae-99e1-c9a788b88090 admin admin] PATH_INFO: `/v3/roles` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:55:28.575632 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f03741c-e421-4bae-99e1-c9a788b88090 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:55:28.577207 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f03741c-e421-4bae-99e1-c9a788b88090 admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:55:28.587562 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1309/2610] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Aug 24 05:55:28 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:55:28.591523 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49344f4d-ddc5-4b9d-8e78-ecf6536cd20f admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:55:28.601261 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49344f4d-ddc5-4b9d-8e78-ecf6536cd20f admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:55:28.605833 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f79deb3-ce9b-4f84-8bc1-7d554e2fb66a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:55:28.606513 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f79deb3-ce9b-4f84-8bc1-7d554e2fb66a admin admin] REQUEST_METHOD: `PUT` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:55:28.606798 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f79deb3-ce9b-4f84-8bc1-7d554e2fb66a admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:55:28.607073 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f79deb3-ce9b-4f84-8bc1-7d554e2fb66a admin admin] PATH_INFO: `/v3/projects/62a0d378d97d45d8bbcf8801a5fe3f5b/users/0addf0952a494d02843ad120037b947b/roles/f7aa4a2c74c94c1b9ca8ecdcccccda5c` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:55:28.615104 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:55:28.624102 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f79deb3-ce9b-4f84-8bc1-7d554e2fb66a admin admin] RBAC: Authorizing `identity:create_grant(project_id=62a0d378d97d45d8bbcf8801a5fe3f5b, user_id=0addf0952a494d02843ad120037b947b, role_id=f7aa4a2c74c94c1b9ca8ecdcccccda5c)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:55:28.626804 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f79deb3-ce9b-4f84-8bc1-7d554e2fb66a admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:55:28.639960 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1302/2611] 10.222.0.26 () {60 vars in 1483 bytes} [Wed Aug 24 05:55:28 2022] PUT /identity/v3/projects/62a0d378d97d45d8bbcf8801a5fe3f5b/users/0addf0952a494d02843ad120037b947b/roles/f7aa4a2c74c94c1b9ca8ecdcccccda5c => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:55:28.651260 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faf6e65-e425-44a3-b98c-4a2c188820c3 None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:55:28.651892 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faf6e65-e425-44a3-b98c-4a2c188820c3 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:55:28.651892 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faf6e65-e425-44a3-b98c-4a2c188820c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:55:28.686028 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-6faf6e65-e425-44a3-b98c-4a2c188820c3 None None] MFA Rules not processed for user `0addf0952a494d02843ad120037b947b`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:55:28.687284 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-6faf6e65-e425-44a3-b98c-4a2c188820c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:55:28.736628 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:55:28.768609 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1310/2612] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:55:28 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:55:28.773453 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f79deb3-ce9b-4f84-8bc1-7d554e2fb66a admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:55:28.836497 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f79deb3-ce9b-4f84-8bc1-7d554e2fb66a admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:55:28.841782 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ca4e45-1035-4b83-916a-54b763d4e2ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:55:28.842532 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ca4e45-1035-4b83-916a-54b763d4e2ff admin admin] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:55:28.842903 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ca4e45-1035-4b83-916a-54b763d4e2ff admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:55:28.843174 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ca4e45-1035-4b83-916a-54b763d4e2ff admin admin] PATH_INFO: `/v3/projects` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:55:28.843836 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ca4e45-1035-4b83-916a-54b763d4e2ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:55:28.845938 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ca4e45-1035-4b83-916a-54b763d4e2ff admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:55:28.876825 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1303/2613] 10.222.0.26 () {60 vars in 1153 bytes} [Wed Aug 24 05:55:28 2022] POST /identity/v3/projects => generated 375 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:55:28.880787 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faf6e65-e425-44a3-b98c-4a2c188820c3 None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:55:28.892804 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faf6e65-e425-44a3-b98c-4a2c188820c3 None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:55:28.950923 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da193e78-2ec6-4683-9664-8d5e1f8c2f67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:55:28.951532 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da193e78-2ec6-4683-9664-8d5e1f8c2f67 admin admin] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:55:28.951815 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da193e78-2ec6-4683-9664-8d5e1f8c2f67 admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:55:28.952091 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da193e78-2ec6-4683-9664-8d5e1f8c2f67 admin admin] PATH_INFO: `/v3/users` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:55:28.952725 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da193e78-2ec6-4683-9664-8d5e1f8c2f67 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:55:28.954694 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da193e78-2ec6-4683-9664-8d5e1f8c2f67 admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:55:28.975679 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1311/2614] 10.222.0.26 () {60 vars in 1144 bytes} [Wed Aug 24 05:55:28 2022] POST /identity/v3/users => generated 294 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:55:28.979649 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ca4e45-1035-4b83-916a-54b763d4e2ff admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:55:28.989816 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ca4e45-1035-4b83-916a-54b763d4e2ff admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:55:28.994466 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923a8613-984e-48a8-9839-020bbe143d8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:55:28.995052 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923a8613-984e-48a8-9839-020bbe143d8f admin admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:55:28.995323 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923a8613-984e-48a8-9839-020bbe143d8f admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:55:28.995588 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923a8613-984e-48a8-9839-020bbe143d8f admin admin] PATH_INFO: `/v3/roles` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:55:28.996725 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923a8613-984e-48a8-9839-020bbe143d8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:55:28.998377 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923a8613-984e-48a8-9839-020bbe143d8f admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:55:29.007929 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1304/2615] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Aug 24 05:55:28 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:55:29.012498 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da193e78-2ec6-4683-9664-8d5e1f8c2f67 admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:55:29.022464 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da193e78-2ec6-4683-9664-8d5e1f8c2f67 admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:55:29.027019 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7fdba5-2bab-4b18-9efe-acaa20dfed9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:55:29.027683 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7fdba5-2bab-4b18-9efe-acaa20dfed9a admin admin] REQUEST_METHOD: `PUT` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:55:29.027970 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7fdba5-2bab-4b18-9efe-acaa20dfed9a admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:55:29.028729 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7fdba5-2bab-4b18-9efe-acaa20dfed9a admin admin] PATH_INFO: `/v3/projects/d229817e942246628d615c6ee5ffc136/users/c704447096e84212bb9009b7b9472f49/roles/640bda0879494e60b72680ee505285f0` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:55:29.043487 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7fdba5-2bab-4b18-9efe-acaa20dfed9a admin admin] RBAC: Authorizing `identity:create_grant(project_id=d229817e942246628d615c6ee5ffc136, user_id=c704447096e84212bb9009b7b9472f49, role_id=640bda0879494e60b72680ee505285f0)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:55:29.046163 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7fdba5-2bab-4b18-9efe-acaa20dfed9a admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:55:29.060720 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1312/2616] 10.222.0.26 () {60 vars in 1483 bytes} [Wed Aug 24 05:55:29 2022] PUT /identity/v3/projects/d229817e942246628d615c6ee5ffc136/users/c704447096e84212bb9009b7b9472f49/roles/640bda0879494e60b72680ee505285f0 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:55:29.064726 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923a8613-984e-48a8-9839-020bbe143d8f admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:55:29.075508 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923a8613-984e-48a8-9839-020bbe143d8f admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:55:29.129190 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430654d3-99de-485e-a6dc-8cff61cf9e1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:55:29.129811 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430654d3-99de-485e-a6dc-8cff61cf9e1d admin admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:55:29.130062 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430654d3-99de-485e-a6dc-8cff61cf9e1d admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:55:29.130333 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430654d3-99de-485e-a6dc-8cff61cf9e1d admin admin] PATH_INFO: `/v3/roles` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:55:29.130957 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430654d3-99de-485e-a6dc-8cff61cf9e1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:55:29.132510 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430654d3-99de-485e-a6dc-8cff61cf9e1d admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:55:29.142724 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1305/2617] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Aug 24 05:55:29 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:55:29.146836 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7fdba5-2bab-4b18-9efe-acaa20dfed9a admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:55:29.157135 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7fdba5-2bab-4b18-9efe-acaa20dfed9a admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:55:29.161798 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8122cab-34d1-4ca5-ab77-047a975b448d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:55:29.162487 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8122cab-34d1-4ca5-ab77-047a975b448d admin admin] REQUEST_METHOD: `PUT` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:55:29.162768 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8122cab-34d1-4ca5-ab77-047a975b448d admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:55:29.163038 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8122cab-34d1-4ca5-ab77-047a975b448d admin admin] PATH_INFO: `/v3/projects/d229817e942246628d615c6ee5ffc136/users/c704447096e84212bb9009b7b9472f49/roles/640bda0879494e60b72680ee505285f0` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:55:29.164951 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8122cab-34d1-4ca5-ab77-047a975b448d admin admin] RBAC: Authorizing `identity:create_grant(project_id=d229817e942246628d615c6ee5ffc136, user_id=c704447096e84212bb9009b7b9472f49, role_id=640bda0879494e60b72680ee505285f0)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:55:29.167603 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8122cab-34d1-4ca5-ab77-047a975b448d admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:55:29.177558 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1313/2618] 10.222.0.26 () {60 vars in 1483 bytes} [Wed Aug 24 05:55:29 2022] PUT /identity/v3/projects/d229817e942246628d615c6ee5ffc136/users/c704447096e84212bb9009b7b9472f49/roles/640bda0879494e60b72680ee505285f0 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:55:29.188205 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd17b4e-6924-42a7-96b6-d13dfb8e2d17 None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:55:29.188496 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd17b4e-6924-42a7-96b6-d13dfb8e2d17 None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:55:29.188774 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd17b4e-6924-42a7-96b6-d13dfb8e2d17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:55:29.216266 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-fdd17b4e-6924-42a7-96b6-d13dfb8e2d17 None None] MFA Rules not processed for user `c704447096e84212bb9009b7b9472f49`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:55:29.217477 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-fdd17b4e-6924-42a7-96b6-d13dfb8e2d17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:55:29.264102 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:55:29.288994 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1306/2619] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:55:29 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:55:29.300072 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8122cab-34d1-4ca5-ab77-047a975b448d admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:55:29.301847 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-c8122cab-34d1-4ca5-ab77-047a975b448d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:55:29.361044 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8122cab-34d1-4ca5-ab77-047a975b448d admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:55:29.364857 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d0180e-6e9a-4265-afa9-ce842fe83a09 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17b450afe795495680fc70f522c83750', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:55:29.365445 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d0180e-6e9a-4265-afa9-ce842fe83a09 service cinder] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:55:29.365721 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d0180e-6e9a-4265-afa9-ce842fe83a09 service cinder] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:55:29.366014 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d0180e-6e9a-4265-afa9-ce842fe83a09 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:55:29.408035 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:55:29.421658 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d0180e-6e9a-4265-afa9-ce842fe83a09 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:55:29.423123 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d0180e-6e9a-4265-afa9-ce842fe83a09 service cinder] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:55:29.431814 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1314/2620] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 24 05:55:29 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:55:31.974812 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd17b4e-6924-42a7-96b6-d13dfb8e2d17 None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:55:31.985003 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd17b4e-6924-42a7-96b6-d13dfb8e2d17 None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:55:31.988577 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12d24db-9a95-4f6c-a9ef-ff16fbd44e2c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17b450afe795495680fc70f522c83750', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:55:31.989200 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12d24db-9a95-4f6c-a9ef-ff16fbd44e2c service cinder] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:55:31.989474 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12d24db-9a95-4f6c-a9ef-ff16fbd44e2c service cinder] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:55:31.989737 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12d24db-9a95-4f6c-a9ef-ff16fbd44e2c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:55:31.998559 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12d24db-9a95-4f6c-a9ef-ff16fbd44e2c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:55:31.999955 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12d24db-9a95-4f6c-a9ef-ff16fbd44e2c service cinder] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:55:32.009299 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1307/2621] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 24 05:55:31 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:55:37.391696 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d0180e-6e9a-4265-afa9-ce842fe83a09 service cinder] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:55:37.393139 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-36d0180e-6e9a-4265-afa9-ce842fe83a09 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:55:37.457506 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d0180e-6e9a-4265-afa9-ce842fe83a09 service cinder] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:55:37.462084 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a413fd08-cc5e-4385-ba2d-35545ec27f01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:55:37.462707 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a413fd08-cc5e-4385-ba2d-35545ec27f01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:55:37.462989 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a413fd08-cc5e-4385-ba2d-35545ec27f01 admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:55:37.463267 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a413fd08-cc5e-4385-ba2d-35545ec27f01 admin admin] PATH_INFO: `/v3/users/8cbf99ec41464abd8e725a0a34c492ea` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:55:37.464405 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a413fd08-cc5e-4385-ba2d-35545ec27f01 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8cbf99ec41464abd8e725a0a34c492ea)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:55:37.466360 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a413fd08-cc5e-4385-ba2d-35545ec27f01 admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:55:37.512423 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-a413fd08-cc5e-4385-ba2d-35545ec27f01 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8cbf99ec41464abd8e725a0a34c492ea'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:55:37.519842 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-a413fd08-cc5e-4385-ba2d-35545ec27f01 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8cbf99ec41464abd8e725a0a34c492ea'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:55:37.520506 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-a413fd08-cc5e-4385-ba2d-35545ec27f01 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8cbf99ec41464abd8e725a0a34c492ea'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:55:37.532537 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-a413fd08-cc5e-4385-ba2d-35545ec27f01 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8cbf99ec41464abd8e725a0a34c492ea'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:55:37.543456 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-a413fd08-cc5e-4385-ba2d-35545ec27f01 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8cbf99ec41464abd8e725a0a34c492ea'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:55:37.550065 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1315/2622] 10.222.0.26 () {58 vars in 1224 bytes} [Wed Aug 24 05:55:37 2022] DELETE /identity/v3/users/8cbf99ec41464abd8e725a0a34c492ea => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:55:37.554566 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a89bf6c-57c5-4345-b853-19e3d6162cf1 None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:55:37.555032 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a89bf6c-57c5-4345-b853-19e3d6162cf1 None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:55:37.555256 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a89bf6c-57c5-4345-b853-19e3d6162cf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:55:37.573932 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-9a89bf6c-57c5-4345-b853-19e3d6162cf1 None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:55:37.575168 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-9a89bf6c-57c5-4345-b853-19e3d6162cf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:55:37.633714 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1308/2623] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:55:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:55:37.644326 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a413fd08-cc5e-4385-ba2d-35545ec27f01 admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:55:37.645777 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-a413fd08-cc5e-4385-ba2d-35545ec27f01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:55:37.704309 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a413fd08-cc5e-4385-ba2d-35545ec27f01 admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:55:37.708039 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea55aab-b792-46cc-8bd0-ed878b7aaebd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '874348b647194ac2b5ecbf12c33bf59e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:55:37.708670 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea55aab-b792-46cc-8bd0-ed878b7aaebd service neutron] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:55:37.708946 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea55aab-b792-46cc-8bd0-ed878b7aaebd service neutron] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:55:37.709212 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea55aab-b792-46cc-8bd0-ed878b7aaebd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:55:37.718814 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea55aab-b792-46cc-8bd0-ed878b7aaebd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:55:37.720242 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea55aab-b792-46cc-8bd0-ed878b7aaebd service neutron] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:55:37.729750 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1316/2624] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 24 05:55:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:55:37.992829 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a89bf6c-57c5-4345-b853-19e3d6162cf1 None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:55:37.994314 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-9a89bf6c-57c5-4345-b853-19e3d6162cf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:55:38.006766 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a89bf6c-57c5-4345-b853-19e3d6162cf1 None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:55:38.011500 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79f5dc6-4719-4cbc-af3e-c13f839d7670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:55:38.012179 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79f5dc6-4719-4cbc-af3e-c13f839d7670 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:55:38.012451 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79f5dc6-4719-4cbc-af3e-c13f839d7670 admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:55:38.012716 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79f5dc6-4719-4cbc-af3e-c13f839d7670 admin admin] PATH_INFO: `/v3/projects/d7238c33a1834970b30e4fb3dbf5e9df` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:55:38.013831 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79f5dc6-4719-4cbc-af3e-c13f839d7670 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d7238c33a1834970b30e4fb3dbf5e9df)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:55:38.016343 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79f5dc6-4719-4cbc-af3e-c13f839d7670 admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:55:38.069864 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-e79f5dc6-4719-4cbc-af3e-c13f839d7670 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd7238c33a1834970b30e4fb3dbf5e9df', 'request_id': 'req-e79f5dc6-4719-4cbc-af3e-c13f839d7670'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:55:38.077402 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-e79f5dc6-4719-4cbc-af3e-c13f839d7670 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd7238c33a1834970b30e4fb3dbf5e9df', 'request_id': 'req-e79f5dc6-4719-4cbc-af3e-c13f839d7670'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:55:38.083867 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-e79f5dc6-4719-4cbc-af3e-c13f839d7670 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd7238c33a1834970b30e4fb3dbf5e9df', 'request_id': 'req-e79f5dc6-4719-4cbc-af3e-c13f839d7670'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:55:38.094284 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-e79f5dc6-4719-4cbc-af3e-c13f839d7670 admin admin] The token cache is being invalidate because project d7238c33a1834970b30e4fb3dbf5e9df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88112) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:55:38.094581 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-e79f5dc6-4719-4cbc-af3e-c13f839d7670 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:55:38.095208 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-e79f5dc6-4719-4cbc-af3e-c13f839d7670 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:55:38.096716 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1309/2625] 10.222.0.26 () {58 vars in 1233 bytes} [Wed Aug 24 05:55:37 2022] DELETE /identity/v3/projects/d7238c33a1834970b30e4fb3dbf5e9df => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 05:55:38.101642 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c6e429-654d-4fc7-af82-45163bc5d380 None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:55:38.101931 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c6e429-654d-4fc7-af82-45163bc5d380 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:55:38.102239 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c6e429-654d-4fc7-af82-45163bc5d380 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:55:38.115693 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:55:38.122210 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-49c6e429-654d-4fc7-af82-45163bc5d380 None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:55:38.125043 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-49c6e429-654d-4fc7-af82-45163bc5d380 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:55:38.183040 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1317/2626] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:55:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:55:38.191155 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c49f76-591f-4cbb-86dc-307d54f22e5c None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:55:38.191439 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c49f76-591f-4cbb-86dc-307d54f22e5c None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:55:38.191964 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c49f76-591f-4cbb-86dc-307d54f22e5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:55:38.211419 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-85c49f76-591f-4cbb-86dc-307d54f22e5c None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:55:38.212635 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-85c49f76-591f-4cbb-86dc-307d54f22e5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:55:38.220821 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1310/2627] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:55:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:55:38.224880 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c6e429-654d-4fc7-af82-45163bc5d380 None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:55:38.234444 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c6e429-654d-4fc7-af82-45163bc5d380 None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:55:38.242175 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d839e7-4ab8-432c-869e-4737e9e70b99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:55:38.242812 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d839e7-4ab8-432c-869e-4737e9e70b99 admin admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:55:38.243097 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d839e7-4ab8-432c-869e-4737e9e70b99 admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:55:38.243368 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d839e7-4ab8-432c-869e-4737e9e70b99 admin admin] PATH_INFO: `/v3/domains` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:55:38.244019 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d839e7-4ab8-432c-869e-4737e9e70b99 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:55:38.244436 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d839e7-4ab8-432c-869e-4737e9e70b99 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:55:38.246095 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d839e7-4ab8-432c-869e-4737e9e70b99 admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:55:38.259896 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1318/2628] 10.222.0.26 () {58 vars in 1153 bytes} [Wed Aug 24 05:55:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:55:38.265035 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c49f76-591f-4cbb-86dc-307d54f22e5c None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:55:38.274358 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c49f76-591f-4cbb-86dc-307d54f22e5c None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:55:38.279124 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebaada1-740b-4946-ba67-c4a6bbd75c3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:55:38.279752 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebaada1-740b-4946-ba67-c4a6bbd75c3c admin admin] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:55:38.280093 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebaada1-740b-4946-ba67-c4a6bbd75c3c admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:55:38.280290 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebaada1-740b-4946-ba67-c4a6bbd75c3c admin admin] PATH_INFO: `/v3/projects` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:55:38.280908 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebaada1-740b-4946-ba67-c4a6bbd75c3c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:55:38.282821 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebaada1-740b-4946-ba67-c4a6bbd75c3c admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:55:38.311677 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1311/2629] 10.222.0.26 () {60 vars in 1153 bytes} [Wed Aug 24 05:55:38 2022] POST /identity/v3/projects => generated 373 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 05:55:38.316204 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d839e7-4ab8-432c-869e-4737e9e70b99 admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:55:38.332705 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d839e7-4ab8-432c-869e-4737e9e70b99 admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:55:38.394029 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d5142b-d920-4a44-a5fa-dd39568ef978 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:55:38.394638 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d5142b-d920-4a44-a5fa-dd39568ef978 admin admin] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:55:38.395263 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d5142b-d920-4a44-a5fa-dd39568ef978 admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:55:38.395263 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d5142b-d920-4a44-a5fa-dd39568ef978 admin admin] PATH_INFO: `/v3/users` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:55:38.395927 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d5142b-d920-4a44-a5fa-dd39568ef978 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:55:38.398472 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d5142b-d920-4a44-a5fa-dd39568ef978 admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:55:38.419761 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1319/2630] 10.222.0.26 () {60 vars in 1144 bytes} [Wed Aug 24 05:55:38 2022] POST /identity/v3/users => generated 287 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 05:55:38.424556 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebaada1-740b-4946-ba67-c4a6bbd75c3c admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:55:38.434957 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebaada1-740b-4946-ba67-c4a6bbd75c3c admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:55:38.440226 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cd80fb-4b45-4ba2-91e6-628073e50ccd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:55:38.440817 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cd80fb-4b45-4ba2-91e6-628073e50ccd admin admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:55:38.441092 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cd80fb-4b45-4ba2-91e6-628073e50ccd admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:55:38.441356 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cd80fb-4b45-4ba2-91e6-628073e50ccd admin admin] PATH_INFO: `/v3/roles` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:55:38.442283 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cd80fb-4b45-4ba2-91e6-628073e50ccd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:55:38.443854 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cd80fb-4b45-4ba2-91e6-628073e50ccd admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:55:38.454157 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1312/2631] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Aug 24 05:55:38 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:55:38.458201 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d5142b-d920-4a44-a5fa-dd39568ef978 admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:55:38.468354 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d5142b-d920-4a44-a5fa-dd39568ef978 admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:55:38.472991 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2197896-4923-41a3-b60a-cc89c0443d16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:55:38.473615 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2197896-4923-41a3-b60a-cc89c0443d16 admin admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:55:38.473894 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2197896-4923-41a3-b60a-cc89c0443d16 admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:55:38.474210 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2197896-4923-41a3-b60a-cc89c0443d16 admin admin] PATH_INFO: `/v3/roles` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:55:38.474844 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2197896-4923-41a3-b60a-cc89c0443d16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:55:38.476440 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2197896-4923-41a3-b60a-cc89c0443d16 admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:55:38.487403 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1320/2632] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Aug 24 05:55:38 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:55:38.491349 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cd80fb-4b45-4ba2-91e6-628073e50ccd admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:55:38.502044 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cd80fb-4b45-4ba2-91e6-628073e50ccd admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:55:38.506505 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6daf93-4261-4fb7-bf30-99409d960431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:55:38.507140 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6daf93-4261-4fb7-bf30-99409d960431 admin admin] REQUEST_METHOD: `PUT` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:55:38.507417 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6daf93-4261-4fb7-bf30-99409d960431 admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:55:38.507714 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6daf93-4261-4fb7-bf30-99409d960431 admin admin] PATH_INFO: `/v3/projects/938d6d4db870409a8d2d15586ab1b0ec/users/aca1ac97884743198ce912f892b2644d/roles/f7aa4a2c74c94c1b9ca8ecdcccccda5c` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:55:38.518487 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:55:38.523080 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6daf93-4261-4fb7-bf30-99409d960431 admin admin] RBAC: Authorizing `identity:create_grant(project_id=938d6d4db870409a8d2d15586ab1b0ec, user_id=aca1ac97884743198ce912f892b2644d, role_id=f7aa4a2c74c94c1b9ca8ecdcccccda5c)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:55:38.525801 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6daf93-4261-4fb7-bf30-99409d960431 admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:55:38.543469 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1313/2633] 10.222.0.26 () {60 vars in 1483 bytes} [Wed Aug 24 05:55:38 2022] PUT /identity/v3/projects/938d6d4db870409a8d2d15586ab1b0ec/users/aca1ac97884743198ce912f892b2644d/roles/f7aa4a2c74c94c1b9ca8ecdcccccda5c => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:55:38.548940 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fd13a9-ae6f-4236-9e7b-081d9707149f None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:55:38.549276 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fd13a9-ae6f-4236-9e7b-081d9707149f None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:55:38.549575 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fd13a9-ae6f-4236-9e7b-081d9707149f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:55:38.569187 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-b8fd13a9-ae6f-4236-9e7b-081d9707149f None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:55:38.570403 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-b8fd13a9-ae6f-4236-9e7b-081d9707149f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:55:38.627052 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1321/2634] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:55:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:55:38.637017 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6daf93-4261-4fb7-bf30-99409d960431 admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:55:38.638882 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-4c6daf93-4261-4fb7-bf30-99409d960431 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:55:38.695299 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6daf93-4261-4fb7-bf30-99409d960431 admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:55:38.698798 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f43907b-bb15-4d78-a823-0958d11d66e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '874348b647194ac2b5ecbf12c33bf59e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:55:38.699396 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f43907b-bb15-4d78-a823-0958d11d66e8 service neutron] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:55:38.699677 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f43907b-bb15-4d78-a823-0958d11d66e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:55:38.699950 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f43907b-bb15-4d78-a823-0958d11d66e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:55:38.709234 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f43907b-bb15-4d78-a823-0958d11d66e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:55:38.710680 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f43907b-bb15-4d78-a823-0958d11d66e8 service neutron] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:55:38.719930 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1314/2635] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 24 05:55:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:55:42.698862 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94caf9ea-86c4-439b-8bee-e72db778a9cf None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:55:42.699727 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94caf9ea-86c4-439b-8bee-e72db778a9cf None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:55:42.700005 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94caf9ea-86c4-439b-8bee-e72db778a9cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:55:42.727103 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:55:42.730661 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-94caf9ea-86c4-439b-8bee-e72db778a9cf None None] MFA Rules not processed for user `aca1ac97884743198ce912f892b2644d`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:55:42.731998 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-94caf9ea-86c4-439b-8bee-e72db778a9cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:55:42.810215 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1322/2636] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:55:42 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:55:42.814874 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f43907b-bb15-4d78-a823-0958d11d66e8 service neutron] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:55:42.825331 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f43907b-bb15-4d78-a823-0958d11d66e8 service neutron] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:55:42.830540 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31c7098-cd9e-45bf-a600-ce8512c66b99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:55:42.831151 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31c7098-cd9e-45bf-a600-ce8512c66b99 admin admin] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:55:42.831429 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31c7098-cd9e-45bf-a600-ce8512c66b99 admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:55:42.834857 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31c7098-cd9e-45bf-a600-ce8512c66b99 admin admin] PATH_INFO: `/v3/projects` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:55:42.835535 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31c7098-cd9e-45bf-a600-ce8512c66b99 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:55:42.837483 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31c7098-cd9e-45bf-a600-ce8512c66b99 admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:55:42.883898 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1315/2637] 10.222.0.26 () {60 vars in 1153 bytes} [Wed Aug 24 05:55:42 2022] POST /identity/v3/projects => generated 371 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 05:55:42.890017 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94caf9ea-86c4-439b-8bee-e72db778a9cf None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:55:42.903230 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94caf9ea-86c4-439b-8bee-e72db778a9cf None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:55:42.964113 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e1351e-8fe9-419a-82b0-aa9f3d56555e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:55:42.964821 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e1351e-8fe9-419a-82b0-aa9f3d56555e admin admin] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:55:42.965004 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e1351e-8fe9-419a-82b0-aa9f3d56555e admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:55:42.965273 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e1351e-8fe9-419a-82b0-aa9f3d56555e admin admin] PATH_INFO: `/v3/users` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:55:42.965902 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e1351e-8fe9-419a-82b0-aa9f3d56555e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:55:42.968153 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e1351e-8fe9-419a-82b0-aa9f3d56555e admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:55:42.990800 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1323/2638] 10.222.0.26 () {60 vars in 1144 bytes} [Wed Aug 24 05:55:42 2022] POST /identity/v3/users => generated 292 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:55:42.995072 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31c7098-cd9e-45bf-a600-ce8512c66b99 admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:55:43.006852 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31c7098-cd9e-45bf-a600-ce8512c66b99 admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:55:43.011841 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867c21f2-4969-4fc1-805a-2fbe5b41d11d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:55:43.012490 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867c21f2-4969-4fc1-805a-2fbe5b41d11d admin admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:55:43.012770 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867c21f2-4969-4fc1-805a-2fbe5b41d11d admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:55:43.013169 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867c21f2-4969-4fc1-805a-2fbe5b41d11d admin admin] PATH_INFO: `/v3/roles` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:55:43.014142 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867c21f2-4969-4fc1-805a-2fbe5b41d11d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:55:43.016449 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867c21f2-4969-4fc1-805a-2fbe5b41d11d admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:55:43.030018 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1316/2639] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Aug 24 05:55:42 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:55:43.034654 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e1351e-8fe9-419a-82b0-aa9f3d56555e admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:55:43.047085 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e1351e-8fe9-419a-82b0-aa9f3d56555e admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:55:43.053229 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c70e7e4-2bc5-431e-8f2e-3a7e501ab214 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:55:43.053985 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c70e7e4-2bc5-431e-8f2e-3a7e501ab214 admin admin] REQUEST_METHOD: `PUT` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:55:43.054296 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c70e7e4-2bc5-431e-8f2e-3a7e501ab214 admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:55:43.054595 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c70e7e4-2bc5-431e-8f2e-3a7e501ab214 admin admin] PATH_INFO: `/v3/projects/b1ee4f2e7e114c9b82fae57b6bf53282/users/cee8dc4ad3764d74b184a3262ac9d334/roles/640bda0879494e60b72680ee505285f0` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:55:43.073164 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c70e7e4-2bc5-431e-8f2e-3a7e501ab214 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1ee4f2e7e114c9b82fae57b6bf53282, user_id=cee8dc4ad3764d74b184a3262ac9d334, role_id=640bda0879494e60b72680ee505285f0)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:55:43.076098 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c70e7e4-2bc5-431e-8f2e-3a7e501ab214 admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:55:43.092302 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1324/2640] 10.222.0.26 () {60 vars in 1483 bytes} [Wed Aug 24 05:55:43 2022] PUT /identity/v3/projects/b1ee4f2e7e114c9b82fae57b6bf53282/users/cee8dc4ad3764d74b184a3262ac9d334/roles/640bda0879494e60b72680ee505285f0 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:55:43.096347 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867c21f2-4969-4fc1-805a-2fbe5b41d11d admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:55:43.108142 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867c21f2-4969-4fc1-805a-2fbe5b41d11d admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:55:43.178491 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e49448-c652-437c-b342-239fc45ae491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:55:43.179271 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e49448-c652-437c-b342-239fc45ae491 admin admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:55:43.179908 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e49448-c652-437c-b342-239fc45ae491 admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:55:43.180372 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e49448-c652-437c-b342-239fc45ae491 admin admin] PATH_INFO: `/v3/roles` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:55:43.181411 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e49448-c652-437c-b342-239fc45ae491 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:55:43.183515 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e49448-c652-437c-b342-239fc45ae491 admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:55:43.199322 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1317/2641] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Aug 24 05:55:43 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:55:43.203284 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c70e7e4-2bc5-431e-8f2e-3a7e501ab214 admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:55:43.215998 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c70e7e4-2bc5-431e-8f2e-3a7e501ab214 admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:55:43.222163 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abca76a3-d853-4879-833b-2119b4d8cfa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:55:43.223510 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abca76a3-d853-4879-833b-2119b4d8cfa0 admin admin] REQUEST_METHOD: `PUT` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:55:43.223510 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abca76a3-d853-4879-833b-2119b4d8cfa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:55:43.223709 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abca76a3-d853-4879-833b-2119b4d8cfa0 admin admin] PATH_INFO: `/v3/projects/b1ee4f2e7e114c9b82fae57b6bf53282/users/cee8dc4ad3764d74b184a3262ac9d334/roles/640bda0879494e60b72680ee505285f0` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:55:43.226012 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abca76a3-d853-4879-833b-2119b4d8cfa0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1ee4f2e7e114c9b82fae57b6bf53282, user_id=cee8dc4ad3764d74b184a3262ac9d334, role_id=640bda0879494e60b72680ee505285f0)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:55:43.228741 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abca76a3-d853-4879-833b-2119b4d8cfa0 admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:55:43.245830 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1325/2642] 10.222.0.26 () {60 vars in 1483 bytes} [Wed Aug 24 05:55:43 2022] PUT /identity/v3/projects/b1ee4f2e7e114c9b82fae57b6bf53282/users/cee8dc4ad3764d74b184a3262ac9d334/roles/640bda0879494e60b72680ee505285f0 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:55:44.767944 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e49448-c652-437c-b342-239fc45ae491 admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:55:44.771910 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-e9e49448-c652-437c-b342-239fc45ae491 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:55:44.791411 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e49448-c652-437c-b342-239fc45ae491 admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:55:44.850888 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:55:44.861228 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e51f6c7-9b8e-4aab-b5dc-25d33e51acf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:55:44.862182 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e51f6c7-9b8e-4aab-b5dc-25d33e51acf1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:55:44.862620 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e51f6c7-9b8e-4aab-b5dc-25d33e51acf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:55:44.863078 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e51f6c7-9b8e-4aab-b5dc-25d33e51acf1 admin admin] PATH_INFO: `/v3/users/0addf0952a494d02843ad120037b947b` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:55:44.864465 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e51f6c7-9b8e-4aab-b5dc-25d33e51acf1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0addf0952a494d02843ad120037b947b)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:55:44.866904 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e51f6c7-9b8e-4aab-b5dc-25d33e51acf1 admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:55:44.956440 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-7e51f6c7-9b8e-4aab-b5dc-25d33e51acf1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0addf0952a494d02843ad120037b947b'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:55:44.965698 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-7e51f6c7-9b8e-4aab-b5dc-25d33e51acf1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0addf0952a494d02843ad120037b947b'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:55:44.993025 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-7e51f6c7-9b8e-4aab-b5dc-25d33e51acf1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0addf0952a494d02843ad120037b947b'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:55:45.004534 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-7e51f6c7-9b8e-4aab-b5dc-25d33e51acf1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0addf0952a494d02843ad120037b947b'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:55:45.005214 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-7e51f6c7-9b8e-4aab-b5dc-25d33e51acf1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0addf0952a494d02843ad120037b947b'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:55:45.013415 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1318/2643] 10.222.0.26 () {58 vars in 1224 bytes} [Wed Aug 24 05:55:44 2022] DELETE /identity/v3/users/0addf0952a494d02843ad120037b947b => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:55:45.018556 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f05d6d7-680f-4e3a-98c2-9f116e15b9e9 None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:55:45.019519 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f05d6d7-680f-4e3a-98c2-9f116e15b9e9 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:55:45.019808 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f05d6d7-680f-4e3a-98c2-9f116e15b9e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:55:45.042027 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-3f05d6d7-680f-4e3a-98c2-9f116e15b9e9 None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:55:45.043697 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-3f05d6d7-680f-4e3a-98c2-9f116e15b9e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:55:45.143861 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:55:45.159586 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1326/2644] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:55:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:55:45.171270 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e51f6c7-9b8e-4aab-b5dc-25d33e51acf1 admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:55:45.172729 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-7e51f6c7-9b8e-4aab-b5dc-25d33e51acf1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:55:45.256759 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e51f6c7-9b8e-4aab-b5dc-25d33e51acf1 admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:55:45.266519 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aff32a5-2302-4741-ae9d-186da7c0f8ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '874348b647194ac2b5ecbf12c33bf59e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:55:45.267696 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aff32a5-2302-4741-ae9d-186da7c0f8ee service neutron] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:55:45.267979 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aff32a5-2302-4741-ae9d-186da7c0f8ee service neutron] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:55:45.268243 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aff32a5-2302-4741-ae9d-186da7c0f8ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:55:45.285445 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aff32a5-2302-4741-ae9d-186da7c0f8ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:55:45.287012 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aff32a5-2302-4741-ae9d-186da7c0f8ee service neutron] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:55:45.302610 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1319/2645] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 24 05:55:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:55:46.225293 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f05d6d7-680f-4e3a-98c2-9f116e15b9e9 None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:55:46.226864 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-3f05d6d7-680f-4e3a-98c2-9f116e15b9e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:55:46.259425 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f05d6d7-680f-4e3a-98c2-9f116e15b9e9 None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:55:46.265889 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3f9d1e-2b37-4b81-a6a5-4a79202120cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:55:46.267395 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3f9d1e-2b37-4b81-a6a5-4a79202120cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:55:46.267839 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3f9d1e-2b37-4b81-a6a5-4a79202120cb admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:55:46.268269 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3f9d1e-2b37-4b81-a6a5-4a79202120cb admin admin] PATH_INFO: `/v3/projects/62a0d378d97d45d8bbcf8801a5fe3f5b` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:55:46.270092 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3f9d1e-2b37-4b81-a6a5-4a79202120cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=62a0d378d97d45d8bbcf8801a5fe3f5b)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:55:46.273145 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3f9d1e-2b37-4b81-a6a5-4a79202120cb admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:55:46.350064 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-ab3f9d1e-2b37-4b81-a6a5-4a79202120cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '62a0d378d97d45d8bbcf8801a5fe3f5b', 'request_id': 'req-ab3f9d1e-2b37-4b81-a6a5-4a79202120cb'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:55:46.377435 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-ab3f9d1e-2b37-4b81-a6a5-4a79202120cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '62a0d378d97d45d8bbcf8801a5fe3f5b', 'request_id': 'req-ab3f9d1e-2b37-4b81-a6a5-4a79202120cb'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:55:46.386613 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-ab3f9d1e-2b37-4b81-a6a5-4a79202120cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '62a0d378d97d45d8bbcf8801a5fe3f5b', 'request_id': 'req-ab3f9d1e-2b37-4b81-a6a5-4a79202120cb'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:55:46.400444 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-ab3f9d1e-2b37-4b81-a6a5-4a79202120cb admin admin] The token cache is being invalidate because project 62a0d378d97d45d8bbcf8801a5fe3f5b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:55:46.401398 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-ab3f9d1e-2b37-4b81-a6a5-4a79202120cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:55:46.402300 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-ab3f9d1e-2b37-4b81-a6a5-4a79202120cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:55:46.411521 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1327/2646] 10.222.0.26 () {58 vars in 1233 bytes} [Wed Aug 24 05:55:46 2022] DELETE /identity/v3/projects/62a0d378d97d45d8bbcf8801a5fe3f5b => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:55:46.412343 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aff32a5-2302-4741-ae9d-186da7c0f8ee service neutron] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:55:46.424997 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aff32a5-2302-4741-ae9d-186da7c0f8ee service neutron] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:55:46.565128 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a084945-4edb-48be-8933-2d1abf2fd22f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:55:46.566007 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a084945-4edb-48be-8933-2d1abf2fd22f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:55:46.566397 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a084945-4edb-48be-8933-2d1abf2fd22f admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:55:46.567054 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a084945-4edb-48be-8933-2d1abf2fd22f admin admin] PATH_INFO: `/v3/users/c704447096e84212bb9009b7b9472f49` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:55:46.568481 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a084945-4edb-48be-8933-2d1abf2fd22f admin admin] RBAC: Authorizing `identity:delete_user(user_id=c704447096e84212bb9009b7b9472f49)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:55:46.571009 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a084945-4edb-48be-8933-2d1abf2fd22f admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:55:46.606221 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:55:46.655139 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-0a084945-4edb-48be-8933-2d1abf2fd22f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c704447096e84212bb9009b7b9472f49'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:55:46.663733 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-0a084945-4edb-48be-8933-2d1abf2fd22f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c704447096e84212bb9009b7b9472f49'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:55:46.683651 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-0a084945-4edb-48be-8933-2d1abf2fd22f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c704447096e84212bb9009b7b9472f49'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:55:46.694162 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-0a084945-4edb-48be-8933-2d1abf2fd22f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c704447096e84212bb9009b7b9472f49'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:55:46.695006 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-0a084945-4edb-48be-8933-2d1abf2fd22f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c704447096e84212bb9009b7b9472f49'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:55:46.706179 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1320/2647] 10.222.0.26 () {58 vars in 1224 bytes} [Wed Aug 24 05:55:46 2022] DELETE /identity/v3/users/c704447096e84212bb9009b7b9472f49 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:55:47.114005 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3f9d1e-2b37-4b81-a6a5-4a79202120cb admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:55:47.115551 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-ab3f9d1e-2b37-4b81-a6a5-4a79202120cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:55:47.138097 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3f9d1e-2b37-4b81-a6a5-4a79202120cb admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:55:47.269304 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f7d3db-1a55-4930-a3e4-2007955d52ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:55:47.271032 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f7d3db-1a55-4930-a3e4-2007955d52ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:55:47.271612 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f7d3db-1a55-4930-a3e4-2007955d52ae admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:55:47.272063 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f7d3db-1a55-4930-a3e4-2007955d52ae admin admin] PATH_INFO: `/v3/projects/d229817e942246628d615c6ee5ffc136` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:55:47.273472 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f7d3db-1a55-4930-a3e4-2007955d52ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=d229817e942246628d615c6ee5ffc136)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:55:47.276582 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f7d3db-1a55-4930-a3e4-2007955d52ae admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:55:47.362406 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-60f7d3db-1a55-4930-a3e4-2007955d52ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd229817e942246628d615c6ee5ffc136', 'request_id': 'req-60f7d3db-1a55-4930-a3e4-2007955d52ae'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:55:47.386078 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-60f7d3db-1a55-4930-a3e4-2007955d52ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd229817e942246628d615c6ee5ffc136', 'request_id': 'req-60f7d3db-1a55-4930-a3e4-2007955d52ae'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:55:47.395043 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-60f7d3db-1a55-4930-a3e4-2007955d52ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd229817e942246628d615c6ee5ffc136', 'request_id': 'req-60f7d3db-1a55-4930-a3e4-2007955d52ae'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:55:47.423456 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-60f7d3db-1a55-4930-a3e4-2007955d52ae admin admin] The token cache is being invalidate because project d229817e942246628d615c6ee5ffc136 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:55:47.424400 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-60f7d3db-1a55-4930-a3e4-2007955d52ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:55:47.425332 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-60f7d3db-1a55-4930-a3e4-2007955d52ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:55:47.429623 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1328/2648] 10.222.0.26 () {58 vars in 1233 bytes} [Wed Aug 24 05:55:47 2022] DELETE /identity/v3/projects/d229817e942246628d615c6ee5ffc136 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:55:47.435051 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0a5fcc-3302-40fb-b2c4-a678be9a5857 None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:55:47.436177 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0a5fcc-3302-40fb-b2c4-a678be9a5857 None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:55:47.436177 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0a5fcc-3302-40fb-b2c4-a678be9a5857 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:55:47.461402 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-2b0a5fcc-3302-40fb-b2c4-a678be9a5857 None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:55:47.462661 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-2b0a5fcc-3302-40fb-b2c4-a678be9a5857 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:55:47.542086 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1321/2649] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:55:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:55:47.549865 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1991325a-f69a-4ce3-a5c4-cc00a9d3d84e None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:55:47.550272 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1991325a-f69a-4ce3-a5c4-cc00a9d3d84e None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:55:47.550435 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1991325a-f69a-4ce3-a5c4-cc00a9d3d84e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:55:47.572297 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-1991325a-f69a-4ce3-a5c4-cc00a9d3d84e None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:55:47.573692 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-1991325a-f69a-4ce3-a5c4-cc00a9d3d84e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:55:47.582850 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1329/2650] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:55:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:55:47.587255 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0a5fcc-3302-40fb-b2c4-a678be9a5857 None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:55:47.599726 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0a5fcc-3302-40fb-b2c4-a678be9a5857 None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:55:47.605719 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94aea5a5-837e-454e-b9d8-4cde3e3bd5d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:55:47.606539 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94aea5a5-837e-454e-b9d8-4cde3e3bd5d3 admin admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:55:47.606917 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94aea5a5-837e-454e-b9d8-4cde3e3bd5d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:55:47.607367 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94aea5a5-837e-454e-b9d8-4cde3e3bd5d3 admin admin] PATH_INFO: `/v3/domains` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:55:47.608138 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94aea5a5-837e-454e-b9d8-4cde3e3bd5d3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:55:47.608590 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94aea5a5-837e-454e-b9d8-4cde3e3bd5d3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:55:47.610412 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94aea5a5-837e-454e-b9d8-4cde3e3bd5d3 admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:55:47.623805 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1322/2651] 10.222.0.26 () {58 vars in 1153 bytes} [Wed Aug 24 05:55:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:55:47.628020 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1991325a-f69a-4ce3-a5c4-cc00a9d3d84e None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:55:47.632746 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:55:47.639949 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1991325a-f69a-4ce3-a5c4-cc00a9d3d84e None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:55:47.648591 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb371b1b-e81c-4d95-a829-696c342faaee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:55:47.649245 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb371b1b-e81c-4d95-a829-696c342faaee admin admin] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:55:47.649535 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb371b1b-e81c-4d95-a829-696c342faaee admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:55:47.650090 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb371b1b-e81c-4d95-a829-696c342faaee admin admin] PATH_INFO: `/v3/projects` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:55:47.650826 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb371b1b-e81c-4d95-a829-696c342faaee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:55:47.652835 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb371b1b-e81c-4d95-a829-696c342faaee admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:55:47.686765 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1330/2652] 10.222.0.26 () {60 vars in 1153 bytes} [Wed Aug 24 05:55:47 2022] POST /identity/v3/projects => generated 379 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:55:47.691218 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94aea5a5-837e-454e-b9d8-4cde3e3bd5d3 admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:55:47.704072 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94aea5a5-837e-454e-b9d8-4cde3e3bd5d3 admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:55:47.774317 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd7cafd-f7c5-44ef-a979-e7c18126a8eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:55:47.775080 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd7cafd-f7c5-44ef-a979-e7c18126a8eb admin admin] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:55:47.775462 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd7cafd-f7c5-44ef-a979-e7c18126a8eb admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:55:47.775838 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd7cafd-f7c5-44ef-a979-e7c18126a8eb admin admin] PATH_INFO: `/v3/users` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:55:47.776611 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd7cafd-f7c5-44ef-a979-e7c18126a8eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:55:47.778805 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd7cafd-f7c5-44ef-a979-e7c18126a8eb admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:55:47.814298 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1323/2653] 10.222.0.26 () {60 vars in 1144 bytes} [Wed Aug 24 05:55:47 2022] POST /identity/v3/users => generated 290 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:55:47.815648 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb371b1b-e81c-4d95-a829-696c342faaee admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:55:47.830510 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb371b1b-e81c-4d95-a829-696c342faaee admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:55:47.840881 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a9f3f5-5c8d-4715-95c8-b8def5d8e192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:55:47.841617 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a9f3f5-5c8d-4715-95c8-b8def5d8e192 admin admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:55:47.841897 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a9f3f5-5c8d-4715-95c8-b8def5d8e192 admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:55:47.842206 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a9f3f5-5c8d-4715-95c8-b8def5d8e192 admin admin] PATH_INFO: `/v3/roles` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:55:47.842939 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a9f3f5-5c8d-4715-95c8-b8def5d8e192 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:55:47.844554 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a9f3f5-5c8d-4715-95c8-b8def5d8e192 admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:55:47.857096 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1331/2654] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Aug 24 05:55:47 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:55:47.862054 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd7cafd-f7c5-44ef-a979-e7c18126a8eb admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:55:47.873981 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd7cafd-f7c5-44ef-a979-e7c18126a8eb admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:55:47.880835 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d09796-6fb9-465a-9510-f4935bad485e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:55:47.882010 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d09796-6fb9-465a-9510-f4935bad485e admin admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:55:47.882415 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d09796-6fb9-465a-9510-f4935bad485e admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:55:47.884014 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d09796-6fb9-465a-9510-f4935bad485e admin admin] PATH_INFO: `/v3/roles` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:55:47.884824 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d09796-6fb9-465a-9510-f4935bad485e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:55:47.886779 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d09796-6fb9-465a-9510-f4935bad485e admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:55:47.903215 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1324/2655] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Aug 24 05:55:47 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:55:47.905269 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a9f3f5-5c8d-4715-95c8-b8def5d8e192 admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:55:47.918101 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a9f3f5-5c8d-4715-95c8-b8def5d8e192 admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:55:47.927623 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7c66d3-03bd-4121-acf3-62ccdf98e18e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:55:47.928644 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7c66d3-03bd-4121-acf3-62ccdf98e18e admin admin] REQUEST_METHOD: `PUT` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:55:47.929152 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7c66d3-03bd-4121-acf3-62ccdf98e18e admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:55:47.930592 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7c66d3-03bd-4121-acf3-62ccdf98e18e admin admin] PATH_INFO: `/v3/projects/b8e5548acab340ea93a5033f8d271d7b/users/3168533e54b44574947f07f6c6cf3fb2/roles/f7aa4a2c74c94c1b9ca8ecdcccccda5c` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:55:47.958116 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7c66d3-03bd-4121-acf3-62ccdf98e18e admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8e5548acab340ea93a5033f8d271d7b, user_id=3168533e54b44574947f07f6c6cf3fb2, role_id=f7aa4a2c74c94c1b9ca8ecdcccccda5c)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:55:47.962286 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7c66d3-03bd-4121-acf3-62ccdf98e18e admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:55:47.996662 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16d4fa0-ef42-48bd-846b-79480d986b5d None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:55:47.996951 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16d4fa0-ef42-48bd-846b-79480d986b5d None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:55:47.997228 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16d4fa0-ef42-48bd-846b-79480d986b5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:55:48.000617 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1332/2656] 10.222.0.26 () {60 vars in 1483 bytes} [Wed Aug 24 05:55:47 2022] PUT /identity/v3/projects/b8e5548acab340ea93a5033f8d271d7b/users/3168533e54b44574947f07f6c6cf3fb2/roles/f7aa4a2c74c94c1b9ca8ecdcccccda5c => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:55:48.005876 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:DELETE=8,keystone:SELECT=88,keystone:INSERT=4 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:55:48.060858 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-a16d4fa0-ef42-48bd-846b-79480d986b5d None None] MFA Rules not processed for user `3168533e54b44574947f07f6c6cf3fb2`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:55:48.062140 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-a16d4fa0-ef42-48bd-846b-79480d986b5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:55:48.192575 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1325/2657] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:55:47 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:55:48.198213 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7c66d3-03bd-4121-acf3-62ccdf98e18e admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:55:48.204060 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decb6a8a-9070-4f91-8a8c-bc82e89ed1bf None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:55:48.204346 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decb6a8a-9070-4f91-8a8c-bc82e89ed1bf None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:55:48.204612 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decb6a8a-9070-4f91-8a8c-bc82e89ed1bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:55:48.247265 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-decb6a8a-9070-4f91-8a8c-bc82e89ed1bf None None] MFA Rules not processed for user `cee8dc4ad3764d74b184a3262ac9d334`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:55:48.255517 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-decb6a8a-9070-4f91-8a8c-bc82e89ed1bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:55:48.315673 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7c66d3-03bd-4121-acf3-62ccdf98e18e admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:55:48.320577 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce6bdda-ac18-419a-a46e-98c01ffc5cd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:55:48.321193 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce6bdda-ac18-419a-a46e-98c01ffc5cd2 admin admin] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:55:48.321459 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce6bdda-ac18-419a-a46e-98c01ffc5cd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:55:48.321730 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce6bdda-ac18-419a-a46e-98c01ffc5cd2 admin admin] PATH_INFO: `/v3/projects` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:55:48.322588 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce6bdda-ac18-419a-a46e-98c01ffc5cd2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:55:48.324513 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce6bdda-ac18-419a-a46e-98c01ffc5cd2 admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:55:48.377248 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1333/2658] 10.222.0.26 () {60 vars in 1153 bytes} [Wed Aug 24 05:55:48 2022] POST /identity/v3/projects => generated 379 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:55:48.381234 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce6bdda-ac18-419a-a46e-98c01ffc5cd2 admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:55:48.406103 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1326/2659] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:55:48 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 05:55:48.425494 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decb6a8a-9070-4f91-8a8c-bc82e89ed1bf None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:55:48.429734 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-decb6a8a-9070-4f91-8a8c-bc82e89ed1bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:55:48.465675 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce6bdda-ac18-419a-a46e-98c01ffc5cd2 admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:55:48.471026 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b43250d-a185-4a78-93df-47d27ffc2c0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:55:48.471643 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b43250d-a185-4a78-93df-47d27ffc2c0f admin admin] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:55:48.471949 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b43250d-a185-4a78-93df-47d27ffc2c0f admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:55:48.472224 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b43250d-a185-4a78-93df-47d27ffc2c0f admin admin] PATH_INFO: `/v3/users` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:55:48.472857 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b43250d-a185-4a78-93df-47d27ffc2c0f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:55:48.474862 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b43250d-a185-4a78-93df-47d27ffc2c0f admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:55:48.502626 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1334/2660] 10.222.0.26 () {60 vars in 1144 bytes} [Wed Aug 24 05:55:48 2022] POST /identity/v3/users => generated 296 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 05:55:48.504137 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b43250d-a185-4a78-93df-47d27ffc2c0f admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:55:48.514797 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b43250d-a185-4a78-93df-47d27ffc2c0f admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:55:48.520276 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3721511f-94e5-4306-a349-8b560d6a2e0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:55:48.521032 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3721511f-94e5-4306-a349-8b560d6a2e0c admin admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:55:48.521416 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3721511f-94e5-4306-a349-8b560d6a2e0c admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:55:48.521782 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3721511f-94e5-4306-a349-8b560d6a2e0c admin admin] PATH_INFO: `/v3/roles` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:55:48.522560 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3721511f-94e5-4306-a349-8b560d6a2e0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:55:48.524251 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3721511f-94e5-4306-a349-8b560d6a2e0c admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:55:48.530562 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:55:48.538116 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1335/2661] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Aug 24 05:55:48 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:55:48.540538 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3721511f-94e5-4306-a349-8b560d6a2e0c admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:55:48.549995 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decb6a8a-9070-4f91-8a8c-bc82e89ed1bf None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:55:48.552501 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3721511f-94e5-4306-a349-8b560d6a2e0c admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:55:48.557681 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50907507-ae70-44f2-b1ee-506b7a552154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:55:48.558596 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50907507-ae70-44f2-b1ee-506b7a552154 admin admin] REQUEST_METHOD: `PUT` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:55:48.558944 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50907507-ae70-44f2-b1ee-506b7a552154 admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:55:48.559289 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50907507-ae70-44f2-b1ee-506b7a552154 admin admin] PATH_INFO: `/v3/projects/22402fd89b824f53bdd9e2f3af650641/users/2fa1db66a50d4078a3df5467cade17f8/roles/640bda0879494e60b72680ee505285f0` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:55:48.563623 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:55:48.580221 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50907507-ae70-44f2-b1ee-506b7a552154 admin admin] RBAC: Authorizing `identity:create_grant(project_id=22402fd89b824f53bdd9e2f3af650641, user_id=2fa1db66a50d4078a3df5467cade17f8, role_id=640bda0879494e60b72680ee505285f0)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:55:48.583159 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50907507-ae70-44f2-b1ee-506b7a552154 admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:55:48.602351 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1336/2662] 10.222.0.26 () {60 vars in 1483 bytes} [Wed Aug 24 05:55:48 2022] PUT /identity/v3/projects/22402fd89b824f53bdd9e2f3af650641/users/2fa1db66a50d4078a3df5467cade17f8/roles/640bda0879494e60b72680ee505285f0 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:55:48.603455 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50907507-ae70-44f2-b1ee-506b7a552154 admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:55:48.627845 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403f0136-0796-46e6-bf4b-558b9de1444e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b633e1aec6c4269bce13aa9c89e911a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:55:48.628842 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403f0136-0796-46e6-bf4b-558b9de1444e service nova] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:55:48.629302 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403f0136-0796-46e6-bf4b-558b9de1444e service nova] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:55:48.629743 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403f0136-0796-46e6-bf4b-558b9de1444e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:55:48.631789 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-403f0136-0796-46e6-bf4b-558b9de1444e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:55:48.673229 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50907507-ae70-44f2-b1ee-506b7a552154 admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:55:48.678356 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334c6bac-ccb2-4bec-8941-b85e8edd7181 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:55:48.678686 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334c6bac-ccb2-4bec-8941-b85e8edd7181 admin admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:55:48.678969 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334c6bac-ccb2-4bec-8941-b85e8edd7181 admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:55:48.679238 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334c6bac-ccb2-4bec-8941-b85e8edd7181 admin admin] PATH_INFO: `/v3/roles` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:55:48.679913 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334c6bac-ccb2-4bec-8941-b85e8edd7181 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:55:48.681532 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334c6bac-ccb2-4bec-8941-b85e8edd7181 admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:55:48.693379 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1337/2663] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Aug 24 05:55:48 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:55:48.698209 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334c6bac-ccb2-4bec-8941-b85e8edd7181 admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:55:48.699853 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403f0136-0796-46e6-bf4b-558b9de1444e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:55:48.702258 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403f0136-0796-46e6-bf4b-558b9de1444e service nova] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:55:48.709181 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334c6bac-ccb2-4bec-8941-b85e8edd7181 admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:55:48.712203 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1327/2664] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 24 05:55:48 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:55:48.716478 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c23eba5-69dc-4612-ab06-65d4b1b85f24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:55:48.717374 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c23eba5-69dc-4612-ab06-65d4b1b85f24 admin admin] REQUEST_METHOD: `PUT` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:55:48.717988 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c23eba5-69dc-4612-ab06-65d4b1b85f24 admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:55:48.718435 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c23eba5-69dc-4612-ab06-65d4b1b85f24 admin admin] PATH_INFO: `/v3/projects/22402fd89b824f53bdd9e2f3af650641/users/2fa1db66a50d4078a3df5467cade17f8/roles/640bda0879494e60b72680ee505285f0` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:55:48.720564 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c23eba5-69dc-4612-ab06-65d4b1b85f24 admin admin] RBAC: Authorizing `identity:create_grant(project_id=22402fd89b824f53bdd9e2f3af650641, user_id=2fa1db66a50d4078a3df5467cade17f8, role_id=640bda0879494e60b72680ee505285f0)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:55:48.723319 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c23eba5-69dc-4612-ab06-65d4b1b85f24 admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:55:48.736145 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1338/2665] 10.222.0.26 () {60 vars in 1483 bytes} [Wed Aug 24 05:55:48 2022] PUT /identity/v3/projects/22402fd89b824f53bdd9e2f3af650641/users/2fa1db66a50d4078a3df5467cade17f8/roles/640bda0879494e60b72680ee505285f0 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:55:48.747607 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06b1f17-88d7-4cff-809e-bf48ac5538f8 None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:55:48.748545 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06b1f17-88d7-4cff-809e-bf48ac5538f8 None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:55:48.748923 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06b1f17-88d7-4cff-809e-bf48ac5538f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:55:48.785743 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-b06b1f17-88d7-4cff-809e-bf48ac5538f8 None None] MFA Rules not processed for user `2fa1db66a50d4078a3df5467cade17f8`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:55:48.787124 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-b06b1f17-88d7-4cff-809e-bf48ac5538f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:55:48.883986 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1328/2666] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:55:48 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:55:48.897844 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c23eba5-69dc-4612-ab06-65d4b1b85f24 admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:55:48.899959 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-1c23eba5-69dc-4612-ab06-65d4b1b85f24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:55:48.976405 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c23eba5-69dc-4612-ab06-65d4b1b85f24 admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:55:48.980574 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fdbe3e-b81a-4345-9c71-c16355fe0eba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17b450afe795495680fc70f522c83750', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:55:48.980854 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fdbe3e-b81a-4345-9c71-c16355fe0eba service cinder] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:55:48.981306 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fdbe3e-b81a-4345-9c71-c16355fe0eba service cinder] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:55:48.981452 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fdbe3e-b81a-4345-9c71-c16355fe0eba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:55:49.041867 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fdbe3e-b81a-4345-9c71-c16355fe0eba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:55:49.043392 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fdbe3e-b81a-4345-9c71-c16355fe0eba service cinder] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:55:49.052579 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1339/2667] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 24 05:55:48 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:55:49.796378 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082e9e31-ea21-4b0d-a9b9-9818024e5d73 None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:55:49.796850 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082e9e31-ea21-4b0d-a9b9-9818024e5d73 None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:55:49.797041 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082e9e31-ea21-4b0d-a9b9-9818024e5d73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:55:49.817396 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-082e9e31-ea21-4b0d-a9b9-9818024e5d73 None None] MFA Rules not processed for user `aca1ac97884743198ce912f892b2644d`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:55:49.818745 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-082e9e31-ea21-4b0d-a9b9-9818024e5d73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:55:49.831651 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=100 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:55:49.875474 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1329/2668] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:55:49 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:55:50.475903 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fdbe3e-b81a-4345-9c71-c16355fe0eba service cinder] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:55:50.477430 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-f5fdbe3e-b81a-4345-9c71-c16355fe0eba service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:55:50.489125 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fdbe3e-b81a-4345-9c71-c16355fe0eba service cinder] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:55:50.493081 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094163cd-21b0-4ecc-ac6d-cedade67c1bb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17b450afe795495680fc70f522c83750', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:55:50.493684 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094163cd-21b0-4ecc-ac6d-cedade67c1bb service cinder] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:55:50.494096 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094163cd-21b0-4ecc-ac6d-cedade67c1bb service cinder] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:55:50.494261 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094163cd-21b0-4ecc-ac6d-cedade67c1bb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:55:50.509424 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094163cd-21b0-4ecc-ac6d-cedade67c1bb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:55:50.510821 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094163cd-21b0-4ecc-ac6d-cedade67c1bb service cinder] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:55:50.520983 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1340/2669] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 24 05:55:50 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:55:54.356376 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082e9e31-ea21-4b0d-a9b9-9818024e5d73 None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:55:54.420872 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082e9e31-ea21-4b0d-a9b9-9818024e5d73 None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:55:54.425366 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4e52a0-47d7-4808-9d62-53778890e919 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:55:54.426036 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4e52a0-47d7-4808-9d62-53778890e919 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:55:54.426321 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4e52a0-47d7-4808-9d62-53778890e919 admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:55:54.426595 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4e52a0-47d7-4808-9d62-53778890e919 admin admin] PATH_INFO: `/v3/users/3168533e54b44574947f07f6c6cf3fb2` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:55:54.427727 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4e52a0-47d7-4808-9d62-53778890e919 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3168533e54b44574947f07f6c6cf3fb2)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:55:54.429615 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4e52a0-47d7-4808-9d62-53778890e919 admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:55:54.476400 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-8d4e52a0-47d7-4808-9d62-53778890e919 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3168533e54b44574947f07f6c6cf3fb2'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:55:54.484110 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-8d4e52a0-47d7-4808-9d62-53778890e919 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3168533e54b44574947f07f6c6cf3fb2'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:55:54.499773 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-8d4e52a0-47d7-4808-9d62-53778890e919 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3168533e54b44574947f07f6c6cf3fb2'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:55:54.510251 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-8d4e52a0-47d7-4808-9d62-53778890e919 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3168533e54b44574947f07f6c6cf3fb2'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:55:54.511079 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-8d4e52a0-47d7-4808-9d62-53778890e919 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3168533e54b44574947f07f6c6cf3fb2'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:55:54.517509 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1330/2670] 10.222.0.26 () {58 vars in 1224 bytes} [Wed Aug 24 05:55:54 2022] DELETE /identity/v3/users/3168533e54b44574947f07f6c6cf3fb2 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:55:54.522001 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a779325f-4e74-4d99-80eb-0f016b989a07 None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:55:54.522448 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a779325f-4e74-4d99-80eb-0f016b989a07 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:55:54.522543 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a779325f-4e74-4d99-80eb-0f016b989a07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:55:54.550752 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-a779325f-4e74-4d99-80eb-0f016b989a07 None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:55:54.551983 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-a779325f-4e74-4d99-80eb-0f016b989a07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:55:54.556134 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:55:54.614172 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1341/2671] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:55:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:55:54.624559 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4e52a0-47d7-4808-9d62-53778890e919 admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:55:54.625975 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-8d4e52a0-47d7-4808-9d62-53778890e919 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:55:54.673118 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:55:54.686909 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4e52a0-47d7-4808-9d62-53778890e919 admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:55:54.690582 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb84bb3-334f-4f36-9f9b-955747453b96 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '874348b647194ac2b5ecbf12c33bf59e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:55:54.691205 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb84bb3-334f-4f36-9f9b-955747453b96 service neutron] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:55:54.691745 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb84bb3-334f-4f36-9f9b-955747453b96 service neutron] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:55:54.692016 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb84bb3-334f-4f36-9f9b-955747453b96 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:55:54.700858 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb84bb3-334f-4f36-9f9b-955747453b96 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:55:54.702359 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb84bb3-334f-4f36-9f9b-955747453b96 service neutron] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:55:54.712927 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1331/2672] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 24 05:55:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:55:54.985832 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a779325f-4e74-4d99-80eb-0f016b989a07 None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:55:54.987304 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-a779325f-4e74-4d99-80eb-0f016b989a07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:55:55.000833 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a779325f-4e74-4d99-80eb-0f016b989a07 None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:55:55.005962 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83c190d-862a-44b8-a2b2-e09560e90ecf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:55:55.006611 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83c190d-862a-44b8-a2b2-e09560e90ecf admin admin] REQUEST_METHOD: `DELETE` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:55:55.006900 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83c190d-862a-44b8-a2b2-e09560e90ecf admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:55:55.007188 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83c190d-862a-44b8-a2b2-e09560e90ecf admin admin] PATH_INFO: `/v3/projects/b8e5548acab340ea93a5033f8d271d7b` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:55:55.009154 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83c190d-862a-44b8-a2b2-e09560e90ecf admin admin] RBAC: Authorizing `identity:delete_project(project_id=b8e5548acab340ea93a5033f8d271d7b)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:55:55.011747 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83c190d-862a-44b8-a2b2-e09560e90ecf admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:55:55.060880 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-a83c190d-862a-44b8-a2b2-e09560e90ecf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b8e5548acab340ea93a5033f8d271d7b', 'request_id': 'req-a83c190d-862a-44b8-a2b2-e09560e90ecf'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:55:55.070353 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-a83c190d-862a-44b8-a2b2-e09560e90ecf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b8e5548acab340ea93a5033f8d271d7b', 'request_id': 'req-a83c190d-862a-44b8-a2b2-e09560e90ecf'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:55:55.078784 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-a83c190d-862a-44b8-a2b2-e09560e90ecf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b8e5548acab340ea93a5033f8d271d7b', 'request_id': 'req-a83c190d-862a-44b8-a2b2-e09560e90ecf'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:55:55.090485 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-a83c190d-862a-44b8-a2b2-e09560e90ecf admin admin] The token cache is being invalidate because project b8e5548acab340ea93a5033f8d271d7b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:55:55.090781 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-a83c190d-862a-44b8-a2b2-e09560e90ecf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:55:55.092267 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-a83c190d-862a-44b8-a2b2-e09560e90ecf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:55:55.094613 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1342/2673] 10.222.0.26 () {58 vars in 1233 bytes} [Wed Aug 24 05:55:54 2022] DELETE /identity/v3/projects/b8e5548acab340ea93a5033f8d271d7b => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:55:55.098799 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb84bb3-334f-4f36-9f9b-955747453b96 service neutron] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:55:55.109594 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb84bb3-334f-4f36-9f9b-955747453b96 service neutron] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:55:55.170518 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063550df-15c5-483b-9b14-d6182f6368e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:55:55.171154 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063550df-15c5-483b-9b14-d6182f6368e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:55:55.171435 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063550df-15c5-483b-9b14-d6182f6368e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:55:55.171707 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063550df-15c5-483b-9b14-d6182f6368e1 admin admin] PATH_INFO: `/v3/users/2fa1db66a50d4078a3df5467cade17f8` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:55:55.172818 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063550df-15c5-483b-9b14-d6182f6368e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2fa1db66a50d4078a3df5467cade17f8)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:55:55.174838 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063550df-15c5-483b-9b14-d6182f6368e1 admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:55:55.226557 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-063550df-15c5-483b-9b14-d6182f6368e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2fa1db66a50d4078a3df5467cade17f8'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:55:55.235410 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-063550df-15c5-483b-9b14-d6182f6368e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2fa1db66a50d4078a3df5467cade17f8'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:55:55.255277 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-063550df-15c5-483b-9b14-d6182f6368e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2fa1db66a50d4078a3df5467cade17f8'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:55:55.264715 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-063550df-15c5-483b-9b14-d6182f6368e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2fa1db66a50d4078a3df5467cade17f8'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:55:55.265458 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-063550df-15c5-483b-9b14-d6182f6368e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2fa1db66a50d4078a3df5467cade17f8'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:55:55.276789 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1332/2674] 10.222.0.26 () {58 vars in 1224 bytes} [Wed Aug 24 05:55:55 2022] DELETE /identity/v3/users/2fa1db66a50d4078a3df5467cade17f8 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:55:55.576477 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83c190d-862a-44b8-a2b2-e09560e90ecf admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:55:55.578031 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-a83c190d-862a-44b8-a2b2-e09560e90ecf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:55:55.591108 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83c190d-862a-44b8-a2b2-e09560e90ecf admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:55:55.653265 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fdeb2c-5b2d-49e5-9478-eb75448e12e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:55:55.654511 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fdeb2c-5b2d-49e5-9478-eb75448e12e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:55:55.654796 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fdeb2c-5b2d-49e5-9478-eb75448e12e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:55:55.655070 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fdeb2c-5b2d-49e5-9478-eb75448e12e2 admin admin] PATH_INFO: `/v3/projects/22402fd89b824f53bdd9e2f3af650641` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:55:55.656204 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fdeb2c-5b2d-49e5-9478-eb75448e12e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=22402fd89b824f53bdd9e2f3af650641)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:55:55.658148 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fdeb2c-5b2d-49e5-9478-eb75448e12e2 admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:55:55.695509 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:55:55.706957 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-50fdeb2c-5b2d-49e5-9478-eb75448e12e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22402fd89b824f53bdd9e2f3af650641', 'request_id': 'req-50fdeb2c-5b2d-49e5-9478-eb75448e12e2'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:55:55.713888 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-50fdeb2c-5b2d-49e5-9478-eb75448e12e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22402fd89b824f53bdd9e2f3af650641', 'request_id': 'req-50fdeb2c-5b2d-49e5-9478-eb75448e12e2'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:55:55.720867 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-50fdeb2c-5b2d-49e5-9478-eb75448e12e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22402fd89b824f53bdd9e2f3af650641', 'request_id': 'req-50fdeb2c-5b2d-49e5-9478-eb75448e12e2'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:55:55.731418 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-50fdeb2c-5b2d-49e5-9478-eb75448e12e2 admin admin] The token cache is being invalidate because project 22402fd89b824f53bdd9e2f3af650641 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:55:55.731726 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-50fdeb2c-5b2d-49e5-9478-eb75448e12e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:55:55.732351 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-50fdeb2c-5b2d-49e5-9478-eb75448e12e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:55:55.733865 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1343/2675] 10.222.0.26 () {58 vars in 1233 bytes} [Wed Aug 24 05:55:55 2022] DELETE /identity/v3/projects/22402fd89b824f53bdd9e2f3af650641 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:55:55.738834 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905fdfc1-8152-40dc-a5b5-555188f9ec1c None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:55:55.739292 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905fdfc1-8152-40dc-a5b5-555188f9ec1c None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:55:55.739408 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905fdfc1-8152-40dc-a5b5-555188f9ec1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:55:55.758328 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-905fdfc1-8152-40dc-a5b5-555188f9ec1c None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:55:55.759513 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-905fdfc1-8152-40dc-a5b5-555188f9ec1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:55:55.821499 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1333/2676] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:55:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:55:55.830009 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4a6f24-0979-497f-9bc7-272c7a8328c6 None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:55:55.830298 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4a6f24-0979-497f-9bc7-272c7a8328c6 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:55:55.830575 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4a6f24-0979-497f-9bc7-272c7a8328c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:55:55.860296 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-bf4a6f24-0979-497f-9bc7-272c7a8328c6 None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:55:55.861528 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-bf4a6f24-0979-497f-9bc7-272c7a8328c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:55:55.869544 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1344/2677] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:55:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:55:55.873830 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905fdfc1-8152-40dc-a5b5-555188f9ec1c None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:55:55.879861 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:55:55.883758 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905fdfc1-8152-40dc-a5b5-555188f9ec1c None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:55:55.889782 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6e2879-1dcb-4fe5-a7c3-1b63b7da4535 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:55:55.890734 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6e2879-1dcb-4fe5-a7c3-1b63b7da4535 admin admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:55:55.891043 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6e2879-1dcb-4fe5-a7c3-1b63b7da4535 admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:55:55.891400 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6e2879-1dcb-4fe5-a7c3-1b63b7da4535 admin admin] PATH_INFO: `/v3/domains` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:55:55.892051 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6e2879-1dcb-4fe5-a7c3-1b63b7da4535 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:55:55.892548 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6e2879-1dcb-4fe5-a7c3-1b63b7da4535 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:55:55.894499 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6e2879-1dcb-4fe5-a7c3-1b63b7da4535 admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:55:55.907372 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1334/2678] 10.222.0.26 () {58 vars in 1153 bytes} [Wed Aug 24 05:55:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:55:55.911680 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4a6f24-0979-497f-9bc7-272c7a8328c6 None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:55:55.922729 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4a6f24-0979-497f-9bc7-272c7a8328c6 None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:55:55.927578 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35b5130-88cc-4a1f-87e8-3549efb13207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:55:55.928340 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35b5130-88cc-4a1f-87e8-3549efb13207 admin admin] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:55:55.928567 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35b5130-88cc-4a1f-87e8-3549efb13207 admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:55:55.928858 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35b5130-88cc-4a1f-87e8-3549efb13207 admin admin] PATH_INFO: `/v3/projects` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:55:55.929569 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35b5130-88cc-4a1f-87e8-3549efb13207 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:55:55.931915 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35b5130-88cc-4a1f-87e8-3549efb13207 admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:55:55.973791 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1345/2679] 10.222.0.26 () {60 vars in 1153 bytes} [Wed Aug 24 05:55:55 2022] POST /identity/v3/projects => generated 387 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:55:55.977872 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6e2879-1dcb-4fe5-a7c3-1b63b7da4535 admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:55:55.987939 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6e2879-1dcb-4fe5-a7c3-1b63b7da4535 admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:55:56.044518 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf00fe1-bc00-4aca-8e76-78e7efde5b05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:55:56.045153 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf00fe1-bc00-4aca-8e76-78e7efde5b05 admin admin] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:55:56.045429 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf00fe1-bc00-4aca-8e76-78e7efde5b05 admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:55:56.045696 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf00fe1-bc00-4aca-8e76-78e7efde5b05 admin admin] PATH_INFO: `/v3/users` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:55:56.046363 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf00fe1-bc00-4aca-8e76-78e7efde5b05 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:55:56.048329 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf00fe1-bc00-4aca-8e76-78e7efde5b05 admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:55:56.074968 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1335/2680] 10.222.0.26 () {60 vars in 1144 bytes} [Wed Aug 24 05:55:55 2022] POST /identity/v3/users => generated 294 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:55:56.079853 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35b5130-88cc-4a1f-87e8-3549efb13207 admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:55:56.091069 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35b5130-88cc-4a1f-87e8-3549efb13207 admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:55:56.096429 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32604a9-d5c8-463e-b9f0-28d1265dd929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:55:56.097044 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32604a9-d5c8-463e-b9f0-28d1265dd929 admin admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:55:56.097329 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32604a9-d5c8-463e-b9f0-28d1265dd929 admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:55:56.097602 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32604a9-d5c8-463e-b9f0-28d1265dd929 admin admin] PATH_INFO: `/v3/roles` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:55:56.098276 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32604a9-d5c8-463e-b9f0-28d1265dd929 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:55:56.099883 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32604a9-d5c8-463e-b9f0-28d1265dd929 admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:55:56.110672 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1346/2681] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Aug 24 05:55:56 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:55:56.115320 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf00fe1-bc00-4aca-8e76-78e7efde5b05 admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:55:56.125848 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf00fe1-bc00-4aca-8e76-78e7efde5b05 admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:55:56.130635 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa97e4f0-d6c3-4b2d-a88a-901018f04e1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:55:56.131243 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa97e4f0-d6c3-4b2d-a88a-901018f04e1b admin admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:55:56.131521 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa97e4f0-d6c3-4b2d-a88a-901018f04e1b admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:55:56.131790 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa97e4f0-d6c3-4b2d-a88a-901018f04e1b admin admin] PATH_INFO: `/v3/roles` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:55:56.132463 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa97e4f0-d6c3-4b2d-a88a-901018f04e1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:55:56.134085 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa97e4f0-d6c3-4b2d-a88a-901018f04e1b admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:55:56.144894 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1336/2682] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Aug 24 05:55:56 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:55:56.149284 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32604a9-d5c8-463e-b9f0-28d1265dd929 admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:55:56.160061 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32604a9-d5c8-463e-b9f0-28d1265dd929 admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:55:56.164640 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229728e2-17b9-4948-a6e8-d81acbd6031a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:55:56.165279 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229728e2-17b9-4948-a6e8-d81acbd6031a admin admin] REQUEST_METHOD: `PUT` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:55:56.165563 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229728e2-17b9-4948-a6e8-d81acbd6031a admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:55:56.165830 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229728e2-17b9-4948-a6e8-d81acbd6031a admin admin] PATH_INFO: `/v3/projects/85f996af09c243f69abac43484b2baeb/users/249e311e1b0d43daa3d0a08dbe3117a1/roles/f7aa4a2c74c94c1b9ca8ecdcccccda5c` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:55:56.181281 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229728e2-17b9-4948-a6e8-d81acbd6031a admin admin] RBAC: Authorizing `identity:create_grant(project_id=85f996af09c243f69abac43484b2baeb, user_id=249e311e1b0d43daa3d0a08dbe3117a1, role_id=f7aa4a2c74c94c1b9ca8ecdcccccda5c)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:55:56.183987 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229728e2-17b9-4948-a6e8-d81acbd6031a admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:55:56.197052 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1347/2683] 10.222.0.26 () {60 vars in 1483 bytes} [Wed Aug 24 05:55:56 2022] PUT /identity/v3/projects/85f996af09c243f69abac43484b2baeb/users/249e311e1b0d43daa3d0a08dbe3117a1/roles/f7aa4a2c74c94c1b9ca8ecdcccccda5c => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 05:55:56.207354 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d957c5af-bc89-41df-8a27-69a631351e8a None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:55:56.207644 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d957c5af-bc89-41df-8a27-69a631351e8a None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:55:56.207955 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d957c5af-bc89-41df-8a27-69a631351e8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:55:56.236053 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-d957c5af-bc89-41df-8a27-69a631351e8a None None] MFA Rules not processed for user `249e311e1b0d43daa3d0a08dbe3117a1`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:55:56.237265 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-d957c5af-bc89-41df-8a27-69a631351e8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:55:56.303341 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1337/2684] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:55:56 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 05:55:56.307888 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229728e2-17b9-4948-a6e8-d81acbd6031a admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:55:56.371418 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229728e2-17b9-4948-a6e8-d81acbd6031a admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:55:56.376267 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001a4584-a559-49e9-807c-dc55135ea077 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:55:56.376879 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001a4584-a559-49e9-807c-dc55135ea077 admin admin] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:55:56.377161 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001a4584-a559-49e9-807c-dc55135ea077 admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:55:56.377431 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001a4584-a559-49e9-807c-dc55135ea077 admin admin] PATH_INFO: `/v3/projects` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:55:56.378099 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001a4584-a559-49e9-807c-dc55135ea077 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:55:56.380025 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001a4584-a559-49e9-807c-dc55135ea077 admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:55:56.407652 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1348/2685] 10.222.0.26 () {60 vars in 1153 bytes} [Wed Aug 24 05:55:56 2022] POST /identity/v3/projects => generated 387 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:55:56.411564 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d957c5af-bc89-41df-8a27-69a631351e8a None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:55:56.422259 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d957c5af-bc89-41df-8a27-69a631351e8a None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:55:56.479628 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3fbcaf-c797-4346-9e06-57ed1f23078d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:55:56.480241 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3fbcaf-c797-4346-9e06-57ed1f23078d admin admin] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:55:56.480544 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3fbcaf-c797-4346-9e06-57ed1f23078d admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:55:56.480817 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3fbcaf-c797-4346-9e06-57ed1f23078d admin admin] PATH_INFO: `/v3/users` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:55:56.481451 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3fbcaf-c797-4346-9e06-57ed1f23078d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:55:56.483406 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3fbcaf-c797-4346-9e06-57ed1f23078d admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:55:56.491168 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:55:56.507764 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1338/2686] 10.222.0.26 () {60 vars in 1144 bytes} [Wed Aug 24 05:55:56 2022] POST /identity/v3/users => generated 300 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 05:55:56.511562 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001a4584-a559-49e9-807c-dc55135ea077 admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:55:56.522809 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001a4584-a559-49e9-807c-dc55135ea077 admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:55:56.530545 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb030b4-423e-44a7-a9d4-0edea545a35b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:55:56.531216 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb030b4-423e-44a7-a9d4-0edea545a35b admin admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:55:56.531504 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb030b4-423e-44a7-a9d4-0edea545a35b admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:55:56.531774 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb030b4-423e-44a7-a9d4-0edea545a35b admin admin] PATH_INFO: `/v3/roles` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:55:56.532466 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb030b4-423e-44a7-a9d4-0edea545a35b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:55:56.534168 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb030b4-423e-44a7-a9d4-0edea545a35b admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:55:56.545841 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1349/2687] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Aug 24 05:55:56 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:55:56.550070 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3fbcaf-c797-4346-9e06-57ed1f23078d admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:55:56.560340 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3fbcaf-c797-4346-9e06-57ed1f23078d admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:55:56.564936 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175f82a1-10fc-42d9-932f-89727fb2a2a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:55:56.565583 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175f82a1-10fc-42d9-932f-89727fb2a2a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:55:56.565859 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175f82a1-10fc-42d9-932f-89727fb2a2a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:55:56.566163 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175f82a1-10fc-42d9-932f-89727fb2a2a7 admin admin] PATH_INFO: `/v3/projects/52c89aa562064645a7a5da790fbdb730/users/621bdac3c4ad4e04a6bbefe45d913f71/roles/640bda0879494e60b72680ee505285f0` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:55:56.582169 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175f82a1-10fc-42d9-932f-89727fb2a2a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=52c89aa562064645a7a5da790fbdb730, user_id=621bdac3c4ad4e04a6bbefe45d913f71, role_id=640bda0879494e60b72680ee505285f0)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:55:56.585291 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175f82a1-10fc-42d9-932f-89727fb2a2a7 admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:55:56.598592 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1339/2688] 10.222.0.26 () {60 vars in 1483 bytes} [Wed Aug 24 05:55:56 2022] PUT /identity/v3/projects/52c89aa562064645a7a5da790fbdb730/users/621bdac3c4ad4e04a6bbefe45d913f71/roles/640bda0879494e60b72680ee505285f0 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:55:56.602715 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb030b4-423e-44a7-a9d4-0edea545a35b admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:55:56.612885 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb030b4-423e-44a7-a9d4-0edea545a35b admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:55:56.637509 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:DELETE=5,keystone:SELECT=91,keystone:INSERT=4 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:55:56.686975 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15833b7-0275-4b85-affe-1a4b9bc7469e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:55:56.687611 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15833b7-0275-4b85-affe-1a4b9bc7469e admin admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:55:56.687885 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15833b7-0275-4b85-affe-1a4b9bc7469e admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:55:56.688160 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15833b7-0275-4b85-affe-1a4b9bc7469e admin admin] PATH_INFO: `/v3/roles` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:55:56.688806 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15833b7-0275-4b85-affe-1a4b9bc7469e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:55:56.690448 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15833b7-0275-4b85-affe-1a4b9bc7469e admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:55:56.700590 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1350/2689] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Aug 24 05:55:56 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:55:56.705637 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175f82a1-10fc-42d9-932f-89727fb2a2a7 admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:55:56.716229 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175f82a1-10fc-42d9-932f-89727fb2a2a7 admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:55:56.720895 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b36350-5ffb-4f9d-972c-6a53b6b12139 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:55:56.721540 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b36350-5ffb-4f9d-972c-6a53b6b12139 admin admin] REQUEST_METHOD: `PUT` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:55:56.721820 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b36350-5ffb-4f9d-972c-6a53b6b12139 admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:55:56.722123 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b36350-5ffb-4f9d-972c-6a53b6b12139 admin admin] PATH_INFO: `/v3/projects/52c89aa562064645a7a5da790fbdb730/users/621bdac3c4ad4e04a6bbefe45d913f71/roles/640bda0879494e60b72680ee505285f0` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:55:56.724128 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b36350-5ffb-4f9d-972c-6a53b6b12139 admin admin] RBAC: Authorizing `identity:create_grant(project_id=52c89aa562064645a7a5da790fbdb730, user_id=621bdac3c4ad4e04a6bbefe45d913f71, role_id=640bda0879494e60b72680ee505285f0)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:55:56.726812 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b36350-5ffb-4f9d-972c-6a53b6b12139 admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:55:56.737759 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1340/2690] 10.222.0.26 () {60 vars in 1483 bytes} [Wed Aug 24 05:55:56 2022] PUT /identity/v3/projects/52c89aa562064645a7a5da790fbdb730/users/621bdac3c4ad4e04a6bbefe45d913f71/roles/640bda0879494e60b72680ee505285f0 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:55:56.749349 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030bfb09-f690-46d1-b511-863a44097d8c None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:55:56.749638 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030bfb09-f690-46d1-b511-863a44097d8c None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:55:56.749917 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030bfb09-f690-46d1-b511-863a44097d8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:55:56.778677 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-030bfb09-f690-46d1-b511-863a44097d8c None None] MFA Rules not processed for user `621bdac3c4ad4e04a6bbefe45d913f71`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:55:56.779929 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-030bfb09-f690-46d1-b511-863a44097d8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:55:56.848000 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1351/2691] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:55:56 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:55:56.858901 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b36350-5ffb-4f9d-972c-6a53b6b12139 admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:55:56.860657 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-a8b36350-5ffb-4f9d-972c-6a53b6b12139 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:55:56.930230 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b36350-5ffb-4f9d-972c-6a53b6b12139 admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:55:56.934179 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13307fbd-ae90-4637-8b47-e6b88a637c51 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17b450afe795495680fc70f522c83750', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:55:56.934797 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13307fbd-ae90-4637-8b47-e6b88a637c51 service cinder] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:55:56.935585 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13307fbd-ae90-4637-8b47-e6b88a637c51 service cinder] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:55:56.935880 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13307fbd-ae90-4637-8b47-e6b88a637c51 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:55:56.946365 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13307fbd-ae90-4637-8b47-e6b88a637c51 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:55:56.947841 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13307fbd-ae90-4637-8b47-e6b88a637c51 service cinder] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:55:56.958188 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1341/2692] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 24 05:55:56 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:55:57.093327 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030bfb09-f690-46d1-b511-863a44097d8c None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:55:57.157776 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030bfb09-f690-46d1-b511-863a44097d8c None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:55:57.162788 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6783f1-706c-4195-a637-4034024cfef8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:55:57.163440 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6783f1-706c-4195-a637-4034024cfef8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:55:57.163703 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6783f1-706c-4195-a637-4034024cfef8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:55:57.163977 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6783f1-706c-4195-a637-4034024cfef8 admin admin] PATH_INFO: `/v3/users/249e311e1b0d43daa3d0a08dbe3117a1` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:55:57.165095 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6783f1-706c-4195-a637-4034024cfef8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=249e311e1b0d43daa3d0a08dbe3117a1)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:55:57.167056 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6783f1-706c-4195-a637-4034024cfef8 admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:55:57.213594 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-ed6783f1-706c-4195-a637-4034024cfef8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '249e311e1b0d43daa3d0a08dbe3117a1'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:55:57.214769 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:55:57.221468 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-ed6783f1-706c-4195-a637-4034024cfef8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '249e311e1b0d43daa3d0a08dbe3117a1'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:55:57.222264 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-ed6783f1-706c-4195-a637-4034024cfef8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '249e311e1b0d43daa3d0a08dbe3117a1'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:55:57.234612 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-ed6783f1-706c-4195-a637-4034024cfef8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '249e311e1b0d43daa3d0a08dbe3117a1'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:55:57.242214 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-ed6783f1-706c-4195-a637-4034024cfef8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '249e311e1b0d43daa3d0a08dbe3117a1'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:55:57.249265 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1352/2693] 10.222.0.26 () {58 vars in 1224 bytes} [Wed Aug 24 05:55:57 2022] DELETE /identity/v3/users/249e311e1b0d43daa3d0a08dbe3117a1 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:55:57.253798 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31089b5-babd-4847-a61e-b03fb8fa27eb None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:55:57.254121 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31089b5-babd-4847-a61e-b03fb8fa27eb None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:55:57.254403 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31089b5-babd-4847-a61e-b03fb8fa27eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:55:57.272828 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-d31089b5-babd-4847-a61e-b03fb8fa27eb None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:55:57.274087 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-d31089b5-babd-4847-a61e-b03fb8fa27eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:55:57.334939 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1342/2694] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:55:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:55:57.344816 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6783f1-706c-4195-a637-4034024cfef8 admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:55:57.346246 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-ed6783f1-706c-4195-a637-4034024cfef8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:55:57.404401 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6783f1-706c-4195-a637-4034024cfef8 admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:55:57.408108 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7761af28-aae2-48ca-aa9e-ae7703459c1f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '874348b647194ac2b5ecbf12c33bf59e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:55:57.408720 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7761af28-aae2-48ca-aa9e-ae7703459c1f service neutron] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:55:57.409000 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7761af28-aae2-48ca-aa9e-ae7703459c1f service neutron] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:55:57.409269 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7761af28-aae2-48ca-aa9e-ae7703459c1f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:55:57.418604 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7761af28-aae2-48ca-aa9e-ae7703459c1f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:55:57.420669 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7761af28-aae2-48ca-aa9e-ae7703459c1f service neutron] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:55:57.430726 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1353/2695] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 24 05:55:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:55:57.706419 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31089b5-babd-4847-a61e-b03fb8fa27eb None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:55:57.707914 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-d31089b5-babd-4847-a61e-b03fb8fa27eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:55:57.723745 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31089b5-babd-4847-a61e-b03fb8fa27eb None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:55:57.730308 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8103b7f7-afd6-4cfd-9296-91f8a00c2979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:55:57.730962 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8103b7f7-afd6-4cfd-9296-91f8a00c2979 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:55:57.731309 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8103b7f7-afd6-4cfd-9296-91f8a00c2979 admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:55:57.731567 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8103b7f7-afd6-4cfd-9296-91f8a00c2979 admin admin] PATH_INFO: `/v3/projects/85f996af09c243f69abac43484b2baeb` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:55:57.733494 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8103b7f7-afd6-4cfd-9296-91f8a00c2979 admin admin] RBAC: Authorizing `identity:delete_project(project_id=85f996af09c243f69abac43484b2baeb)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:55:57.735606 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8103b7f7-afd6-4cfd-9296-91f8a00c2979 admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:55:57.785733 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-8103b7f7-afd6-4cfd-9296-91f8a00c2979 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '85f996af09c243f69abac43484b2baeb', 'request_id': 'req-8103b7f7-afd6-4cfd-9296-91f8a00c2979'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:55:57.787401 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:INSERT=5,keystone:SELECT=91,keystone:DELETE=4 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:55:57.795433 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-8103b7f7-afd6-4cfd-9296-91f8a00c2979 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '85f996af09c243f69abac43484b2baeb', 'request_id': 'req-8103b7f7-afd6-4cfd-9296-91f8a00c2979'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:55:57.803528 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-8103b7f7-afd6-4cfd-9296-91f8a00c2979 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '85f996af09c243f69abac43484b2baeb', 'request_id': 'req-8103b7f7-afd6-4cfd-9296-91f8a00c2979'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:55:57.814825 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-8103b7f7-afd6-4cfd-9296-91f8a00c2979 admin admin] The token cache is being invalidate because project 85f996af09c243f69abac43484b2baeb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88112) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:55:57.815115 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-8103b7f7-afd6-4cfd-9296-91f8a00c2979 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:55:57.815767 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-8103b7f7-afd6-4cfd-9296-91f8a00c2979 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:55:57.817503 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1343/2696] 10.222.0.26 () {58 vars in 1233 bytes} [Wed Aug 24 05:55:57 2022] DELETE /identity/v3/projects/85f996af09c243f69abac43484b2baeb => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:55:57.821535 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7761af28-aae2-48ca-aa9e-ae7703459c1f service neutron] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:55:57.831663 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7761af28-aae2-48ca-aa9e-ae7703459c1f service neutron] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:55:57.889417 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5832402-7d86-4d67-a70f-61b6ed479186 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:55:57.890199 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5832402-7d86-4d67-a70f-61b6ed479186 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:55:57.890482 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5832402-7d86-4d67-a70f-61b6ed479186 admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:55:57.890759 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5832402-7d86-4d67-a70f-61b6ed479186 admin admin] PATH_INFO: `/v3/users/621bdac3c4ad4e04a6bbefe45d913f71` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:55:57.891890 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5832402-7d86-4d67-a70f-61b6ed479186 admin admin] RBAC: Authorizing `identity:delete_user(user_id=621bdac3c4ad4e04a6bbefe45d913f71)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:55:57.893838 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5832402-7d86-4d67-a70f-61b6ed479186 admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:55:57.940646 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-e5832402-7d86-4d67-a70f-61b6ed479186 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '621bdac3c4ad4e04a6bbefe45d913f71'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:55:57.947745 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-e5832402-7d86-4d67-a70f-61b6ed479186 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '621bdac3c4ad4e04a6bbefe45d913f71'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:55:57.948413 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-e5832402-7d86-4d67-a70f-61b6ed479186 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '621bdac3c4ad4e04a6bbefe45d913f71'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:55:57.958523 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:55:57.960685 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-e5832402-7d86-4d67-a70f-61b6ed479186 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '621bdac3c4ad4e04a6bbefe45d913f71'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:55:57.968360 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-e5832402-7d86-4d67-a70f-61b6ed479186 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '621bdac3c4ad4e04a6bbefe45d913f71'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:55:57.974880 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1354/2697] 10.222.0.26 () {58 vars in 1224 bytes} [Wed Aug 24 05:55:57 2022] DELETE /identity/v3/users/621bdac3c4ad4e04a6bbefe45d913f71 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:55:58.255836 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8103b7f7-afd6-4cfd-9296-91f8a00c2979 admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:55:58.257385 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-8103b7f7-afd6-4cfd-9296-91f8a00c2979 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:55:58.270771 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8103b7f7-afd6-4cfd-9296-91f8a00c2979 admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:55:58.332890 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d53fb8d-5c6f-4762-b11a-2aba128d9d45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:55:58.333431 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d53fb8d-5c6f-4762-b11a-2aba128d9d45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:55:58.333708 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d53fb8d-5c6f-4762-b11a-2aba128d9d45 admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:55:58.334005 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d53fb8d-5c6f-4762-b11a-2aba128d9d45 admin admin] PATH_INFO: `/v3/projects/52c89aa562064645a7a5da790fbdb730` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:55:58.335105 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d53fb8d-5c6f-4762-b11a-2aba128d9d45 admin admin] RBAC: Authorizing `identity:delete_project(project_id=52c89aa562064645a7a5da790fbdb730)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:55:58.336974 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d53fb8d-5c6f-4762-b11a-2aba128d9d45 admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:55:58.384386 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-4d53fb8d-5c6f-4762-b11a-2aba128d9d45 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52c89aa562064645a7a5da790fbdb730', 'request_id': 'req-4d53fb8d-5c6f-4762-b11a-2aba128d9d45'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:55:58.391755 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-4d53fb8d-5c6f-4762-b11a-2aba128d9d45 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52c89aa562064645a7a5da790fbdb730', 'request_id': 'req-4d53fb8d-5c6f-4762-b11a-2aba128d9d45'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:55:58.399141 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-4d53fb8d-5c6f-4762-b11a-2aba128d9d45 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52c89aa562064645a7a5da790fbdb730', 'request_id': 'req-4d53fb8d-5c6f-4762-b11a-2aba128d9d45'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:55:58.409219 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-4d53fb8d-5c6f-4762-b11a-2aba128d9d45 admin admin] The token cache is being invalidate because project 52c89aa562064645a7a5da790fbdb730 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88112) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:55:58.409515 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-4d53fb8d-5c6f-4762-b11a-2aba128d9d45 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:55:58.410207 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-4d53fb8d-5c6f-4762-b11a-2aba128d9d45 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:55:58.411689 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1344/2698] 10.222.0.26 () {58 vars in 1233 bytes} [Wed Aug 24 05:55:58 2022] DELETE /identity/v3/projects/52c89aa562064645a7a5da790fbdb730 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:55:58.416540 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d86f7ac-1f6a-4d59-8f80-7f47a61212d5 None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:55:58.416902 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d86f7ac-1f6a-4d59-8f80-7f47a61212d5 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:55:58.417240 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d86f7ac-1f6a-4d59-8f80-7f47a61212d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:55:58.438264 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-0d86f7ac-1f6a-4d59-8f80-7f47a61212d5 None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:55:58.439496 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-0d86f7ac-1f6a-4d59-8f80-7f47a61212d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:55:58.498599 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1355/2699] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:55:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:55:58.506481 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce5cfa8-9770-417e-b30c-cfdcd794f28a None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:55:58.506770 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce5cfa8-9770-417e-b30c-cfdcd794f28a None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:55:58.507044 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce5cfa8-9770-417e-b30c-cfdcd794f28a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:55:58.528205 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-cce5cfa8-9770-417e-b30c-cfdcd794f28a None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:55:58.530097 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-cce5cfa8-9770-417e-b30c-cfdcd794f28a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:55:58.537974 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1345/2700] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:55:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:55:58.542436 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d86f7ac-1f6a-4d59-8f80-7f47a61212d5 None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:55:58.552786 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d86f7ac-1f6a-4d59-8f80-7f47a61212d5 None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:55:58.557357 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486c7339-b312-4060-bfc9-0f201640f580 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:55:58.557967 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486c7339-b312-4060-bfc9-0f201640f580 admin admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:55:58.558262 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486c7339-b312-4060-bfc9-0f201640f580 admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:55:58.558531 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486c7339-b312-4060-bfc9-0f201640f580 admin admin] PATH_INFO: `/v3/domains` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:55:58.559177 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486c7339-b312-4060-bfc9-0f201640f580 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:55:58.559484 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486c7339-b312-4060-bfc9-0f201640f580 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:55:58.561085 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486c7339-b312-4060-bfc9-0f201640f580 admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:55:58.573149 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1356/2701] 10.222.0.26 () {58 vars in 1153 bytes} [Wed Aug 24 05:55:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:55:58.579154 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce5cfa8-9770-417e-b30c-cfdcd794f28a None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:55:58.588724 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce5cfa8-9770-417e-b30c-cfdcd794f28a None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:55:58.593383 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2071bce-822d-4ec5-a915-6a4798cc8393 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:55:58.594083 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2071bce-822d-4ec5-a915-6a4798cc8393 admin admin] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:55:58.594369 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2071bce-822d-4ec5-a915-6a4798cc8393 admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:55:58.594639 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2071bce-822d-4ec5-a915-6a4798cc8393 admin admin] PATH_INFO: `/v3/projects` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:55:58.595270 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2071bce-822d-4ec5-a915-6a4798cc8393 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:55:58.597168 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2071bce-822d-4ec5-a915-6a4798cc8393 admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:55:58.625789 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1346/2702] 10.222.0.26 () {60 vars in 1153 bytes} [Wed Aug 24 05:55:58 2022] POST /identity/v3/projects => generated 371 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:55:58.629807 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486c7339-b312-4060-bfc9-0f201640f580 admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:55:58.640330 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486c7339-b312-4060-bfc9-0f201640f580 admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:55:58.700235 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac3939f-1e91-41a8-ad6c-442dcbd22479 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:55:58.700235 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac3939f-1e91-41a8-ad6c-442dcbd22479 admin admin] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:55:58.700975 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac3939f-1e91-41a8-ad6c-442dcbd22479 admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:55:58.701243 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac3939f-1e91-41a8-ad6c-442dcbd22479 admin admin] PATH_INFO: `/v3/users` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:55:58.702057 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac3939f-1e91-41a8-ad6c-442dcbd22479 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:55:58.704008 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac3939f-1e91-41a8-ad6c-442dcbd22479 admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:55:58.725851 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1357/2703] 10.222.0.26 () {60 vars in 1144 bytes} [Wed Aug 24 05:55:58 2022] POST /identity/v3/users => generated 286 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:55:58.730361 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2071bce-822d-4ec5-a915-6a4798cc8393 admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:55:58.741267 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2071bce-822d-4ec5-a915-6a4798cc8393 admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:55:58.746419 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeadb602-e75b-4e82-a18e-5678ecdd72a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:55:58.747100 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeadb602-e75b-4e82-a18e-5678ecdd72a9 admin admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:55:58.747550 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeadb602-e75b-4e82-a18e-5678ecdd72a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:55:58.747826 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeadb602-e75b-4e82-a18e-5678ecdd72a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:55:58.748476 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeadb602-e75b-4e82-a18e-5678ecdd72a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:55:58.750069 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeadb602-e75b-4e82-a18e-5678ecdd72a9 admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:55:58.766741 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1347/2704] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Aug 24 05:55:58 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:55:58.778216 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac3939f-1e91-41a8-ad6c-442dcbd22479 admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:55:58.782568 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac3939f-1e91-41a8-ad6c-442dcbd22479 admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:55:58.787800 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c680c84-6e43-4c78-9060-ec7cdb58e573 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:55:58.788416 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c680c84-6e43-4c78-9060-ec7cdb58e573 admin admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:55:58.788700 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c680c84-6e43-4c78-9060-ec7cdb58e573 admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:55:58.788973 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c680c84-6e43-4c78-9060-ec7cdb58e573 admin admin] PATH_INFO: `/v3/roles` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:55:58.789662 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c680c84-6e43-4c78-9060-ec7cdb58e573 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:55:58.791310 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c680c84-6e43-4c78-9060-ec7cdb58e573 admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:55:58.802655 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1358/2705] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Aug 24 05:55:58 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:55:58.806873 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeadb602-e75b-4e82-a18e-5678ecdd72a9 admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:55:58.817285 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeadb602-e75b-4e82-a18e-5678ecdd72a9 admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:55:58.821885 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2ed73a-00fe-4079-8260-068c5410a7db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:55:58.822716 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2ed73a-00fe-4079-8260-068c5410a7db admin admin] REQUEST_METHOD: `PUT` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:55:58.823003 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2ed73a-00fe-4079-8260-068c5410a7db admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:55:58.823271 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2ed73a-00fe-4079-8260-068c5410a7db admin admin] PATH_INFO: `/v3/projects/d8535281142140dbaf027fce8b56916a/users/4c3e142fd5014708829157a8b014b98f/roles/f7aa4a2c74c94c1b9ca8ecdcccccda5c` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:55:58.838280 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2ed73a-00fe-4079-8260-068c5410a7db admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8535281142140dbaf027fce8b56916a, user_id=4c3e142fd5014708829157a8b014b98f, role_id=f7aa4a2c74c94c1b9ca8ecdcccccda5c)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:55:58.840939 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2ed73a-00fe-4079-8260-068c5410a7db admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:55:58.854079 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1348/2706] 10.222.0.26 () {60 vars in 1483 bytes} [Wed Aug 24 05:55:58 2022] PUT /identity/v3/projects/d8535281142140dbaf027fce8b56916a/users/4c3e142fd5014708829157a8b014b98f/roles/f7aa4a2c74c94c1b9ca8ecdcccccda5c => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:55:58.865364 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a43d12-2be2-4f1c-b1a4-772af2945aab None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:55:58.865835 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a43d12-2be2-4f1c-b1a4-772af2945aab None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:55:58.865972 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a43d12-2be2-4f1c-b1a4-772af2945aab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:55:58.895690 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-d8a43d12-2be2-4f1c-b1a4-772af2945aab None None] MFA Rules not processed for user `4c3e142fd5014708829157a8b014b98f`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:55:58.896892 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-d8a43d12-2be2-4f1c-b1a4-772af2945aab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:55:58.938671 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:DELETE=2,keystone:SELECT=94,keystone:INSERT=4 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:55:58.964126 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1359/2707] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:55:58 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:55:58.975359 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2ed73a-00fe-4079-8260-068c5410a7db admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:55:58.977037 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-8b2ed73a-00fe-4079-8260-068c5410a7db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:55:58.983599 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:INSERT=4,keystone:DELETE=10,keystone:SELECT=86 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:55:59.037231 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2ed73a-00fe-4079-8260-068c5410a7db admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:55:59.040860 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c0ca4f-f3e6-4e5e-a74a-849b186c2b0b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17b450afe795495680fc70f522c83750', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:55:59.041472 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c0ca4f-f3e6-4e5e-a74a-849b186c2b0b service cinder] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:55:59.041753 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c0ca4f-f3e6-4e5e-a74a-849b186c2b0b service cinder] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:55:59.042052 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c0ca4f-f3e6-4e5e-a74a-849b186c2b0b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:55:59.050209 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c0ca4f-f3e6-4e5e-a74a-849b186c2b0b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:55:59.051642 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c0ca4f-f3e6-4e5e-a74a-849b186c2b0b service cinder] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:55:59.062170 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1349/2708] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 24 05:55:58 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:55:59.083819 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a43d12-2be2-4f1c-b1a4-772af2945aab None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:55:59.147058 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a43d12-2be2-4f1c-b1a4-772af2945aab None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:55:59.151875 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6306e301-7f4d-4afa-b339-b0c5ee042bcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:55:59.152516 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6306e301-7f4d-4afa-b339-b0c5ee042bcd admin admin] REQUEST_METHOD: `DELETE` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:55:59.152797 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6306e301-7f4d-4afa-b339-b0c5ee042bcd admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:55:59.153071 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6306e301-7f4d-4afa-b339-b0c5ee042bcd admin admin] PATH_INFO: `/v3/users/4c3e142fd5014708829157a8b014b98f` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:55:59.154265 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6306e301-7f4d-4afa-b339-b0c5ee042bcd admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c3e142fd5014708829157a8b014b98f)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:55:59.156190 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6306e301-7f4d-4afa-b339-b0c5ee042bcd admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:55:59.205175 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-6306e301-7f4d-4afa-b339-b0c5ee042bcd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c3e142fd5014708829157a8b014b98f'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:55:59.213658 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-6306e301-7f4d-4afa-b339-b0c5ee042bcd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c3e142fd5014708829157a8b014b98f'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:55:59.214576 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-6306e301-7f4d-4afa-b339-b0c5ee042bcd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c3e142fd5014708829157a8b014b98f'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:55:59.227191 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-6306e301-7f4d-4afa-b339-b0c5ee042bcd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c3e142fd5014708829157a8b014b98f'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:55:59.234879 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-6306e301-7f4d-4afa-b339-b0c5ee042bcd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c3e142fd5014708829157a8b014b98f'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:55:59.241519 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1360/2709] 10.222.0.26 () {58 vars in 1224 bytes} [Wed Aug 24 05:55:59 2022] DELETE /identity/v3/users/4c3e142fd5014708829157a8b014b98f => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:55:59.246472 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be39721b-a330-4214-b2da-c1ea3ac5352c None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:55:59.246782 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be39721b-a330-4214-b2da-c1ea3ac5352c None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:55:59.247054 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be39721b-a330-4214-b2da-c1ea3ac5352c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:55:59.266627 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-be39721b-a330-4214-b2da-c1ea3ac5352c None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:55:59.267945 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-be39721b-a330-4214-b2da-c1ea3ac5352c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:55:59.328114 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1350/2710] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:55:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 05:55:59.338528 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6306e301-7f4d-4afa-b339-b0c5ee042bcd admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:55:59.340021 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-6306e301-7f4d-4afa-b339-b0c5ee042bcd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:55:59.399867 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6306e301-7f4d-4afa-b339-b0c5ee042bcd admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:55:59.403471 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc4cd0e-a368-4b4e-8f48-9f8711235cfd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '874348b647194ac2b5ecbf12c33bf59e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:55:59.404079 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc4cd0e-a368-4b4e-8f48-9f8711235cfd service neutron] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:55:59.404360 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc4cd0e-a368-4b4e-8f48-9f8711235cfd service neutron] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:55:59.404633 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc4cd0e-a368-4b4e-8f48-9f8711235cfd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:55:59.413619 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc4cd0e-a368-4b4e-8f48-9f8711235cfd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:55:59.415105 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc4cd0e-a368-4b4e-8f48-9f8711235cfd service neutron] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:55:59.425806 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1361/2711] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 24 05:55:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:55:59.806750 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be39721b-a330-4214-b2da-c1ea3ac5352c None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:55:59.809156 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-be39721b-a330-4214-b2da-c1ea3ac5352c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:55:59.823055 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be39721b-a330-4214-b2da-c1ea3ac5352c None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:55:59.829050 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcd121c-46d5-49bf-ba23-075413e3d4b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:55:59.829905 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcd121c-46d5-49bf-ba23-075413e3d4b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:55:59.830305 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcd121c-46d5-49bf-ba23-075413e3d4b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:55:59.830671 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcd121c-46d5-49bf-ba23-075413e3d4b5 admin admin] PATH_INFO: `/v3/projects/d8535281142140dbaf027fce8b56916a` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:55:59.831933 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcd121c-46d5-49bf-ba23-075413e3d4b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d8535281142140dbaf027fce8b56916a)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:55:59.833917 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcd121c-46d5-49bf-ba23-075413e3d4b5 admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:55:59.895825 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-8bcd121c-46d5-49bf-ba23-075413e3d4b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd8535281142140dbaf027fce8b56916a', 'request_id': 'req-8bcd121c-46d5-49bf-ba23-075413e3d4b5'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:55:59.903532 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-8bcd121c-46d5-49bf-ba23-075413e3d4b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd8535281142140dbaf027fce8b56916a', 'request_id': 'req-8bcd121c-46d5-49bf-ba23-075413e3d4b5'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:55:59.911865 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-8bcd121c-46d5-49bf-ba23-075413e3d4b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd8535281142140dbaf027fce8b56916a', 'request_id': 'req-8bcd121c-46d5-49bf-ba23-075413e3d4b5'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:55:59.923032 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-8bcd121c-46d5-49bf-ba23-075413e3d4b5 admin admin] The token cache is being invalidate because project d8535281142140dbaf027fce8b56916a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88112) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:55:59.923227 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-8bcd121c-46d5-49bf-ba23-075413e3d4b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:55:59.924096 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-8bcd121c-46d5-49bf-ba23-075413e3d4b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:55:59.925498 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1351/2712] 10.222.0.26 () {58 vars in 1233 bytes} [Wed Aug 24 05:55:59 2022] DELETE /identity/v3/projects/d8535281142140dbaf027fce8b56916a => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:55:59.930392 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236bc856-6647-4626-a788-fea9c3abee83 None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:55:59.930853 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236bc856-6647-4626-a788-fea9c3abee83 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:55:59.931089 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236bc856-6647-4626-a788-fea9c3abee83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:55:59.940453 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:55:59.953819 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-236bc856-6647-4626-a788-fea9c3abee83 None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:55:59.955058 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-236bc856-6647-4626-a788-fea9c3abee83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:56:00.019225 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1362/2713] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:55:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:56:00.026887 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113ba71d-ca1e-45fa-bd0d-2edd91a39dae None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:56:00.027363 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113ba71d-ca1e-45fa-bd0d-2edd91a39dae None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:56:00.027755 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113ba71d-ca1e-45fa-bd0d-2edd91a39dae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:56:00.048436 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-113ba71d-ca1e-45fa-bd0d-2edd91a39dae None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:56:00.049655 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-113ba71d-ca1e-45fa-bd0d-2edd91a39dae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:56:00.058023 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1352/2714] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:56:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:56:00.064291 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236bc856-6647-4626-a788-fea9c3abee83 None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:56:00.074735 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236bc856-6647-4626-a788-fea9c3abee83 None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:56:00.079299 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebacc70b-3e07-42fe-af61-47f5ac82a9ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:56:00.079893 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebacc70b-3e07-42fe-af61-47f5ac82a9ac admin admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:56:00.080172 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebacc70b-3e07-42fe-af61-47f5ac82a9ac admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:56:00.080442 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebacc70b-3e07-42fe-af61-47f5ac82a9ac admin admin] PATH_INFO: `/v3/domains` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:56:00.081084 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebacc70b-3e07-42fe-af61-47f5ac82a9ac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:56:00.081381 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebacc70b-3e07-42fe-af61-47f5ac82a9ac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:56:00.083072 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebacc70b-3e07-42fe-af61-47f5ac82a9ac admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:56:00.100305 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1363/2715] 10.222.0.26 () {58 vars in 1153 bytes} [Wed Aug 24 05:56:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:56:00.101836 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113ba71d-ca1e-45fa-bd0d-2edd91a39dae None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:56:00.113031 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113ba71d-ca1e-45fa-bd0d-2edd91a39dae None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:56:00.118017 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecabc08a-5ae2-4077-903c-1f397741fb18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:56:00.119636 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecabc08a-5ae2-4077-903c-1f397741fb18 admin admin] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:56:00.123437 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecabc08a-5ae2-4077-903c-1f397741fb18 admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:56:00.123437 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecabc08a-5ae2-4077-903c-1f397741fb18 admin admin] PATH_INFO: `/v3/projects` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:56:00.123437 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecabc08a-5ae2-4077-903c-1f397741fb18 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:56:00.124156 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecabc08a-5ae2-4077-903c-1f397741fb18 admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:56:00.158383 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1353/2716] 10.222.0.26 () {60 vars in 1153 bytes} [Wed Aug 24 05:56:00 2022] POST /identity/v3/projects => generated 375 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:56:00.162867 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebacc70b-3e07-42fe-af61-47f5ac82a9ac admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:56:00.173800 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebacc70b-3e07-42fe-af61-47f5ac82a9ac admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:56:00.238048 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc243b45-cafb-41e1-afd6-5a2824c88615 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:56:00.238652 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc243b45-cafb-41e1-afd6-5a2824c88615 admin admin] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:56:00.238965 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc243b45-cafb-41e1-afd6-5a2824c88615 admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:56:00.239230 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc243b45-cafb-41e1-afd6-5a2824c88615 admin admin] PATH_INFO: `/v3/users` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:56:00.239861 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc243b45-cafb-41e1-afd6-5a2824c88615 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:56:00.241776 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc243b45-cafb-41e1-afd6-5a2824c88615 admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:56:00.265991 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1364/2717] 10.222.0.26 () {60 vars in 1144 bytes} [Wed Aug 24 05:56:00 2022] POST /identity/v3/users => generated 288 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:56:00.268434 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecabc08a-5ae2-4077-903c-1f397741fb18 admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:56:00.274196 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:56:00.281099 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecabc08a-5ae2-4077-903c-1f397741fb18 admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:56:00.286825 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36559cea-fda1-4cb3-aa9b-474729b68023 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:56:00.287455 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36559cea-fda1-4cb3-aa9b-474729b68023 admin admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:56:00.287732 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36559cea-fda1-4cb3-aa9b-474729b68023 admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:56:00.288001 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36559cea-fda1-4cb3-aa9b-474729b68023 admin admin] PATH_INFO: `/v3/roles` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:56:00.288643 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36559cea-fda1-4cb3-aa9b-474729b68023 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:56:00.290320 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36559cea-fda1-4cb3-aa9b-474729b68023 admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:56:00.300677 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1354/2718] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Aug 24 05:56:00 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:56:00.304880 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc243b45-cafb-41e1-afd6-5a2824c88615 admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:56:00.315871 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc243b45-cafb-41e1-afd6-5a2824c88615 admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:56:00.320683 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba596a90-9c77-4443-adf0-7d9e713c09ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:56:00.321281 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba596a90-9c77-4443-adf0-7d9e713c09ed admin admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:56:00.321564 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba596a90-9c77-4443-adf0-7d9e713c09ed admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:56:00.321838 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba596a90-9c77-4443-adf0-7d9e713c09ed admin admin] PATH_INFO: `/v3/roles` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:56:00.322519 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba596a90-9c77-4443-adf0-7d9e713c09ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:56:00.324112 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba596a90-9c77-4443-adf0-7d9e713c09ed admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:56:00.334631 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1365/2719] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Aug 24 05:56:00 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:56:00.338824 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36559cea-fda1-4cb3-aa9b-474729b68023 admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:56:00.348917 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36559cea-fda1-4cb3-aa9b-474729b68023 admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:56:00.353433 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d70b8ba-a1ff-4371-a97a-5b4ff34c7075 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:56:00.354096 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d70b8ba-a1ff-4371-a97a-5b4ff34c7075 admin admin] REQUEST_METHOD: `PUT` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:56:00.354380 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d70b8ba-a1ff-4371-a97a-5b4ff34c7075 admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:56:00.354649 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d70b8ba-a1ff-4371-a97a-5b4ff34c7075 admin admin] PATH_INFO: `/v3/projects/60f8d8d56d414c26962363339175d9c4/users/4667254e09d849f9908acdb7400cdbdb/roles/f7aa4a2c74c94c1b9ca8ecdcccccda5c` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:56:00.369414 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d70b8ba-a1ff-4371-a97a-5b4ff34c7075 admin admin] RBAC: Authorizing `identity:create_grant(project_id=60f8d8d56d414c26962363339175d9c4, user_id=4667254e09d849f9908acdb7400cdbdb, role_id=f7aa4a2c74c94c1b9ca8ecdcccccda5c)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:56:00.372094 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d70b8ba-a1ff-4371-a97a-5b4ff34c7075 admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:56:00.385890 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1355/2720] 10.222.0.26 () {60 vars in 1483 bytes} [Wed Aug 24 05:56:00 2022] PUT /identity/v3/projects/60f8d8d56d414c26962363339175d9c4/users/4667254e09d849f9908acdb7400cdbdb/roles/f7aa4a2c74c94c1b9ca8ecdcccccda5c => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:56:00.396625 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef8d34c-168e-4d32-9b4d-e5b9ce0f995c None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:56:00.396918 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef8d34c-168e-4d32-9b4d-e5b9ce0f995c None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:56:00.397188 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef8d34c-168e-4d32-9b4d-e5b9ce0f995c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:56:00.425502 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-4ef8d34c-168e-4d32-9b4d-e5b9ce0f995c None None] MFA Rules not processed for user `4667254e09d849f9908acdb7400cdbdb`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:56:00.426669 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-4ef8d34c-168e-4d32-9b4d-e5b9ce0f995c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:56:00.493840 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:56:00.499495 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1366/2721] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:56:00 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 05:56:00.503421 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d70b8ba-a1ff-4371-a97a-5b4ff34c7075 admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:56:00.567123 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d70b8ba-a1ff-4371-a97a-5b4ff34c7075 admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:56:00.572008 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0d2728-435a-4c84-870d-feffe68cf319 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:56:00.572647 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0d2728-435a-4c84-870d-feffe68cf319 admin admin] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:56:00.572926 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0d2728-435a-4c84-870d-feffe68cf319 admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:56:00.573199 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0d2728-435a-4c84-870d-feffe68cf319 admin admin] PATH_INFO: `/v3/projects` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:56:00.573830 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0d2728-435a-4c84-870d-feffe68cf319 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:56:00.575765 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0d2728-435a-4c84-870d-feffe68cf319 admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:56:00.602882 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1356/2722] 10.222.0.26 () {60 vars in 1153 bytes} [Wed Aug 24 05:56:00 2022] POST /identity/v3/projects => generated 375 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 05:56:00.606954 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef8d34c-168e-4d32-9b4d-e5b9ce0f995c None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:56:00.618348 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef8d34c-168e-4d32-9b4d-e5b9ce0f995c None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:56:00.674492 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd69474-d247-4bcb-8788-fbd41e11a7cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:56:00.675105 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd69474-d247-4bcb-8788-fbd41e11a7cb admin admin] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:56:00.675387 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd69474-d247-4bcb-8788-fbd41e11a7cb admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:56:00.675713 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd69474-d247-4bcb-8788-fbd41e11a7cb admin admin] PATH_INFO: `/v3/users` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:56:00.676294 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd69474-d247-4bcb-8788-fbd41e11a7cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:56:00.678345 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd69474-d247-4bcb-8788-fbd41e11a7cb admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:56:00.700429 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1367/2723] 10.222.0.26 () {60 vars in 1144 bytes} [Wed Aug 24 05:56:00 2022] POST /identity/v3/users => generated 294 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:56:00.705821 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0d2728-435a-4c84-870d-feffe68cf319 admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:56:00.716428 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0d2728-435a-4c84-870d-feffe68cf319 admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:56:00.721762 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599a4166-f85c-4551-b7b8-74d11d2e7a1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:56:00.722441 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599a4166-f85c-4551-b7b8-74d11d2e7a1f admin admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:56:00.722723 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599a4166-f85c-4551-b7b8-74d11d2e7a1f admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:56:00.722997 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599a4166-f85c-4551-b7b8-74d11d2e7a1f admin admin] PATH_INFO: `/v3/roles` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:56:00.723664 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599a4166-f85c-4551-b7b8-74d11d2e7a1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:56:00.725248 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599a4166-f85c-4551-b7b8-74d11d2e7a1f admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:56:00.737112 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1357/2724] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Aug 24 05:56:00 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:56:00.741317 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd69474-d247-4bcb-8788-fbd41e11a7cb admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:56:00.751323 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd69474-d247-4bcb-8788-fbd41e11a7cb admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:56:00.755954 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77683d8d-d75a-412b-8cf6-5dd011d00ec5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:56:00.756758 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77683d8d-d75a-412b-8cf6-5dd011d00ec5 admin admin] REQUEST_METHOD: `PUT` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:56:00.757045 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77683d8d-d75a-412b-8cf6-5dd011d00ec5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:56:00.757322 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77683d8d-d75a-412b-8cf6-5dd011d00ec5 admin admin] PATH_INFO: `/v3/projects/4c27170801fd41a3bc4e589bebe4c337/users/15f5864ff0e7424fb2f51d09bd9b1e75/roles/640bda0879494e60b72680ee505285f0` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:56:00.772399 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77683d8d-d75a-412b-8cf6-5dd011d00ec5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c27170801fd41a3bc4e589bebe4c337, user_id=15f5864ff0e7424fb2f51d09bd9b1e75, role_id=640bda0879494e60b72680ee505285f0)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:56:00.775101 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77683d8d-d75a-412b-8cf6-5dd011d00ec5 admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:56:00.788469 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1368/2725] 10.222.0.26 () {60 vars in 1483 bytes} [Wed Aug 24 05:56:00 2022] PUT /identity/v3/projects/4c27170801fd41a3bc4e589bebe4c337/users/15f5864ff0e7424fb2f51d09bd9b1e75/roles/640bda0879494e60b72680ee505285f0 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:56:00.792308 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599a4166-f85c-4551-b7b8-74d11d2e7a1f admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:56:00.802497 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599a4166-f85c-4551-b7b8-74d11d2e7a1f admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:56:00.862145 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2028e8-3754-4bf9-b650-16ed9f11a4fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:56:00.862761 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2028e8-3754-4bf9-b650-16ed9f11a4fe admin admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:56:00.863044 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2028e8-3754-4bf9-b650-16ed9f11a4fe admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:56:00.863320 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2028e8-3754-4bf9-b650-16ed9f11a4fe admin admin] PATH_INFO: `/v3/roles` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:56:00.863994 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2028e8-3754-4bf9-b650-16ed9f11a4fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:56:00.865571 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2028e8-3754-4bf9-b650-16ed9f11a4fe admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:56:00.875674 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1358/2726] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Aug 24 05:56:00 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:56:00.880069 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77683d8d-d75a-412b-8cf6-5dd011d00ec5 admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:56:00.890894 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77683d8d-d75a-412b-8cf6-5dd011d00ec5 admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:56:00.895513 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24eef29d-ae2b-418c-9b93-0dcc68c22c26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:56:00.896170 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24eef29d-ae2b-418c-9b93-0dcc68c22c26 admin admin] REQUEST_METHOD: `PUT` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:56:00.896455 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24eef29d-ae2b-418c-9b93-0dcc68c22c26 admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:56:00.896734 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24eef29d-ae2b-418c-9b93-0dcc68c22c26 admin admin] PATH_INFO: `/v3/projects/4c27170801fd41a3bc4e589bebe4c337/users/15f5864ff0e7424fb2f51d09bd9b1e75/roles/640bda0879494e60b72680ee505285f0` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:56:00.898712 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24eef29d-ae2b-418c-9b93-0dcc68c22c26 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c27170801fd41a3bc4e589bebe4c337, user_id=15f5864ff0e7424fb2f51d09bd9b1e75, role_id=640bda0879494e60b72680ee505285f0)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:56:00.902205 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24eef29d-ae2b-418c-9b93-0dcc68c22c26 admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:56:00.913265 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1369/2727] 10.222.0.26 () {60 vars in 1483 bytes} [Wed Aug 24 05:56:00 2022] PUT /identity/v3/projects/4c27170801fd41a3bc4e589bebe4c337/users/15f5864ff0e7424fb2f51d09bd9b1e75/roles/640bda0879494e60b72680ee505285f0 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:56:00.980561 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a38344-669a-4d0a-9704-e6ca6a86cb75 None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:56:00.980852 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a38344-669a-4d0a-9704-e6ca6a86cb75 None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:56:00.981131 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a38344-669a-4d0a-9704-e6ca6a86cb75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:56:01.008613 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-05a38344-669a-4d0a-9704-e6ca6a86cb75 None None] MFA Rules not processed for user `15f5864ff0e7424fb2f51d09bd9b1e75`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:56:01.009899 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-05a38344-669a-4d0a-9704-e6ca6a86cb75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:56:01.038568 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:56:01.082716 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1359/2728] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:56:00 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:56:01.094224 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24eef29d-ae2b-418c-9b93-0dcc68c22c26 admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:56:01.095974 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-24eef29d-ae2b-418c-9b93-0dcc68c22c26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:56:01.152852 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24eef29d-ae2b-418c-9b93-0dcc68c22c26 admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:56:01.156579 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c451a1-ac8e-47c6-b380-08962816a924 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17b450afe795495680fc70f522c83750', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:56:01.157171 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c451a1-ac8e-47c6-b380-08962816a924 service cinder] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:56:01.157453 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c451a1-ac8e-47c6-b380-08962816a924 service cinder] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:56:01.157724 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c451a1-ac8e-47c6-b380-08962816a924 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:56:01.212614 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c451a1-ac8e-47c6-b380-08962816a924 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:56:01.213964 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c451a1-ac8e-47c6-b380-08962816a924 service cinder] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:56:01.222663 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1370/2729] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 24 05:56:01 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 05:56:03.736503 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a38344-669a-4d0a-9704-e6ca6a86cb75 None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:56:03.796481 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a38344-669a-4d0a-9704-e6ca6a86cb75 None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:56:03.800929 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f80c34-c022-480e-9708-dd22f435bbc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:56:03.801551 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f80c34-c022-480e-9708-dd22f435bbc7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:56:03.801836 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f80c34-c022-480e-9708-dd22f435bbc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:56:03.802153 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f80c34-c022-480e-9708-dd22f435bbc7 admin admin] PATH_INFO: `/v3/users/4667254e09d849f9908acdb7400cdbdb` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:56:03.803255 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f80c34-c022-480e-9708-dd22f435bbc7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4667254e09d849f9908acdb7400cdbdb)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:56:03.805153 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f80c34-c022-480e-9708-dd22f435bbc7 admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:56:03.851103 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-34f80c34-c022-480e-9708-dd22f435bbc7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4667254e09d849f9908acdb7400cdbdb'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:56:03.857852 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-34f80c34-c022-480e-9708-dd22f435bbc7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4667254e09d849f9908acdb7400cdbdb'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:56:03.870774 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-34f80c34-c022-480e-9708-dd22f435bbc7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4667254e09d849f9908acdb7400cdbdb'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:56:03.877786 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-34f80c34-c022-480e-9708-dd22f435bbc7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4667254e09d849f9908acdb7400cdbdb'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:56:03.878431 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-34f80c34-c022-480e-9708-dd22f435bbc7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4667254e09d849f9908acdb7400cdbdb'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:56:03.884253 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1360/2730] 10.222.0.26 () {58 vars in 1224 bytes} [Wed Aug 24 05:56:03 2022] DELETE /identity/v3/users/4667254e09d849f9908acdb7400cdbdb => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:56:03.888810 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1ae9d2-b7a7-4422-86d2-771256cee8d8 None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:56:03.889285 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1ae9d2-b7a7-4422-86d2-771256cee8d8 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:56:03.889408 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1ae9d2-b7a7-4422-86d2-771256cee8d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:56:03.902917 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:56:03.909891 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-4b1ae9d2-b7a7-4422-86d2-771256cee8d8 None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:56:03.911149 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-4b1ae9d2-b7a7-4422-86d2-771256cee8d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:56:03.969035 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1371/2731] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:56:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 05:56:03.978653 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f80c34-c022-480e-9708-dd22f435bbc7 admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:56:03.980035 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-34f80c34-c022-480e-9708-dd22f435bbc7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:56:04.025835 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:56:04.040444 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f80c34-c022-480e-9708-dd22f435bbc7 admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:56:04.044164 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee9097a-87c8-4500-a10c-4d3e25906733 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '874348b647194ac2b5ecbf12c33bf59e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:56:04.044790 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee9097a-87c8-4500-a10c-4d3e25906733 service neutron] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:56:04.045069 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee9097a-87c8-4500-a10c-4d3e25906733 service neutron] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:56:04.045339 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee9097a-87c8-4500-a10c-4d3e25906733 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:56:04.054548 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee9097a-87c8-4500-a10c-4d3e25906733 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:56:04.055962 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee9097a-87c8-4500-a10c-4d3e25906733 service neutron] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:56:04.065558 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1361/2732] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 24 05:56:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:56:04.320525 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1ae9d2-b7a7-4422-86d2-771256cee8d8 None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:56:04.322100 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-4b1ae9d2-b7a7-4422-86d2-771256cee8d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:56:04.334936 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1ae9d2-b7a7-4422-86d2-771256cee8d8 None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:56:04.339476 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9ed550-4a44-480e-879c-0c00d85c58e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:56:04.340110 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9ed550-4a44-480e-879c-0c00d85c58e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:56:04.340867 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9ed550-4a44-480e-879c-0c00d85c58e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:56:04.341348 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9ed550-4a44-480e-879c-0c00d85c58e4 admin admin] PATH_INFO: `/v3/projects/60f8d8d56d414c26962363339175d9c4` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:56:04.342485 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9ed550-4a44-480e-879c-0c00d85c58e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=60f8d8d56d414c26962363339175d9c4)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:56:04.344407 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9ed550-4a44-480e-879c-0c00d85c58e4 admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:56:04.390945 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-3c9ed550-4a44-480e-879c-0c00d85c58e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '60f8d8d56d414c26962363339175d9c4', 'request_id': 'req-3c9ed550-4a44-480e-879c-0c00d85c58e4'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:56:04.398043 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-3c9ed550-4a44-480e-879c-0c00d85c58e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '60f8d8d56d414c26962363339175d9c4', 'request_id': 'req-3c9ed550-4a44-480e-879c-0c00d85c58e4'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:56:04.404194 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-3c9ed550-4a44-480e-879c-0c00d85c58e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '60f8d8d56d414c26962363339175d9c4', 'request_id': 'req-3c9ed550-4a44-480e-879c-0c00d85c58e4'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:56:04.414679 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-3c9ed550-4a44-480e-879c-0c00d85c58e4 admin admin] The token cache is being invalidate because project 60f8d8d56d414c26962363339175d9c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:56:04.414968 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-3c9ed550-4a44-480e-879c-0c00d85c58e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:56:04.415594 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-3c9ed550-4a44-480e-879c-0c00d85c58e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:56:04.417065 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1372/2733] 10.222.0.26 () {58 vars in 1233 bytes} [Wed Aug 24 05:56:04 2022] DELETE /identity/v3/projects/60f8d8d56d414c26962363339175d9c4 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:56:04.421073 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee9097a-87c8-4500-a10c-4d3e25906733 service neutron] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:56:04.430547 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee9097a-87c8-4500-a10c-4d3e25906733 service neutron] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:56:04.485889 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f280483-da01-4264-bc3f-e74e8364d15f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:56:04.486521 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f280483-da01-4264-bc3f-e74e8364d15f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:56:04.486796 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f280483-da01-4264-bc3f-e74e8364d15f admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:56:04.487067 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f280483-da01-4264-bc3f-e74e8364d15f admin admin] PATH_INFO: `/v3/users/15f5864ff0e7424fb2f51d09bd9b1e75` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:56:04.488174 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f280483-da01-4264-bc3f-e74e8364d15f admin admin] RBAC: Authorizing `identity:delete_user(user_id=15f5864ff0e7424fb2f51d09bd9b1e75)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:56:04.490229 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f280483-da01-4264-bc3f-e74e8364d15f admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:56:04.536310 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-4f280483-da01-4264-bc3f-e74e8364d15f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '15f5864ff0e7424fb2f51d09bd9b1e75'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:56:04.543576 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-4f280483-da01-4264-bc3f-e74e8364d15f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '15f5864ff0e7424fb2f51d09bd9b1e75'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:56:04.555884 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-4f280483-da01-4264-bc3f-e74e8364d15f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '15f5864ff0e7424fb2f51d09bd9b1e75'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:56:04.563931 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-4f280483-da01-4264-bc3f-e74e8364d15f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '15f5864ff0e7424fb2f51d09bd9b1e75'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:56:04.564703 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-4f280483-da01-4264-bc3f-e74e8364d15f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '15f5864ff0e7424fb2f51d09bd9b1e75'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:56:04.570806 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1362/2734] 10.222.0.26 () {58 vars in 1224 bytes} [Wed Aug 24 05:56:04 2022] DELETE /identity/v3/users/15f5864ff0e7424fb2f51d09bd9b1e75 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:56:04.833580 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9ed550-4a44-480e-879c-0c00d85c58e4 admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:56:04.835170 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-3c9ed550-4a44-480e-879c-0c00d85c58e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:56:04.848848 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9ed550-4a44-480e-879c-0c00d85c58e4 admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:56:04.903509 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a1ed31-506c-481b-af6e-4829001c4341 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:56:04.904162 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a1ed31-506c-481b-af6e-4829001c4341 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:56:04.904389 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a1ed31-506c-481b-af6e-4829001c4341 admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:56:04.904656 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a1ed31-506c-481b-af6e-4829001c4341 admin admin] PATH_INFO: `/v3/projects/4c27170801fd41a3bc4e589bebe4c337` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:56:04.906283 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a1ed31-506c-481b-af6e-4829001c4341 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c27170801fd41a3bc4e589bebe4c337)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:56:04.908182 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a1ed31-506c-481b-af6e-4829001c4341 admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:56:04.941557 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:56:04.955694 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-b6a1ed31-506c-481b-af6e-4829001c4341 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c27170801fd41a3bc4e589bebe4c337', 'request_id': 'req-b6a1ed31-506c-481b-af6e-4829001c4341'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:56:04.963017 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-b6a1ed31-506c-481b-af6e-4829001c4341 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c27170801fd41a3bc4e589bebe4c337', 'request_id': 'req-b6a1ed31-506c-481b-af6e-4829001c4341'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:56:04.969809 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-b6a1ed31-506c-481b-af6e-4829001c4341 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c27170801fd41a3bc4e589bebe4c337', 'request_id': 'req-b6a1ed31-506c-481b-af6e-4829001c4341'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:56:04.979929 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-b6a1ed31-506c-481b-af6e-4829001c4341 admin admin] The token cache is being invalidate because project 4c27170801fd41a3bc4e589bebe4c337 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:56:04.980215 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-b6a1ed31-506c-481b-af6e-4829001c4341 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:56:04.980878 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-b6a1ed31-506c-481b-af6e-4829001c4341 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:56:04.982389 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1373/2735] 10.222.0.26 () {58 vars in 1233 bytes} [Wed Aug 24 05:56:04 2022] DELETE /identity/v3/projects/4c27170801fd41a3bc4e589bebe4c337 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:56:04.987981 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37a459f-1c1d-4976-924a-79dcfde4d48c None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:56:04.988470 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37a459f-1c1d-4976-924a-79dcfde4d48c None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:56:04.988594 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37a459f-1c1d-4976-924a-79dcfde4d48c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:56:05.008112 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-b37a459f-1c1d-4976-924a-79dcfde4d48c None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:56:05.009293 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-b37a459f-1c1d-4976-924a-79dcfde4d48c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:56:05.067117 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1363/2736] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:56:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:56:05.074300 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c926a64-a1a0-4be1-8cd3-a816abd66c31 None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:56:05.074589 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c926a64-a1a0-4be1-8cd3-a816abd66c31 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:56:05.074866 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c926a64-a1a0-4be1-8cd3-a816abd66c31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:56:05.094918 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-4c926a64-a1a0-4be1-8cd3-a816abd66c31 None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:56:05.096113 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-4c926a64-a1a0-4be1-8cd3-a816abd66c31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:56:05.104044 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1374/2737] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:56:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:56:05.108260 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37a459f-1c1d-4976-924a-79dcfde4d48c None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:56:05.115123 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:56:05.119035 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37a459f-1c1d-4976-924a-79dcfde4d48c None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:56:05.125018 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0224fb7-64c8-4708-a9b0-7b004010e781 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:56:05.125837 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0224fb7-64c8-4708-a9b0-7b004010e781 admin admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:56:05.126366 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0224fb7-64c8-4708-a9b0-7b004010e781 admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:56:05.126789 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0224fb7-64c8-4708-a9b0-7b004010e781 admin admin] PATH_INFO: `/v3/domains` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:56:05.127438 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0224fb7-64c8-4708-a9b0-7b004010e781 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:56:05.127740 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0224fb7-64c8-4708-a9b0-7b004010e781 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:56:05.129387 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0224fb7-64c8-4708-a9b0-7b004010e781 admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:56:05.140870 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1364/2738] 10.222.0.26 () {58 vars in 1153 bytes} [Wed Aug 24 05:56:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:56:05.145154 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c926a64-a1a0-4be1-8cd3-a816abd66c31 None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:56:05.154472 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c926a64-a1a0-4be1-8cd3-a816abd66c31 None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:56:05.159694 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f30963-7958-45de-ac86-a13011c56db8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:56:05.160281 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f30963-7958-45de-ac86-a13011c56db8 admin admin] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:56:05.160560 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f30963-7958-45de-ac86-a13011c56db8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:56:05.160832 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f30963-7958-45de-ac86-a13011c56db8 admin admin] PATH_INFO: `/v3/projects` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:56:05.161459 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f30963-7958-45de-ac86-a13011c56db8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:56:05.163395 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f30963-7958-45de-ac86-a13011c56db8 admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:56:05.191996 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1375/2739] 10.222.0.26 () {60 vars in 1153 bytes} [Wed Aug 24 05:56:05 2022] POST /identity/v3/projects => generated 367 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:56:05.196115 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0224fb7-64c8-4708-a9b0-7b004010e781 admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:56:05.206474 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0224fb7-64c8-4708-a9b0-7b004010e781 admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:56:05.261269 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000e58d6-bab9-4188-9329-7e047b99f27b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:56:05.261860 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000e58d6-bab9-4188-9329-7e047b99f27b admin admin] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:56:05.262169 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000e58d6-bab9-4188-9329-7e047b99f27b admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:56:05.262437 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000e58d6-bab9-4188-9329-7e047b99f27b admin admin] PATH_INFO: `/v3/users` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:56:05.263045 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000e58d6-bab9-4188-9329-7e047b99f27b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:56:05.265428 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000e58d6-bab9-4188-9329-7e047b99f27b admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:56:05.287338 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1365/2740] 10.222.0.26 () {60 vars in 1144 bytes} [Wed Aug 24 05:56:05 2022] POST /identity/v3/users => generated 284 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:56:05.291907 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f30963-7958-45de-ac86-a13011c56db8 admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:56:05.302217 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f30963-7958-45de-ac86-a13011c56db8 admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:56:05.306766 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd24625b-aeaa-4714-a615-0c8277e6efae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:56:05.307349 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd24625b-aeaa-4714-a615-0c8277e6efae admin admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:56:05.307623 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd24625b-aeaa-4714-a615-0c8277e6efae admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:56:05.307896 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd24625b-aeaa-4714-a615-0c8277e6efae admin admin] PATH_INFO: `/v3/roles` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:56:05.308527 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd24625b-aeaa-4714-a615-0c8277e6efae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:56:05.310161 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd24625b-aeaa-4714-a615-0c8277e6efae admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:56:05.320071 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1376/2741] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Aug 24 05:56:05 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:56:05.323883 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000e58d6-bab9-4188-9329-7e047b99f27b admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:56:05.334208 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000e58d6-bab9-4188-9329-7e047b99f27b admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:56:05.338795 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafb0e26-26c1-4f5a-850e-0fa111f9e879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:56:05.339391 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafb0e26-26c1-4f5a-850e-0fa111f9e879 admin admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:56:05.339670 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafb0e26-26c1-4f5a-850e-0fa111f9e879 admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:56:05.339941 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafb0e26-26c1-4f5a-850e-0fa111f9e879 admin admin] PATH_INFO: `/v3/roles` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:56:05.340609 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafb0e26-26c1-4f5a-850e-0fa111f9e879 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:56:05.342247 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafb0e26-26c1-4f5a-850e-0fa111f9e879 admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:56:05.352716 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1366/2742] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Aug 24 05:56:05 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:56:05.356495 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd24625b-aeaa-4714-a615-0c8277e6efae admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:56:05.366737 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd24625b-aeaa-4714-a615-0c8277e6efae admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:56:05.371372 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a13bb8-7144-40f8-9f73-f58bec6ae374 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:56:05.372002 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a13bb8-7144-40f8-9f73-f58bec6ae374 admin admin] REQUEST_METHOD: `PUT` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:56:05.372282 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a13bb8-7144-40f8-9f73-f58bec6ae374 admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:56:05.372555 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a13bb8-7144-40f8-9f73-f58bec6ae374 admin admin] PATH_INFO: `/v3/projects/091830b130ed41539171d5c6b3903b6a/users/12ba0829536542d9abf9f7f6143a68b6/roles/f7aa4a2c74c94c1b9ca8ecdcccccda5c` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:56:05.387336 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a13bb8-7144-40f8-9f73-f58bec6ae374 admin admin] RBAC: Authorizing `identity:create_grant(project_id=091830b130ed41539171d5c6b3903b6a, user_id=12ba0829536542d9abf9f7f6143a68b6, role_id=f7aa4a2c74c94c1b9ca8ecdcccccda5c)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:56:05.390113 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a13bb8-7144-40f8-9f73-f58bec6ae374 admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:56:05.402818 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1377/2743] 10.222.0.26 () {60 vars in 1483 bytes} [Wed Aug 24 05:56:05 2022] PUT /identity/v3/projects/091830b130ed41539171d5c6b3903b6a/users/12ba0829536542d9abf9f7f6143a68b6/roles/f7aa4a2c74c94c1b9ca8ecdcccccda5c => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:56:05.412768 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b1a02b-7a4d-4f9c-b642-f513eb7e242e None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:56:05.413051 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b1a02b-7a4d-4f9c-b642-f513eb7e242e None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:56:05.413321 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b1a02b-7a4d-4f9c-b642-f513eb7e242e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:56:05.440795 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-d4b1a02b-7a4d-4f9c-b642-f513eb7e242e None None] MFA Rules not processed for user `12ba0829536542d9abf9f7f6143a68b6`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:56:05.442342 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-d4b1a02b-7a4d-4f9c-b642-f513eb7e242e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:56:05.503432 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1367/2744] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:56:05 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:56:05.514670 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a13bb8-7144-40f8-9f73-f58bec6ae374 admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:56:05.516453 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-78a13bb8-7144-40f8-9f73-f58bec6ae374 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:56:05.572599 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a13bb8-7144-40f8-9f73-f58bec6ae374 admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:56:05.576284 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d711a8-3f0d-4303-a62d-517cd56af071 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f856958add7474a989325cea7b1b224', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:56:05.576885 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d711a8-3f0d-4303-a62d-517cd56af071 service glance] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:56:05.577167 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d711a8-3f0d-4303-a62d-517cd56af071 service glance] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:56:05.577481 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d711a8-3f0d-4303-a62d-517cd56af071 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:56:05.585600 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d711a8-3f0d-4303-a62d-517cd56af071 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:56:05.587011 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d711a8-3f0d-4303-a62d-517cd56af071 service glance] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:56:05.596091 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1378/2745] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 24 05:56:05 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:56:08.304891 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b1a02b-7a4d-4f9c-b642-f513eb7e242e None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:56:08.306328 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-d4b1a02b-7a4d-4f9c-b642-f513eb7e242e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:56:08.363233 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b1a02b-7a4d-4f9c-b642-f513eb7e242e None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:56:08.366676 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f41c29-a1b7-4e90-a0a7-ecfcbe1bbe39 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17b450afe795495680fc70f522c83750', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:56:08.367276 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f41c29-a1b7-4e90-a0a7-ecfcbe1bbe39 service cinder] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:56:08.367553 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f41c29-a1b7-4e90-a0a7-ecfcbe1bbe39 service cinder] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:56:08.367817 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f41c29-a1b7-4e90-a0a7-ecfcbe1bbe39 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:56:08.369505 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-32f41c29-a1b7-4e90-a0a7-ecfcbe1bbe39 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:56:08.382999 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:56:08.442226 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f41c29-a1b7-4e90-a0a7-ecfcbe1bbe39 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:56:08.443713 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f41c29-a1b7-4e90-a0a7-ecfcbe1bbe39 service cinder] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:56:08.455039 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1368/2746] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 24 05:56:08 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:56:08.780818 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d711a8-3f0d-4303-a62d-517cd56af071 service glance] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:56:08.782864 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-05d711a8-3f0d-4303-a62d-517cd56af071 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:56:08.794625 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d711a8-3f0d-4303-a62d-517cd56af071 service glance] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:56:08.798681 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac94fb93-3ccc-43b8-84d8-875d135c5cb1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17b450afe795495680fc70f522c83750', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:56:08.799266 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac94fb93-3ccc-43b8-84d8-875d135c5cb1 service cinder] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:56:08.799540 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac94fb93-3ccc-43b8-84d8-875d135c5cb1 service cinder] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:56:08.799806 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac94fb93-3ccc-43b8-84d8-875d135c5cb1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:56:08.801475 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-ac94fb93-3ccc-43b8-84d8-875d135c5cb1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:56:08.820073 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac94fb93-3ccc-43b8-84d8-875d135c5cb1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:56:08.821525 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac94fb93-3ccc-43b8-84d8-875d135c5cb1 service cinder] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:56:08.833638 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1379/2747] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 24 05:56:08 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:56:18.450023 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=27 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:56:18.828633 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=71,keystone:DELETE=5,keystone:INSERT=3 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:56:25.920989 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f41c29-a1b7-4e90-a0a7-ecfcbe1bbe39 service cinder] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:56:25.922454 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-32f41c29-a1b7-4e90-a0a7-ecfcbe1bbe39 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:56:25.983591 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f41c29-a1b7-4e90-a0a7-ecfcbe1bbe39 service cinder] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:56:25.987178 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b6d6e1-a0e5-4574-bffc-bff32f4ae1ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '874348b647194ac2b5ecbf12c33bf59e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:56:25.988441 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b6d6e1-a0e5-4574-bffc-bff32f4ae1ab service neutron] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:56:25.988713 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b6d6e1-a0e5-4574-bffc-bff32f4ae1ab service neutron] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:56:25.988979 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b6d6e1-a0e5-4574-bffc-bff32f4ae1ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:56:25.990713 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-b1b6d6e1-a0e5-4574-bffc-bff32f4ae1ab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:56:26.052005 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b6d6e1-a0e5-4574-bffc-bff32f4ae1ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:56:26.053443 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b6d6e1-a0e5-4574-bffc-bff32f4ae1ab service neutron] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:56:26.064031 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1369/2748] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 24 05:56:25 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:56:27.686110 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac94fb93-3ccc-43b8-84d8-875d135c5cb1 service cinder] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:56:27.696515 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac94fb93-3ccc-43b8-84d8-875d135c5cb1 service cinder] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:56:27.700620 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fccdb3a-7074-488f-85fe-0133af6346ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '874348b647194ac2b5ecbf12c33bf59e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:56:27.701235 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fccdb3a-7074-488f-85fe-0133af6346ac service neutron] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:56:27.701515 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fccdb3a-7074-488f-85fe-0133af6346ac service neutron] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:56:27.701836 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fccdb3a-7074-488f-85fe-0133af6346ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:56:27.703680 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-2fccdb3a-7074-488f-85fe-0133af6346ac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:56:27.715022 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fccdb3a-7074-488f-85fe-0133af6346ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:56:27.716475 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fccdb3a-7074-488f-85fe-0133af6346ac service neutron] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:56:27.730177 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1380/2749] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 24 05:56:27 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:56:32.371137 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b6d6e1-a0e5-4574-bffc-bff32f4ae1ab service neutron] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:56:32.431914 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b6d6e1-a0e5-4574-bffc-bff32f4ae1ab service neutron] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:56:32.436470 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6098b264-822b-41a8-8e75-ba03e9df0a69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:56:32.437091 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6098b264-822b-41a8-8e75-ba03e9df0a69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:56:32.437372 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6098b264-822b-41a8-8e75-ba03e9df0a69 admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:56:32.437645 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6098b264-822b-41a8-8e75-ba03e9df0a69 admin admin] PATH_INFO: `/v3/users/12ba0829536542d9abf9f7f6143a68b6` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:56:32.438788 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6098b264-822b-41a8-8e75-ba03e9df0a69 admin admin] RBAC: Authorizing `identity:delete_user(user_id=12ba0829536542d9abf9f7f6143a68b6)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:56:32.440733 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6098b264-822b-41a8-8e75-ba03e9df0a69 admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:56:32.487119 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-6098b264-822b-41a8-8e75-ba03e9df0a69 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '12ba0829536542d9abf9f7f6143a68b6'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:56:32.491522 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:56:32.494857 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-6098b264-822b-41a8-8e75-ba03e9df0a69 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '12ba0829536542d9abf9f7f6143a68b6'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:56:32.508025 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-6098b264-822b-41a8-8e75-ba03e9df0a69 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '12ba0829536542d9abf9f7f6143a68b6'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:56:32.515377 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-6098b264-822b-41a8-8e75-ba03e9df0a69 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '12ba0829536542d9abf9f7f6143a68b6'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:56:32.516072 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-6098b264-822b-41a8-8e75-ba03e9df0a69 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '12ba0829536542d9abf9f7f6143a68b6'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:56:32.522808 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1370/2750] 10.222.0.26 () {58 vars in 1224 bytes} [Wed Aug 24 05:56:32 2022] DELETE /identity/v3/users/12ba0829536542d9abf9f7f6143a68b6 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:56:32.527482 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc281d0-bc3a-4906-919f-071cde5c8ee3 None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:56:32.527961 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc281d0-bc3a-4906-919f-071cde5c8ee3 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:56:32.528080 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc281d0-bc3a-4906-919f-071cde5c8ee3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:56:32.547340 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-bbc281d0-bc3a-4906-919f-071cde5c8ee3 None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:56:32.548484 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-bbc281d0-bc3a-4906-919f-071cde5c8ee3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:56:32.605356 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1381/2751] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:56:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:56:32.615617 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6098b264-822b-41a8-8e75-ba03e9df0a69 admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:56:32.617195 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-6098b264-822b-41a8-8e75-ba03e9df0a69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:56:32.672765 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6098b264-822b-41a8-8e75-ba03e9df0a69 admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:56:32.677009 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cabc91-1ec9-40e9-a055-5f1607884d6c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '874348b647194ac2b5ecbf12c33bf59e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:56:32.677608 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cabc91-1ec9-40e9-a055-5f1607884d6c service neutron] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:56:32.677883 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cabc91-1ec9-40e9-a055-5f1607884d6c service neutron] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:56:32.678180 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cabc91-1ec9-40e9-a055-5f1607884d6c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:56:32.686879 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cabc91-1ec9-40e9-a055-5f1607884d6c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:56:32.688352 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cabc91-1ec9-40e9-a055-5f1607884d6c service neutron] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:56:32.697831 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1371/2752] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 24 05:56:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 05:56:32.964549 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc281d0-bc3a-4906-919f-071cde5c8ee3 None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:56:32.966153 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-bbc281d0-bc3a-4906-919f-071cde5c8ee3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:56:32.979385 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc281d0-bc3a-4906-919f-071cde5c8ee3 None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:56:32.984267 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5567506-154e-42e3-a5f8-9a4ef1f81f2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:56:32.984893 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5567506-154e-42e3-a5f8-9a4ef1f81f2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:56:32.985171 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5567506-154e-42e3-a5f8-9a4ef1f81f2b admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:56:32.985439 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5567506-154e-42e3-a5f8-9a4ef1f81f2b admin admin] PATH_INFO: `/v3/projects/091830b130ed41539171d5c6b3903b6a` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:56:32.986633 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5567506-154e-42e3-a5f8-9a4ef1f81f2b admin admin] RBAC: Authorizing `identity:delete_project(project_id=091830b130ed41539171d5c6b3903b6a)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:56:32.988477 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5567506-154e-42e3-a5f8-9a4ef1f81f2b admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:56:33.033662 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-b5567506-154e-42e3-a5f8-9a4ef1f81f2b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '091830b130ed41539171d5c6b3903b6a', 'request_id': 'req-b5567506-154e-42e3-a5f8-9a4ef1f81f2b'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:56:33.041586 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-b5567506-154e-42e3-a5f8-9a4ef1f81f2b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '091830b130ed41539171d5c6b3903b6a', 'request_id': 'req-b5567506-154e-42e3-a5f8-9a4ef1f81f2b'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:56:33.047896 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-b5567506-154e-42e3-a5f8-9a4ef1f81f2b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '091830b130ed41539171d5c6b3903b6a', 'request_id': 'req-b5567506-154e-42e3-a5f8-9a4ef1f81f2b'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:56:33.058167 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-b5567506-154e-42e3-a5f8-9a4ef1f81f2b admin admin] The token cache is being invalidate because project 091830b130ed41539171d5c6b3903b6a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:56:33.058453 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-b5567506-154e-42e3-a5f8-9a4ef1f81f2b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:56:33.059067 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-b5567506-154e-42e3-a5f8-9a4ef1f81f2b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:56:33.060532 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1382/2753] 10.222.0.26 () {58 vars in 1233 bytes} [Wed Aug 24 05:56:32 2022] DELETE /identity/v3/projects/091830b130ed41539171d5c6b3903b6a => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:56:33.066254 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6302f353-73c4-4d1a-a9b2-4d5717171054 None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:56:33.066541 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6302f353-73c4-4d1a-a9b2-4d5717171054 None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:56:33.066812 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6302f353-73c4-4d1a-a9b2-4d5717171054 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:56:33.086127 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-6302f353-73c4-4d1a-a9b2-4d5717171054 None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:56:33.087249 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-6302f353-73c4-4d1a-a9b2-4d5717171054 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:56:33.150273 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1372/2754] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:56:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:56:33.158957 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d9b04f-0bf9-43a9-a1ee-47c32ac5cd77 None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:56:33.159902 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d9b04f-0bf9-43a9-a1ee-47c32ac5cd77 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:56:33.160179 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d9b04f-0bf9-43a9-a1ee-47c32ac5cd77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:56:33.179405 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-90d9b04f-0bf9-43a9-a1ee-47c32ac5cd77 None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:56:33.180598 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-90d9b04f-0bf9-43a9-a1ee-47c32ac5cd77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:56:33.188349 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1383/2755] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:56:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:56:33.192799 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6302f353-73c4-4d1a-a9b2-4d5717171054 None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:56:33.202356 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6302f353-73c4-4d1a-a9b2-4d5717171054 None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:56:33.207460 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6367598-dfd4-45c6-8d71-fe8511909be1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:56:33.208050 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6367598-dfd4-45c6-8d71-fe8511909be1 admin admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:56:33.208330 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6367598-dfd4-45c6-8d71-fe8511909be1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:56:33.208630 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6367598-dfd4-45c6-8d71-fe8511909be1 admin admin] PATH_INFO: `/v3/domains` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:56:33.209273 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6367598-dfd4-45c6-8d71-fe8511909be1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:56:33.209576 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6367598-dfd4-45c6-8d71-fe8511909be1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:56:33.211197 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6367598-dfd4-45c6-8d71-fe8511909be1 admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:56:33.222927 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1373/2756] 10.222.0.26 () {58 vars in 1153 bytes} [Wed Aug 24 05:56:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:56:33.227058 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d9b04f-0bf9-43a9-a1ee-47c32ac5cd77 None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:56:33.236185 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d9b04f-0bf9-43a9-a1ee-47c32ac5cd77 None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:56:33.240796 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d4346a-7588-48c4-8749-c53cb0a3dd0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:56:33.241381 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d4346a-7588-48c4-8749-c53cb0a3dd0f admin admin] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:56:33.241659 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d4346a-7588-48c4-8749-c53cb0a3dd0f admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:56:33.241928 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d4346a-7588-48c4-8749-c53cb0a3dd0f admin admin] PATH_INFO: `/v3/projects` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:56:33.242581 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d4346a-7588-48c4-8749-c53cb0a3dd0f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:56:33.244476 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d4346a-7588-48c4-8749-c53cb0a3dd0f admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:56:33.272043 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1384/2757] 10.222.0.26 () {60 vars in 1153 bytes} [Wed Aug 24 05:56:33 2022] POST /identity/v3/projects => generated 375 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:56:33.276133 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6367598-dfd4-45c6-8d71-fe8511909be1 admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:56:33.285976 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6367598-dfd4-45c6-8d71-fe8511909be1 admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:56:33.342960 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2128e96-019c-4ea4-8380-3f19d907a238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:56:33.343595 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2128e96-019c-4ea4-8380-3f19d907a238 admin admin] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:56:33.343880 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2128e96-019c-4ea4-8380-3f19d907a238 admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:56:33.344155 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2128e96-019c-4ea4-8380-3f19d907a238 admin admin] PATH_INFO: `/v3/users` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:56:33.344814 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2128e96-019c-4ea4-8380-3f19d907a238 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:56:33.346763 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2128e96-019c-4ea4-8380-3f19d907a238 admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:56:33.354485 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:56:33.368667 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1374/2758] 10.222.0.26 () {60 vars in 1144 bytes} [Wed Aug 24 05:56:33 2022] POST /identity/v3/users => generated 288 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:56:33.372786 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d4346a-7588-48c4-8749-c53cb0a3dd0f admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:56:33.383746 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d4346a-7588-48c4-8749-c53cb0a3dd0f admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:56:33.388324 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd6d2ff-2fe8-434a-9426-8af5b8fa1e42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:56:33.388921 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd6d2ff-2fe8-434a-9426-8af5b8fa1e42 admin admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:56:33.389202 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd6d2ff-2fe8-434a-9426-8af5b8fa1e42 admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:56:33.389472 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd6d2ff-2fe8-434a-9426-8af5b8fa1e42 admin admin] PATH_INFO: `/v3/roles` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:56:33.390148 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd6d2ff-2fe8-434a-9426-8af5b8fa1e42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:56:33.391747 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd6d2ff-2fe8-434a-9426-8af5b8fa1e42 admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:56:33.402057 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1385/2759] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Aug 24 05:56:33 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:56:33.405855 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2128e96-019c-4ea4-8380-3f19d907a238 admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:56:33.415912 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2128e96-019c-4ea4-8380-3f19d907a238 admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:56:33.420318 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6c4e43-2ac2-4a9a-b399-3fc2d2d451d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:56:33.420899 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6c4e43-2ac2-4a9a-b399-3fc2d2d451d1 admin admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:56:33.421174 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6c4e43-2ac2-4a9a-b399-3fc2d2d451d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:56:33.421444 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6c4e43-2ac2-4a9a-b399-3fc2d2d451d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:56:33.422109 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6c4e43-2ac2-4a9a-b399-3fc2d2d451d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:56:33.423670 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6c4e43-2ac2-4a9a-b399-3fc2d2d451d1 admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:56:33.433936 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1375/2760] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Aug 24 05:56:33 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:56:33.437860 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd6d2ff-2fe8-434a-9426-8af5b8fa1e42 admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:56:33.448565 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd6d2ff-2fe8-434a-9426-8af5b8fa1e42 admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:56:33.453127 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10382401-564b-4367-b6f3-40129f37eb34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:56:33.453759 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10382401-564b-4367-b6f3-40129f37eb34 admin admin] REQUEST_METHOD: `PUT` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:56:33.454076 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10382401-564b-4367-b6f3-40129f37eb34 admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:56:33.454350 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10382401-564b-4367-b6f3-40129f37eb34 admin admin] PATH_INFO: `/v3/projects/e57a390c91c54539a2a0cdbe689a8bb6/users/168e2f1c26af43a3b8469203eaecc983/roles/f7aa4a2c74c94c1b9ca8ecdcccccda5c` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:56:33.469165 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10382401-564b-4367-b6f3-40129f37eb34 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e57a390c91c54539a2a0cdbe689a8bb6, user_id=168e2f1c26af43a3b8469203eaecc983, role_id=f7aa4a2c74c94c1b9ca8ecdcccccda5c)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:56:33.471834 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10382401-564b-4367-b6f3-40129f37eb34 admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:56:33.484541 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1386/2761] 10.222.0.26 () {60 vars in 1483 bytes} [Wed Aug 24 05:56:33 2022] PUT /identity/v3/projects/e57a390c91c54539a2a0cdbe689a8bb6/users/168e2f1c26af43a3b8469203eaecc983/roles/f7aa4a2c74c94c1b9ca8ecdcccccda5c => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:56:33.494580 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ba0ec4-3113-4fac-8802-eb4e8a964d13 None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:56:33.494863 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ba0ec4-3113-4fac-8802-eb4e8a964d13 None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:56:33.495139 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ba0ec4-3113-4fac-8802-eb4e8a964d13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:56:33.522996 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-28ba0ec4-3113-4fac-8802-eb4e8a964d13 None None] MFA Rules not processed for user `168e2f1c26af43a3b8469203eaecc983`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:56:33.524351 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-28ba0ec4-3113-4fac-8802-eb4e8a964d13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:56:33.587766 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1376/2762] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:56:33 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:56:33.598985 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10382401-564b-4367-b6f3-40129f37eb34 admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:56:33.600597 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-10382401-564b-4367-b6f3-40129f37eb34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:56:33.610303 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:56:33.658006 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10382401-564b-4367-b6f3-40129f37eb34 admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:56:33.662342 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bb80f4-732c-403c-a30d-df3b0a7e1322 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17b450afe795495680fc70f522c83750', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:56:33.662945 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bb80f4-732c-403c-a30d-df3b0a7e1322 service cinder] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:56:33.663228 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bb80f4-732c-403c-a30d-df3b0a7e1322 service cinder] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:56:33.663503 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bb80f4-732c-403c-a30d-df3b0a7e1322 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:56:33.672019 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bb80f4-732c-403c-a30d-df3b0a7e1322 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:56:33.673445 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bb80f4-732c-403c-a30d-df3b0a7e1322 service cinder] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:56:33.682326 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1387/2763] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 24 05:56:33 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:56:35.028631 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c521f8-4093-4c0a-a63f-b156a486a31e None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:56:35.029146 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c521f8-4093-4c0a-a63f-b156a486a31e None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:56:35.029255 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c521f8-4093-4c0a-a63f-b156a486a31e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:56:35.048280 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-70c521f8-4093-4c0a-a63f-b156a486a31e None None] MFA Rules not processed for user `168e2f1c26af43a3b8469203eaecc983`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:56:35.049507 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-70c521f8-4093-4c0a-a63f-b156a486a31e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:56:35.056969 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1377/2764] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:56:35 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:56:35.511255 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bb80f4-732c-403c-a30d-df3b0a7e1322 service cinder] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:56:35.512675 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-57bb80f4-732c-403c-a30d-df3b0a7e1322 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:56:35.587417 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bb80f4-732c-403c-a30d-df3b0a7e1322 service cinder] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:56:35.592367 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf451f0-79c3-40be-b788-f0a582bf8ea4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '995ebe690b7748c9842bc0696415fc52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:56:35.592969 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf451f0-79c3-40be-b788-f0a582bf8ea4 service placement] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:56:35.593250 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf451f0-79c3-40be-b788-f0a582bf8ea4 service placement] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:56:35.593521 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf451f0-79c3-40be-b788-f0a582bf8ea4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:56:35.595256 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-5bf451f0-79c3-40be-b788-f0a582bf8ea4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:56:35.606944 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf451f0-79c3-40be-b788-f0a582bf8ea4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:56:35.608544 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf451f0-79c3-40be-b788-f0a582bf8ea4 service placement] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:56:35.618995 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1388/2765] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 24 05:56:35 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:56:38.482513 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c521f8-4093-4c0a-a63f-b156a486a31e None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:56:38.484708 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-70c521f8-4093-4c0a-a63f-b156a486a31e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:56:38.570622 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c521f8-4093-4c0a-a63f-b156a486a31e None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:56:38.576367 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc24e244-31b0-4f5b-8f4a-feb2301ba7e2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b633e1aec6c4269bce13aa9c89e911a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:56:38.577047 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc24e244-31b0-4f5b-8f4a-feb2301ba7e2 service nova] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:56:38.577393 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc24e244-31b0-4f5b-8f4a-feb2301ba7e2 service nova] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:56:38.577820 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc24e244-31b0-4f5b-8f4a-feb2301ba7e2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:56:38.579675 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-dc24e244-31b0-4f5b-8f4a-feb2301ba7e2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:56:38.591752 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc24e244-31b0-4f5b-8f4a-feb2301ba7e2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:56:38.593310 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc24e244-31b0-4f5b-8f4a-feb2301ba7e2 service nova] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:56:38.604881 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1378/2766] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 24 05:56:38 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:56:45.614772 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=55 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:56:48.599855 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:INSERT=3,keystone:SELECT=76 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:56:51.480227 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc10e6a-a475-4097-a1b0-803787fc5784 None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:56:51.480820 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc10e6a-a475-4097-a1b0-803787fc5784 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:56:51.480820 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc10e6a-a475-4097-a1b0-803787fc5784 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:56:51.530935 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-ebc10e6a-a475-4097-a1b0-803787fc5784 None None] MFA Rules not processed for user `6c2c08b27a0f4943b5da908eb7b1cd96`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:56:51.532130 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-ebc10e6a-a475-4097-a1b0-803787fc5784 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:56:51.717989 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1389/2767] 10.222.0.26 () {58 vars in 1009 bytes} [Wed Aug 24 05:56:51 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:56:51.766678 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc24e244-31b0-4f5b-8f4a-feb2301ba7e2 service nova] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:56:51.768183 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-dc24e244-31b0-4f5b-8f4a-feb2301ba7e2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:56:51.862150 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc24e244-31b0-4f5b-8f4a-feb2301ba7e2 service nova] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:56:51.867248 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64262dd-7c0e-41e3-8022-057614a6753f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87ff96222a7c4baea31fc1bebf4d89a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:56:51.867846 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64262dd-7c0e-41e3-8022-057614a6753f service swift] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:56:51.868122 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64262dd-7c0e-41e3-8022-057614a6753f service swift] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:56:51.868391 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64262dd-7c0e-41e3-8022-057614a6753f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:56:51.876485 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64262dd-7c0e-41e3-8022-057614a6753f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:56:51.878082 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64262dd-7c0e-41e3-8022-057614a6753f service swift] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:56:51.885937 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1379/2768] 10.222.0.26 () {60 vars in 1384 bytes} [Wed Aug 24 05:56:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 05:56:52.381055 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f282d5c-0fcf-4280-b6a4-a46ecdacf779 None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:56:52.381380 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f282d5c-0fcf-4280-b6a4-a46ecdacf779 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:56:52.381647 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f282d5c-0fcf-4280-b6a4-a46ecdacf779 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:56:52.399838 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-5f282d5c-0fcf-4280-b6a4-a46ecdacf779 None None] MFA Rules not processed for user `6c2c08b27a0f4943b5da908eb7b1cd96`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:56:52.401015 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-5f282d5c-0fcf-4280-b6a4-a46ecdacf779 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:56:52.408005 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1390/2769] 10.222.0.26 () {58 vars in 967 bytes} [Wed Aug 24 05:56:52 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:56:52.419858 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64262dd-7c0e-41e3-8022-057614a6753f service swift] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:56:52.431169 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64262dd-7c0e-41e3-8022-057614a6753f service swift] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:56:52.436160 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c4c576-820b-4c49-984e-b555be274fc7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87ff96222a7c4baea31fc1bebf4d89a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:56:52.436753 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c4c576-820b-4c49-984e-b555be274fc7 service swift] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:56:52.437030 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c4c576-820b-4c49-984e-b555be274fc7 service swift] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:56:52.437329 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c4c576-820b-4c49-984e-b555be274fc7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:56:52.446460 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c4c576-820b-4c49-984e-b555be274fc7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:56:52.448033 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c4c576-820b-4c49-984e-b555be274fc7 service swift] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:56:52.456170 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1380/2770] 10.222.0.26 () {60 vars in 1384 bytes} [Wed Aug 24 05:56:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 05:56:52.669100 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514a60fd-673f-47d3-8a00-cb7b021285a6 None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:56:52.669563 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514a60fd-673f-47d3-8a00-cb7b021285a6 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:56:52.669660 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514a60fd-673f-47d3-8a00-cb7b021285a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:56:52.688498 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-514a60fd-673f-47d3-8a00-cb7b021285a6 None None] MFA Rules not processed for user `6c2c08b27a0f4943b5da908eb7b1cd96`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:56:52.689704 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-514a60fd-673f-47d3-8a00-cb7b021285a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:56:52.697030 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1391/2771] 10.222.0.26 () {58 vars in 1009 bytes} [Wed Aug 24 05:56:52 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 05:56:52.708862 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c4c576-820b-4c49-984e-b555be274fc7 service swift] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:56:52.719351 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c4c576-820b-4c49-984e-b555be274fc7 service swift] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:56:52.725030 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3baaac-5b7f-410f-828f-4dfc7f3bca3c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87ff96222a7c4baea31fc1bebf4d89a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:56:52.725628 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3baaac-5b7f-410f-828f-4dfc7f3bca3c service swift] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:56:52.725904 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3baaac-5b7f-410f-828f-4dfc7f3bca3c service swift] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:56:52.726204 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3baaac-5b7f-410f-828f-4dfc7f3bca3c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:56:52.734141 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3baaac-5b7f-410f-828f-4dfc7f3bca3c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:56:52.735684 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3baaac-5b7f-410f-828f-4dfc7f3bca3c service swift] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:56:52.744250 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1381/2772] 10.222.0.26 () {60 vars in 1384 bytes} [Wed Aug 24 05:56:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 05:56:53.056877 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8418bf-5295-4991-b4a2-8941af980e29 None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:56:53.057154 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8418bf-5295-4991-b4a2-8941af980e29 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:56:53.057421 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8418bf-5295-4991-b4a2-8941af980e29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:56:53.076831 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-0c8418bf-5295-4991-b4a2-8941af980e29 None None] MFA Rules not processed for user `6c2c08b27a0f4943b5da908eb7b1cd96`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:56:53.078046 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-0c8418bf-5295-4991-b4a2-8941af980e29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:56:53.085459 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1392/2773] 10.222.0.26 () {58 vars in 967 bytes} [Wed Aug 24 05:56:53 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:56:53.097928 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3baaac-5b7f-410f-828f-4dfc7f3bca3c service swift] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:56:53.108472 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3baaac-5b7f-410f-828f-4dfc7f3bca3c service swift] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:56:53.113700 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c61753-8bbc-444f-918c-5ab326b854ab service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87ff96222a7c4baea31fc1bebf4d89a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:56:53.114324 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c61753-8bbc-444f-918c-5ab326b854ab service swift] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:56:53.114606 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c61753-8bbc-444f-918c-5ab326b854ab service swift] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:56:53.114877 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c61753-8bbc-444f-918c-5ab326b854ab service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:56:53.122957 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c61753-8bbc-444f-918c-5ab326b854ab service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:56:53.124513 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c61753-8bbc-444f-918c-5ab326b854ab service swift] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:56:53.132577 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1382/2774] 10.222.0.26 () {60 vars in 1384 bytes} [Wed Aug 24 05:56:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 05:56:55.186240 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8418bf-5295-4991-b4a2-8941af980e29 None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:56:55.253111 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8418bf-5295-4991-b4a2-8941af980e29 None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:56:55.257707 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c93ad60-7389-4ede-897c-28ddbe0e261e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:56:55.258430 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c93ad60-7389-4ede-897c-28ddbe0e261e admin admin] REQUEST_METHOD: `DELETE` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:56:55.258618 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c93ad60-7389-4ede-897c-28ddbe0e261e admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:56:55.258894 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c93ad60-7389-4ede-897c-28ddbe0e261e admin admin] PATH_INFO: `/v3/users/168e2f1c26af43a3b8469203eaecc983` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:56:55.260010 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c93ad60-7389-4ede-897c-28ddbe0e261e admin admin] RBAC: Authorizing `identity:delete_user(user_id=168e2f1c26af43a3b8469203eaecc983)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:56:55.261907 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c93ad60-7389-4ede-897c-28ddbe0e261e admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:56:55.307912 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-6c93ad60-7389-4ede-897c-28ddbe0e261e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '168e2f1c26af43a3b8469203eaecc983'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:56:55.312989 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:56:55.315192 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-6c93ad60-7389-4ede-897c-28ddbe0e261e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '168e2f1c26af43a3b8469203eaecc983'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:56:55.316391 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-6c93ad60-7389-4ede-897c-28ddbe0e261e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '168e2f1c26af43a3b8469203eaecc983'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:56:55.329044 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-6c93ad60-7389-4ede-897c-28ddbe0e261e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '168e2f1c26af43a3b8469203eaecc983'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:56:55.337726 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-6c93ad60-7389-4ede-897c-28ddbe0e261e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '168e2f1c26af43a3b8469203eaecc983'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:56:55.343788 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1393/2775] 10.222.0.26 () {58 vars in 1224 bytes} [Wed Aug 24 05:56:55 2022] DELETE /identity/v3/users/168e2f1c26af43a3b8469203eaecc983 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:56:55.349226 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9061ffb-cb94-4a65-8455-0b12bacde5bc None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:56:55.349757 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9061ffb-cb94-4a65-8455-0b12bacde5bc None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:56:55.349757 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9061ffb-cb94-4a65-8455-0b12bacde5bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:56:55.367915 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-f9061ffb-cb94-4a65-8455-0b12bacde5bc None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:56:55.369065 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-f9061ffb-cb94-4a65-8455-0b12bacde5bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:56:55.424784 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1383/2776] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:56:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:56:55.434409 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c93ad60-7389-4ede-897c-28ddbe0e261e admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:56:55.435797 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-6c93ad60-7389-4ede-897c-28ddbe0e261e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:56:55.491734 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c93ad60-7389-4ede-897c-28ddbe0e261e admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:56:55.495406 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e2ee94-199e-482a-984c-ab52b069c914 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '874348b647194ac2b5ecbf12c33bf59e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:56:55.496006 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e2ee94-199e-482a-984c-ab52b069c914 service neutron] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:56:55.496282 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e2ee94-199e-482a-984c-ab52b069c914 service neutron] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:56:55.496548 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e2ee94-199e-482a-984c-ab52b069c914 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:56:55.505725 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e2ee94-199e-482a-984c-ab52b069c914 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:56:55.507178 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e2ee94-199e-482a-984c-ab52b069c914 service neutron] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:56:55.516311 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1394/2777] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 24 05:56:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:56:55.698065 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9061ffb-cb94-4a65-8455-0b12bacde5bc None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:56:55.699485 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-f9061ffb-cb94-4a65-8455-0b12bacde5bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:56:55.712395 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9061ffb-cb94-4a65-8455-0b12bacde5bc None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:56:55.717422 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c2bc97-c7fe-41a1-80eb-eb5fecdd0e09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:56:55.718101 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c2bc97-c7fe-41a1-80eb-eb5fecdd0e09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:56:55.718385 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c2bc97-c7fe-41a1-80eb-eb5fecdd0e09 admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:56:55.718657 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c2bc97-c7fe-41a1-80eb-eb5fecdd0e09 admin admin] PATH_INFO: `/v3/projects/e57a390c91c54539a2a0cdbe689a8bb6` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:56:55.719816 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c2bc97-c7fe-41a1-80eb-eb5fecdd0e09 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e57a390c91c54539a2a0cdbe689a8bb6)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:56:55.721742 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c2bc97-c7fe-41a1-80eb-eb5fecdd0e09 admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:56:55.757024 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:56:55.775798 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-f8c2bc97-c7fe-41a1-80eb-eb5fecdd0e09 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e57a390c91c54539a2a0cdbe689a8bb6', 'request_id': 'req-f8c2bc97-c7fe-41a1-80eb-eb5fecdd0e09'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:56:55.783543 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-f8c2bc97-c7fe-41a1-80eb-eb5fecdd0e09 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e57a390c91c54539a2a0cdbe689a8bb6', 'request_id': 'req-f8c2bc97-c7fe-41a1-80eb-eb5fecdd0e09'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:56:55.790550 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-f8c2bc97-c7fe-41a1-80eb-eb5fecdd0e09 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e57a390c91c54539a2a0cdbe689a8bb6', 'request_id': 'req-f8c2bc97-c7fe-41a1-80eb-eb5fecdd0e09'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:56:55.801306 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-f8c2bc97-c7fe-41a1-80eb-eb5fecdd0e09 admin admin] The token cache is being invalidate because project e57a390c91c54539a2a0cdbe689a8bb6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88112) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:56:55.801593 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-f8c2bc97-c7fe-41a1-80eb-eb5fecdd0e09 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:56:55.802258 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-f8c2bc97-c7fe-41a1-80eb-eb5fecdd0e09 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:56:55.803864 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1384/2778] 10.222.0.26 () {58 vars in 1233 bytes} [Wed Aug 24 05:56:55 2022] DELETE /identity/v3/projects/e57a390c91c54539a2a0cdbe689a8bb6 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:57:05.512238 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=35,keystone:DELETE=3,keystone:INSERT=1 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:57:05.798239 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:DELETE=6,keystone:SELECT=14,keystone:INSERT=1 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:57:38.678532 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f0de98-07cd-42e8-b14c-800d543edb72 None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:57:38.679082 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f0de98-07cd-42e8-b14c-800d543edb72 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:57:38.679082 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f0de98-07cd-42e8-b14c-800d543edb72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:57:38.698258 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-94f0de98-07cd-42e8-b14c-800d543edb72 None None] MFA Rules not processed for user `810acc57487f4db2b8b1d3d40f4d28d5`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:57:38.699443 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-94f0de98-07cd-42e8-b14c-800d543edb72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:57:38.751553 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1395/2779] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:57:38 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:57:39.045553 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c2bc97-c7fe-41a1-80eb-eb5fecdd0e09 admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:57:39.046987 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-f8c2bc97-c7fe-41a1-80eb-eb5fecdd0e09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:57:39.104402 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c2bc97-c7fe-41a1-80eb-eb5fecdd0e09 admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:57:39.107846 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454e9a1f-56f4-479d-aedf-67979abf3e42 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '874348b647194ac2b5ecbf12c33bf59e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:57:39.108445 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454e9a1f-56f4-479d-aedf-67979abf3e42 service neutron] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:57:39.108723 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454e9a1f-56f4-479d-aedf-67979abf3e42 service neutron] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:57:39.108991 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454e9a1f-56f4-479d-aedf-67979abf3e42 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:57:39.110724 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-454e9a1f-56f4-479d-aedf-67979abf3e42 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:57:39.120558 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454e9a1f-56f4-479d-aedf-67979abf3e42 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:57:39.122002 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454e9a1f-56f4-479d-aedf-67979abf3e42 service neutron] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:57:39.130498 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1385/2780] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 24 05:57:39 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:57:48.745020 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=25 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:57:49.126368 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=26 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:59:04.513912 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f0de98-07cd-42e8-b14c-800d543edb72 None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:59:04.515584 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-94f0de98-07cd-42e8-b14c-800d543edb72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:59:04.587194 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f0de98-07cd-42e8-b14c-800d543edb72 None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:59:04.592486 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4aaae3-dbb4-4f30-8010-53a139152e07 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b633e1aec6c4269bce13aa9c89e911a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:59:04.593086 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4aaae3-dbb4-4f30-8010-53a139152e07 service nova] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:59:04.593362 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4aaae3-dbb4-4f30-8010-53a139152e07 service nova] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:59:04.593631 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4aaae3-dbb4-4f30-8010-53a139152e07 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:59:04.595336 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-4b4aaae3-dbb4-4f30-8010-53a139152e07 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:59:04.605832 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4aaae3-dbb4-4f30-8010-53a139152e07 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:59:04.607412 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4aaae3-dbb4-4f30-8010-53a139152e07 service nova] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:59:04.616083 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1396/2781] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 24 05:59:04 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:59:12.155535 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454e9a1f-56f4-479d-aedf-67979abf3e42 service neutron] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:59:12.157055 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-454e9a1f-56f4-479d-aedf-67979abf3e42 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:59:12.235876 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454e9a1f-56f4-479d-aedf-67979abf3e42 service neutron] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:59:12.241209 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ab8e56-d07c-4321-bd19-3ec6147d9892 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '995ebe690b7748c9842bc0696415fc52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:59:12.241827 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ab8e56-d07c-4321-bd19-3ec6147d9892 service placement] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:59:12.242154 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ab8e56-d07c-4321-bd19-3ec6147d9892 service placement] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:59:12.242534 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ab8e56-d07c-4321-bd19-3ec6147d9892 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:59:12.244599 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-a3ab8e56-d07c-4321-bd19-3ec6147d9892 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:59:12.257027 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ab8e56-d07c-4321-bd19-3ec6147d9892 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:59:12.258666 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ab8e56-d07c-4321-bd19-3ec6147d9892 service placement] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:59:12.268772 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1386/2782] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 24 05:59:12 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:59:14.612093 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=34 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:59:18.575371 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4aaae3-dbb4-4f30-8010-53a139152e07 service nova] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:59:18.585308 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4aaae3-dbb4-4f30-8010-53a139152e07 service nova] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:59:18.588943 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d067d9a5-beb8-4306-8c94-b6adda3b2f23 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '874348b647194ac2b5ecbf12c33bf59e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:59:18.589532 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d067d9a5-beb8-4306-8c94-b6adda3b2f23 service neutron] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:59:18.589813 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d067d9a5-beb8-4306-8c94-b6adda3b2f23 service neutron] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:59:18.590121 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d067d9a5-beb8-4306-8c94-b6adda3b2f23 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:59:18.591918 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-d067d9a5-beb8-4306-8c94-b6adda3b2f23 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:59:18.601874 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d067d9a5-beb8-4306-8c94-b6adda3b2f23 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:59:18.603317 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d067d9a5-beb8-4306-8c94-b6adda3b2f23 service neutron] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:59:18.612076 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1397/2783] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 24 05:59:18 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:59:19.224962 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ab8e56-d07c-4321-bd19-3ec6147d9892 service placement] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:59:19.238513 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ab8e56-d07c-4321-bd19-3ec6147d9892 service placement] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:59:19.243987 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7267f387-2ed1-4c21-bffc-2e44caf50a16 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b633e1aec6c4269bce13aa9c89e911a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:59:19.244708 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7267f387-2ed1-4c21-bffc-2e44caf50a16 service nova] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:59:19.244995 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7267f387-2ed1-4c21-bffc-2e44caf50a16 service nova] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:59:19.245269 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7267f387-2ed1-4c21-bffc-2e44caf50a16 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:59:19.247026 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-7267f387-2ed1-4c21-bffc-2e44caf50a16 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:59:19.259243 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7267f387-2ed1-4c21-bffc-2e44caf50a16 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:59:19.260819 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7267f387-2ed1-4c21-bffc-2e44caf50a16 service nova] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:59:19.271552 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1387/2784] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 24 05:59:19 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:59:19.690918 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d067d9a5-beb8-4306-8c94-b6adda3b2f23 service neutron] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:59:19.699922 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d067d9a5-beb8-4306-8c94-b6adda3b2f23 service neutron] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:59:19.704087 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e8d2d7-5a57-4193-b65c-00e440d51715 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '874348b647194ac2b5ecbf12c33bf59e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:59:19.704679 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e8d2d7-5a57-4193-b65c-00e440d51715 service neutron] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:59:19.704957 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e8d2d7-5a57-4193-b65c-00e440d51715 service neutron] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:59:19.705228 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e8d2d7-5a57-4193-b65c-00e440d51715 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:59:19.707032 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-81e8d2d7-5a57-4193-b65c-00e440d51715 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:59:19.721740 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e8d2d7-5a57-4193-b65c-00e440d51715 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:59:19.723198 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e8d2d7-5a57-4193-b65c-00e440d51715 service neutron] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:59:19.734548 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1398/2785] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 24 05:59:19 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:59:26.744084 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7267f387-2ed1-4c21-bffc-2e44caf50a16 service nova] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:59:26.745536 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-7267f387-2ed1-4c21-bffc-2e44caf50a16 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:59:26.757705 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7267f387-2ed1-4c21-bffc-2e44caf50a16 service nova] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:59:26.761962 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc08ad7d-442f-4909-a330-ff0c41254bbb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '874348b647194ac2b5ecbf12c33bf59e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:59:26.762642 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc08ad7d-442f-4909-a330-ff0c41254bbb service neutron] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:59:26.763040 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc08ad7d-442f-4909-a330-ff0c41254bbb service neutron] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:59:26.763320 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc08ad7d-442f-4909-a330-ff0c41254bbb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:59:26.766029 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-bc08ad7d-442f-4909-a330-ff0c41254bbb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:59:26.838504 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc08ad7d-442f-4909-a330-ff0c41254bbb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:59:26.839841 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc08ad7d-442f-4909-a330-ff0c41254bbb service neutron] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:59:26.849928 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1388/2786] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 24 05:59:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:59:29.729350 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=12 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:59:30.152767 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e8d2d7-5a57-4193-b65c-00e440d51715 service neutron] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:59:30.154211 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-81e8d2d7-5a57-4193-b65c-00e440d51715 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:59:30.168037 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e8d2d7-5a57-4193-b65c-00e440d51715 service neutron] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:59:30.173460 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1201d7-e016-4bba-8d92-72e1f574797b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '995ebe690b7748c9842bc0696415fc52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:59:30.174690 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1201d7-e016-4bba-8d92-72e1f574797b service placement] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:59:30.174974 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1201d7-e016-4bba-8d92-72e1f574797b service placement] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:59:30.175248 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1201d7-e016-4bba-8d92-72e1f574797b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:59:30.176958 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-bf1201d7-e016-4bba-8d92-72e1f574797b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:59:30.190064 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1201d7-e016-4bba-8d92-72e1f574797b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:59:30.191643 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1201d7-e016-4bba-8d92-72e1f574797b service placement] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:59:30.203146 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1399/2787] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 24 05:59:30 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:59:30.217299 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc08ad7d-442f-4909-a330-ff0c41254bbb service neutron] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:59:30.218820 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-bc08ad7d-442f-4909-a330-ff0c41254bbb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:59:30.236614 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc08ad7d-442f-4909-a330-ff0c41254bbb service neutron] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:59:30.242586 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7107a4e1-6ab0-4e14-bc62-c5db0dfbdc57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:59:30.243043 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7107a4e1-6ab0-4e14-bc62-c5db0dfbdc57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:59:30.243325 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7107a4e1-6ab0-4e14-bc62-c5db0dfbdc57 admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:59:30.243602 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7107a4e1-6ab0-4e14-bc62-c5db0dfbdc57 admin admin] PATH_INFO: `/v3/users/810acc57487f4db2b8b1d3d40f4d28d5` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:59:30.244757 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7107a4e1-6ab0-4e14-bc62-c5db0dfbdc57 admin admin] RBAC: Authorizing `identity:delete_user(user_id=810acc57487f4db2b8b1d3d40f4d28d5)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:59:30.246717 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7107a4e1-6ab0-4e14-bc62-c5db0dfbdc57 admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:59:30.292452 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-7107a4e1-6ab0-4e14-bc62-c5db0dfbdc57 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '810acc57487f4db2b8b1d3d40f4d28d5'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:59:30.299981 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-7107a4e1-6ab0-4e14-bc62-c5db0dfbdc57 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '810acc57487f4db2b8b1d3d40f4d28d5'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:59:30.306924 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:59:30.312961 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-7107a4e1-6ab0-4e14-bc62-c5db0dfbdc57 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '810acc57487f4db2b8b1d3d40f4d28d5'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:59:30.320618 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-7107a4e1-6ab0-4e14-bc62-c5db0dfbdc57 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '810acc57487f4db2b8b1d3d40f4d28d5'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:59:30.321315 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-7107a4e1-6ab0-4e14-bc62-c5db0dfbdc57 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '810acc57487f4db2b8b1d3d40f4d28d5'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:59:30.327111 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1389/2788] 10.222.0.26 () {58 vars in 1224 bytes} [Wed Aug 24 05:59:30 2022] DELETE /identity/v3/users/810acc57487f4db2b8b1d3d40f4d28d5 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:59:30.491575 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1201d7-e016-4bba-8d92-72e1f574797b service placement] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:59:30.504857 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1201d7-e016-4bba-8d92-72e1f574797b service placement] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:59:30.565931 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c87675-aa54-44a3-b63a-b38be98b1ddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:59:30.566589 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c87675-aa54-44a3-b63a-b38be98b1ddd admin admin] REQUEST_METHOD: `DELETE` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:59:30.566874 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c87675-aa54-44a3-b63a-b38be98b1ddd admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:59:30.567148 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c87675-aa54-44a3-b63a-b38be98b1ddd admin admin] PATH_INFO: `/v3/projects/20a001c4775b42c2b4d8ec5598f942b2` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:59:30.568264 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c87675-aa54-44a3-b63a-b38be98b1ddd admin admin] RBAC: Authorizing `identity:delete_project(project_id=20a001c4775b42c2b4d8ec5598f942b2)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:59:30.570471 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c87675-aa54-44a3-b63a-b38be98b1ddd admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:59:30.616510 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-92c87675-aa54-44a3-b63a-b38be98b1ddd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '20a001c4775b42c2b4d8ec5598f942b2', 'request_id': 'req-92c87675-aa54-44a3-b63a-b38be98b1ddd'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:59:30.623079 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-92c87675-aa54-44a3-b63a-b38be98b1ddd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '20a001c4775b42c2b4d8ec5598f942b2', 'request_id': 'req-92c87675-aa54-44a3-b63a-b38be98b1ddd'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:59:30.629161 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-92c87675-aa54-44a3-b63a-b38be98b1ddd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '20a001c4775b42c2b4d8ec5598f942b2', 'request_id': 'req-92c87675-aa54-44a3-b63a-b38be98b1ddd'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:59:30.639062 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-92c87675-aa54-44a3-b63a-b38be98b1ddd admin admin] The token cache is being invalidate because project 20a001c4775b42c2b4d8ec5598f942b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:59:30.639344 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-92c87675-aa54-44a3-b63a-b38be98b1ddd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:59:30.639980 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-92c87675-aa54-44a3-b63a-b38be98b1ddd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:59:30.641923 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1400/2789] 10.222.0.26 () {58 vars in 1233 bytes} [Wed Aug 24 05:59:30 2022] DELETE /identity/v3/projects/20a001c4775b42c2b4d8ec5598f942b2 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:59:30.646864 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e4d724-6fcb-4dc7-aa93-9620c0871276 None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:59:30.647147 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e4d724-6fcb-4dc7-aa93-9620c0871276 None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:59:30.647415 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e4d724-6fcb-4dc7-aa93-9620c0871276 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:59:30.666662 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-08e4d724-6fcb-4dc7-aa93-9620c0871276 None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:59:30.667846 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-08e4d724-6fcb-4dc7-aa93-9620c0871276 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:59:30.726168 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1390/2790] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:59:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:59:30.735043 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729dc93d-a5a4-495a-b879-fe25a15e3d92 None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:59:30.735537 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729dc93d-a5a4-495a-b879-fe25a15e3d92 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:59:30.735661 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729dc93d-a5a4-495a-b879-fe25a15e3d92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:59:30.754556 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-729dc93d-a5a4-495a-b879-fe25a15e3d92 None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:59:30.755750 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-729dc93d-a5a4-495a-b879-fe25a15e3d92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:59:30.763750 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1401/2791] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:59:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:59:30.768639 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e4d724-6fcb-4dc7-aa93-9620c0871276 None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:59:30.778407 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e4d724-6fcb-4dc7-aa93-9620c0871276 None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:59:30.783536 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9eb70d2-6a8f-48ef-94df-d8bca2c6328b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:59:30.784125 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9eb70d2-6a8f-48ef-94df-d8bca2c6328b admin admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:59:30.784420 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9eb70d2-6a8f-48ef-94df-d8bca2c6328b admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:59:30.784668 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9eb70d2-6a8f-48ef-94df-d8bca2c6328b admin admin] PATH_INFO: `/v3/domains` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:59:30.785300 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9eb70d2-6a8f-48ef-94df-d8bca2c6328b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:59:30.785598 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9eb70d2-6a8f-48ef-94df-d8bca2c6328b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:59:30.787274 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9eb70d2-6a8f-48ef-94df-d8bca2c6328b admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:59:30.798578 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1391/2792] 10.222.0.26 () {58 vars in 1153 bytes} [Wed Aug 24 05:59:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:59:30.802642 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729dc93d-a5a4-495a-b879-fe25a15e3d92 None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:59:30.811967 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729dc93d-a5a4-495a-b879-fe25a15e3d92 None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:59:30.816623 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671650b2-4309-4b9f-a6e1-2cc710c83e99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:59:30.817207 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671650b2-4309-4b9f-a6e1-2cc710c83e99 admin admin] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:59:30.817488 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671650b2-4309-4b9f-a6e1-2cc710c83e99 admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:59:30.817760 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671650b2-4309-4b9f-a6e1-2cc710c83e99 admin admin] PATH_INFO: `/v3/projects` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:59:30.818705 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671650b2-4309-4b9f-a6e1-2cc710c83e99 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:59:30.820601 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671650b2-4309-4b9f-a6e1-2cc710c83e99 admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:59:30.848445 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1402/2793] 10.222.0.26 () {60 vars in 1153 bytes} [Wed Aug 24 05:59:30 2022] POST /identity/v3/projects => generated 383 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:59:30.852801 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9eb70d2-6a8f-48ef-94df-d8bca2c6328b admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:59:30.862675 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9eb70d2-6a8f-48ef-94df-d8bca2c6328b admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:59:30.924005 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e41a11-ef61-481a-aba2-d21d7216ca7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:59:30.924614 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e41a11-ef61-481a-aba2-d21d7216ca7c admin admin] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:59:30.924894 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e41a11-ef61-481a-aba2-d21d7216ca7c admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:59:30.925525 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e41a11-ef61-481a-aba2-d21d7216ca7c admin admin] PATH_INFO: `/v3/users` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:59:30.925891 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e41a11-ef61-481a-aba2-d21d7216ca7c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:59:30.927701 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e41a11-ef61-481a-aba2-d21d7216ca7c admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:59:30.950560 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1392/2794] 10.222.0.26 () {60 vars in 1144 bytes} [Wed Aug 24 05:59:30 2022] POST /identity/v3/users => generated 292 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:59:30.955459 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671650b2-4309-4b9f-a6e1-2cc710c83e99 admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:59:30.965723 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671650b2-4309-4b9f-a6e1-2cc710c83e99 admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:59:30.970455 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559b990d-3dbf-4803-8b4e-d7b75ecbf099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:59:30.971146 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559b990d-3dbf-4803-8b4e-d7b75ecbf099 admin admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:59:30.971493 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559b990d-3dbf-4803-8b4e-d7b75ecbf099 admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:59:30.971833 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559b990d-3dbf-4803-8b4e-d7b75ecbf099 admin admin] PATH_INFO: `/v3/roles` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:59:30.972550 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559b990d-3dbf-4803-8b4e-d7b75ecbf099 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:59:30.974219 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559b990d-3dbf-4803-8b4e-d7b75ecbf099 admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:59:30.984609 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1403/2795] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Aug 24 05:59:30 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 05:59:30.988972 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e41a11-ef61-481a-aba2-d21d7216ca7c admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:59:30.999774 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e41a11-ef61-481a-aba2-d21d7216ca7c admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:59:31.005546 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778fcb8f-2b94-4220-8786-f06ac74ddb09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:59:31.006259 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778fcb8f-2b94-4220-8786-f06ac74ddb09 admin admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:59:31.006546 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778fcb8f-2b94-4220-8786-f06ac74ddb09 admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:59:31.006820 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778fcb8f-2b94-4220-8786-f06ac74ddb09 admin admin] PATH_INFO: `/v3/roles` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:59:31.007484 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778fcb8f-2b94-4220-8786-f06ac74ddb09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:59:31.009066 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778fcb8f-2b94-4220-8786-f06ac74ddb09 admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:59:31.021775 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1393/2796] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Aug 24 05:59:30 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:59:31.026139 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559b990d-3dbf-4803-8b4e-d7b75ecbf099 admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:59:31.036834 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559b990d-3dbf-4803-8b4e-d7b75ecbf099 admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:59:31.041641 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5027262-9741-4658-9998-c9dbc757ed6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:59:31.042321 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5027262-9741-4658-9998-c9dbc757ed6f admin admin] REQUEST_METHOD: `PUT` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:59:31.042599 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5027262-9741-4658-9998-c9dbc757ed6f admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:59:31.042874 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5027262-9741-4658-9998-c9dbc757ed6f admin admin] PATH_INFO: `/v3/projects/d875e9ac1ecd427fb2fa3d87c618497a/users/633f4e91487248d584a3621afff47197/roles/f7aa4a2c74c94c1b9ca8ecdcccccda5c` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:59:31.057807 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5027262-9741-4658-9998-c9dbc757ed6f admin admin] RBAC: Authorizing `identity:create_grant(project_id=d875e9ac1ecd427fb2fa3d87c618497a, user_id=633f4e91487248d584a3621afff47197, role_id=f7aa4a2c74c94c1b9ca8ecdcccccda5c)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:59:31.060460 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5027262-9741-4658-9998-c9dbc757ed6f admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:59:31.075472 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1404/2797] 10.222.0.26 () {60 vars in 1483 bytes} [Wed Aug 24 05:59:31 2022] PUT /identity/v3/projects/d875e9ac1ecd427fb2fa3d87c618497a/users/633f4e91487248d584a3621afff47197/roles/f7aa4a2c74c94c1b9ca8ecdcccccda5c => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 05:59:31.086762 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c583dfe6-6d98-4f18-a718-6931c4a6a2d2 None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:59:31.087193 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c583dfe6-6d98-4f18-a718-6931c4a6a2d2 None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:59:31.087450 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c583dfe6-6d98-4f18-a718-6931c4a6a2d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:59:31.116805 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-c583dfe6-6d98-4f18-a718-6931c4a6a2d2 None None] MFA Rules not processed for user `633f4e91487248d584a3621afff47197`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:59:31.118063 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-c583dfe6-6d98-4f18-a718-6931c4a6a2d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:59:31.155108 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:59:31.182271 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1394/2798] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:59:31 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:59:31.194577 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5027262-9741-4658-9998-c9dbc757ed6f admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:59:31.196613 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-c5027262-9741-4658-9998-c9dbc757ed6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:59:31.211809 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:59:31.277037 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5027262-9741-4658-9998-c9dbc757ed6f admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:59:31.283529 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5df4a6-acec-4faf-ae36-88d568cbc4a7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b633e1aec6c4269bce13aa9c89e911a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:59:31.284136 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5df4a6-acec-4faf-ae36-88d568cbc4a7 service nova] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:59:31.284414 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5df4a6-acec-4faf-ae36-88d568cbc4a7 service nova] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:59:31.284689 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5df4a6-acec-4faf-ae36-88d568cbc4a7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:59:31.292286 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5df4a6-acec-4faf-ae36-88d568cbc4a7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:59:31.293867 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5df4a6-acec-4faf-ae36-88d568cbc4a7 service nova] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:59:31.303019 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1405/2799] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 24 05:59:31 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:59:36.612247 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c583dfe6-6d98-4f18-a718-6931c4a6a2d2 None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:59:36.671533 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c583dfe6-6d98-4f18-a718-6931c4a6a2d2 None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:59:36.676606 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78867115-d843-4ade-9b36-116c9ab23c9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:59:36.677236 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78867115-d843-4ade-9b36-116c9ab23c9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:59:36.677514 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78867115-d843-4ade-9b36-116c9ab23c9a admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:59:36.677788 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78867115-d843-4ade-9b36-116c9ab23c9a admin admin] PATH_INFO: `/v3/users/633f4e91487248d584a3621afff47197` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:59:36.678935 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78867115-d843-4ade-9b36-116c9ab23c9a admin admin] RBAC: Authorizing `identity:delete_user(user_id=633f4e91487248d584a3621afff47197)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:59:36.680831 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78867115-d843-4ade-9b36-116c9ab23c9a admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:59:36.725921 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-78867115-d843-4ade-9b36-116c9ab23c9a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '633f4e91487248d584a3621afff47197'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:59:36.732703 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-78867115-d843-4ade-9b36-116c9ab23c9a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '633f4e91487248d584a3621afff47197'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:59:36.745071 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-78867115-d843-4ade-9b36-116c9ab23c9a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '633f4e91487248d584a3621afff47197'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:59:36.751325 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-78867115-d843-4ade-9b36-116c9ab23c9a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '633f4e91487248d584a3621afff47197'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:59:36.751960 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-78867115-d843-4ade-9b36-116c9ab23c9a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '633f4e91487248d584a3621afff47197'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:59:36.758277 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1395/2800] 10.222.0.26 () {58 vars in 1224 bytes} [Wed Aug 24 05:59:36 2022] DELETE /identity/v3/users/633f4e91487248d584a3621afff47197 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:59:36.762918 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f0304d-3682-4890-b887-a193e448df46 None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:59:36.763417 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f0304d-3682-4890-b887-a193e448df46 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:59:36.763516 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f0304d-3682-4890-b887-a193e448df46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:59:36.781760 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-f3f0304d-3682-4890-b887-a193e448df46 None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:59:36.782975 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-f3f0304d-3682-4890-b887-a193e448df46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:59:36.840217 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1406/2801] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:59:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 05:59:36.849803 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78867115-d843-4ade-9b36-116c9ab23c9a admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:59:36.851223 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-78867115-d843-4ade-9b36-116c9ab23c9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:59:36.908767 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78867115-d843-4ade-9b36-116c9ab23c9a admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:59:36.912453 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095efb74-31b5-497a-8c2c-6acd62d22924 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '874348b647194ac2b5ecbf12c33bf59e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:59:36.913055 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095efb74-31b5-497a-8c2c-6acd62d22924 service neutron] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:59:36.913334 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095efb74-31b5-497a-8c2c-6acd62d22924 service neutron] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:59:36.913610 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095efb74-31b5-497a-8c2c-6acd62d22924 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:59:36.922507 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095efb74-31b5-497a-8c2c-6acd62d22924 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:59:36.924646 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095efb74-31b5-497a-8c2c-6acd62d22924 service neutron] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:59:36.929743 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:59:36.934850 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1396/2802] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 24 05:59:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:59:37.192508 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f0304d-3682-4890-b887-a193e448df46 None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:59:37.194250 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-f3f0304d-3682-4890-b887-a193e448df46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:59:37.206110 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f0304d-3682-4890-b887-a193e448df46 None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:59:37.210691 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad70d19-c7ef-431f-a135-b6579eda2b18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:59:37.211315 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad70d19-c7ef-431f-a135-b6579eda2b18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:59:37.211595 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad70d19-c7ef-431f-a135-b6579eda2b18 admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:59:37.211862 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad70d19-c7ef-431f-a135-b6579eda2b18 admin admin] PATH_INFO: `/v3/projects/d875e9ac1ecd427fb2fa3d87c618497a` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:59:37.212995 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad70d19-c7ef-431f-a135-b6579eda2b18 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d875e9ac1ecd427fb2fa3d87c618497a)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:59:37.214972 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad70d19-c7ef-431f-a135-b6579eda2b18 admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:59:37.262544 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-bad70d19-c7ef-431f-a135-b6579eda2b18 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd875e9ac1ecd427fb2fa3d87c618497a', 'request_id': 'req-bad70d19-c7ef-431f-a135-b6579eda2b18'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:59:37.270134 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-bad70d19-c7ef-431f-a135-b6579eda2b18 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd875e9ac1ecd427fb2fa3d87c618497a', 'request_id': 'req-bad70d19-c7ef-431f-a135-b6579eda2b18'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:59:37.276637 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-bad70d19-c7ef-431f-a135-b6579eda2b18 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd875e9ac1ecd427fb2fa3d87c618497a', 'request_id': 'req-bad70d19-c7ef-431f-a135-b6579eda2b18'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:59:37.288723 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-bad70d19-c7ef-431f-a135-b6579eda2b18 admin admin] The token cache is being invalidate because project d875e9ac1ecd427fb2fa3d87c618497a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:59:37.288868 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-bad70d19-c7ef-431f-a135-b6579eda2b18 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:59:37.289500 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-bad70d19-c7ef-431f-a135-b6579eda2b18 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:59:37.291013 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1407/2803] 10.222.0.26 () {58 vars in 1233 bytes} [Wed Aug 24 05:59:37 2022] DELETE /identity/v3/projects/d875e9ac1ecd427fb2fa3d87c618497a => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:59:37.295950 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8441e0c5-6ecd-4c56-ac9f-947d24b128ad None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:59:37.296229 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8441e0c5-6ecd-4c56-ac9f-947d24b128ad None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:59:37.296517 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8441e0c5-6ecd-4c56-ac9f-947d24b128ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:59:37.315306 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-8441e0c5-6ecd-4c56-ac9f-947d24b128ad None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:59:37.316489 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-8441e0c5-6ecd-4c56-ac9f-947d24b128ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:59:37.373011 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1397/2804] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:59:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:59:37.380709 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998a7ce3-81e2-4e1e-8a0e-207187356187 None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:59:37.380992 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998a7ce3-81e2-4e1e-8a0e-207187356187 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:59:37.381266 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998a7ce3-81e2-4e1e-8a0e-207187356187 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:59:37.400625 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-998a7ce3-81e2-4e1e-8a0e-207187356187 None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:59:37.401809 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-998a7ce3-81e2-4e1e-8a0e-207187356187 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:59:37.410228 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1408/2805] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:59:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:59:37.414295 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8441e0c5-6ecd-4c56-ac9f-947d24b128ad None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:59:37.423733 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8441e0c5-6ecd-4c56-ac9f-947d24b128ad None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:59:37.428201 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c83783-6a03-4e4f-bdab-0713d8e3d449 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:59:37.428782 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c83783-6a03-4e4f-bdab-0713d8e3d449 admin admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:59:37.429058 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c83783-6a03-4e4f-bdab-0713d8e3d449 admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:59:37.429324 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c83783-6a03-4e4f-bdab-0713d8e3d449 admin admin] PATH_INFO: `/v3/domains` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:59:37.429977 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c83783-6a03-4e4f-bdab-0713d8e3d449 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:59:37.430282 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c83783-6a03-4e4f-bdab-0713d8e3d449 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:59:37.431851 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c83783-6a03-4e4f-bdab-0713d8e3d449 admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:59:37.443134 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1398/2806] 10.222.0.26 () {58 vars in 1153 bytes} [Wed Aug 24 05:59:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:59:37.447376 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998a7ce3-81e2-4e1e-8a0e-207187356187 None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:59:37.456920 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998a7ce3-81e2-4e1e-8a0e-207187356187 None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:59:37.461460 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894ba5a7-06b8-44da-992a-2cfbb17e8901 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:59:37.462071 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894ba5a7-06b8-44da-992a-2cfbb17e8901 admin admin] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:59:37.462353 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894ba5a7-06b8-44da-992a-2cfbb17e8901 admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:59:37.462624 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894ba5a7-06b8-44da-992a-2cfbb17e8901 admin admin] PATH_INFO: `/v3/projects` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:59:37.463233 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894ba5a7-06b8-44da-992a-2cfbb17e8901 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:59:37.465123 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894ba5a7-06b8-44da-992a-2cfbb17e8901 admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:59:37.480031 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:59:37.493154 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1409/2807] 10.222.0.26 () {60 vars in 1153 bytes} [Wed Aug 24 05:59:37 2022] POST /identity/v3/projects => generated 363 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:59:37.497273 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c83783-6a03-4e4f-bdab-0713d8e3d449 admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:59:37.507490 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c83783-6a03-4e4f-bdab-0713d8e3d449 admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:59:37.562714 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934bd35c-8dbc-454c-9652-c6c2bcc68fea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:59:37.563310 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934bd35c-8dbc-454c-9652-c6c2bcc68fea admin admin] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:59:37.563587 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934bd35c-8dbc-454c-9652-c6c2bcc68fea admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:59:37.563852 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934bd35c-8dbc-454c-9652-c6c2bcc68fea admin admin] PATH_INFO: `/v3/users` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:59:37.564460 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934bd35c-8dbc-454c-9652-c6c2bcc68fea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:59:37.566386 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934bd35c-8dbc-454c-9652-c6c2bcc68fea admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:59:37.587232 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1399/2808] 10.222.0.26 () {60 vars in 1144 bytes} [Wed Aug 24 05:59:37 2022] POST /identity/v3/users => generated 282 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:59:37.591369 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894ba5a7-06b8-44da-992a-2cfbb17e8901 admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:59:37.602232 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894ba5a7-06b8-44da-992a-2cfbb17e8901 admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:59:37.606812 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24237e1c-90fc-40d0-b2fc-ef828c28fbc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:59:37.607396 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24237e1c-90fc-40d0-b2fc-ef828c28fbc6 admin admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:59:37.607675 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24237e1c-90fc-40d0-b2fc-ef828c28fbc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:59:37.607943 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24237e1c-90fc-40d0-b2fc-ef828c28fbc6 admin admin] PATH_INFO: `/v3/roles` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:59:37.608583 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24237e1c-90fc-40d0-b2fc-ef828c28fbc6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:59:37.610196 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24237e1c-90fc-40d0-b2fc-ef828c28fbc6 admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:59:37.619774 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1410/2809] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Aug 24 05:59:37 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:59:37.623548 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934bd35c-8dbc-454c-9652-c6c2bcc68fea admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:59:37.634071 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934bd35c-8dbc-454c-9652-c6c2bcc68fea admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:59:37.638699 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0f4039-5f13-4aa4-87a0-0f0726608797 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:59:37.639284 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0f4039-5f13-4aa4-87a0-0f0726608797 admin admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:59:37.639563 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0f4039-5f13-4aa4-87a0-0f0726608797 admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:59:37.639833 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0f4039-5f13-4aa4-87a0-0f0726608797 admin admin] PATH_INFO: `/v3/roles` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:59:37.640467 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0f4039-5f13-4aa4-87a0-0f0726608797 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:59:37.642079 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0f4039-5f13-4aa4-87a0-0f0726608797 admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:59:37.652946 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1400/2810] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Aug 24 05:59:37 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:59:37.656894 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24237e1c-90fc-40d0-b2fc-ef828c28fbc6 admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:59:37.666638 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24237e1c-90fc-40d0-b2fc-ef828c28fbc6 admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:59:37.671214 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c176ad16-ff63-402f-8549-c9d163bc9f14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:59:37.671845 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c176ad16-ff63-402f-8549-c9d163bc9f14 admin admin] REQUEST_METHOD: `PUT` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:59:37.672124 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c176ad16-ff63-402f-8549-c9d163bc9f14 admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:59:37.672396 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c176ad16-ff63-402f-8549-c9d163bc9f14 admin admin] PATH_INFO: `/v3/projects/405dbfc936ed4ae19fd73f2e89f60829/users/d0931617bed649898cebb4513ee76247/roles/f7aa4a2c74c94c1b9ca8ecdcccccda5c` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:59:37.686607 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c176ad16-ff63-402f-8549-c9d163bc9f14 admin admin] RBAC: Authorizing `identity:create_grant(project_id=405dbfc936ed4ae19fd73f2e89f60829, user_id=d0931617bed649898cebb4513ee76247, role_id=f7aa4a2c74c94c1b9ca8ecdcccccda5c)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:59:37.689260 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c176ad16-ff63-402f-8549-c9d163bc9f14 admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:59:37.702496 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1411/2811] 10.222.0.26 () {60 vars in 1483 bytes} [Wed Aug 24 05:59:37 2022] PUT /identity/v3/projects/405dbfc936ed4ae19fd73f2e89f60829/users/d0931617bed649898cebb4513ee76247/roles/f7aa4a2c74c94c1b9ca8ecdcccccda5c => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:59:37.714681 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66333590-c67f-4d71-91fe-4a53970650bc None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:59:37.714960 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66333590-c67f-4d71-91fe-4a53970650bc None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:59:37.715256 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66333590-c67f-4d71-91fe-4a53970650bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:59:37.741659 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-66333590-c67f-4d71-91fe-4a53970650bc None None] MFA Rules not processed for user `d0931617bed649898cebb4513ee76247`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:59:37.742892 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-66333590-c67f-4d71-91fe-4a53970650bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:59:37.796299 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:59:37.806338 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1401/2812] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:59:37 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:59:37.810799 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c176ad16-ff63-402f-8549-c9d163bc9f14 admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:59:37.870115 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c176ad16-ff63-402f-8549-c9d163bc9f14 admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:59:37.874704 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298870d4-cf4a-4683-a79a-5e8e6d261dc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:59:37.875288 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298870d4-cf4a-4683-a79a-5e8e6d261dc3 admin admin] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:59:37.875564 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298870d4-cf4a-4683-a79a-5e8e6d261dc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:59:37.875835 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298870d4-cf4a-4683-a79a-5e8e6d261dc3 admin admin] PATH_INFO: `/v3/projects` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:59:37.876453 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298870d4-cf4a-4683-a79a-5e8e6d261dc3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:59:37.878880 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298870d4-cf4a-4683-a79a-5e8e6d261dc3 admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:59:37.904633 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1412/2813] 10.222.0.26 () {60 vars in 1153 bytes} [Wed Aug 24 05:59:37 2022] POST /identity/v3/projects => generated 365 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 05:59:37.908667 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66333590-c67f-4d71-91fe-4a53970650bc None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:59:37.919225 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66333590-c67f-4d71-91fe-4a53970650bc None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:59:37.984035 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7eae408-c9f5-475a-8bcc-9130ec4e5146 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:59:37.984684 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7eae408-c9f5-475a-8bcc-9130ec4e5146 admin admin] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:59:37.984956 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7eae408-c9f5-475a-8bcc-9130ec4e5146 admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:59:37.985228 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7eae408-c9f5-475a-8bcc-9130ec4e5146 admin admin] PATH_INFO: `/v3/users` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:59:37.985836 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7eae408-c9f5-475a-8bcc-9130ec4e5146 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:59:37.987793 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7eae408-c9f5-475a-8bcc-9130ec4e5146 admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:59:38.008695 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1402/2814] 10.222.0.26 () {60 vars in 1144 bytes} [Wed Aug 24 05:59:37 2022] POST /identity/v3/users => generated 289 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:59:38.012747 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298870d4-cf4a-4683-a79a-5e8e6d261dc3 admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:59:38.023656 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298870d4-cf4a-4683-a79a-5e8e6d261dc3 admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:59:38.028149 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9cae90-097d-4d3b-9510-5175573c2a3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:59:38.028733 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9cae90-097d-4d3b-9510-5175573c2a3a admin admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:59:38.029009 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9cae90-097d-4d3b-9510-5175573c2a3a admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:59:38.029275 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9cae90-097d-4d3b-9510-5175573c2a3a admin admin] PATH_INFO: `/v3/roles` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:59:38.029900 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9cae90-097d-4d3b-9510-5175573c2a3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:59:38.031504 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9cae90-097d-4d3b-9510-5175573c2a3a admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:59:38.042571 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1413/2815] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Aug 24 05:59:38 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:59:38.046605 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7eae408-c9f5-475a-8bcc-9130ec4e5146 admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:59:38.057861 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7eae408-c9f5-475a-8bcc-9130ec4e5146 admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:59:38.062537 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb589268-1012-44e3-8915-2bd4f6d1a726 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:59:38.063213 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb589268-1012-44e3-8915-2bd4f6d1a726 admin admin] REQUEST_METHOD: `PUT` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:59:38.063494 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb589268-1012-44e3-8915-2bd4f6d1a726 admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:59:38.063868 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb589268-1012-44e3-8915-2bd4f6d1a726 admin admin] PATH_INFO: `/v3/projects/b4da6d3eec1c4cbeb01ba7fc21e5b1d7/users/baba92cb038942798075c45f9c4d5717/roles/640bda0879494e60b72680ee505285f0` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:59:38.080320 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb589268-1012-44e3-8915-2bd4f6d1a726 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4da6d3eec1c4cbeb01ba7fc21e5b1d7, user_id=baba92cb038942798075c45f9c4d5717, role_id=640bda0879494e60b72680ee505285f0)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:59:38.083024 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb589268-1012-44e3-8915-2bd4f6d1a726 admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:59:38.095838 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1403/2816] 10.222.0.26 () {60 vars in 1483 bytes} [Wed Aug 24 05:59:38 2022] PUT /identity/v3/projects/b4da6d3eec1c4cbeb01ba7fc21e5b1d7/users/baba92cb038942798075c45f9c4d5717/roles/640bda0879494e60b72680ee505285f0 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:59:38.099791 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9cae90-097d-4d3b-9510-5175573c2a3a admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:59:38.109853 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9cae90-097d-4d3b-9510-5175573c2a3a admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:59:38.165266 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd934760-baee-47e4-9ff5-084e5af07f22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:59:38.165859 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd934760-baee-47e4-9ff5-084e5af07f22 admin admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:59:38.166167 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd934760-baee-47e4-9ff5-084e5af07f22 admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:59:38.166439 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd934760-baee-47e4-9ff5-084e5af07f22 admin admin] PATH_INFO: `/v3/roles` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:59:38.167069 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd934760-baee-47e4-9ff5-084e5af07f22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:59:38.168645 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd934760-baee-47e4-9ff5-084e5af07f22 admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:59:38.178000 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1414/2817] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Aug 24 05:59:38 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:59:38.182031 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb589268-1012-44e3-8915-2bd4f6d1a726 admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:59:38.192068 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb589268-1012-44e3-8915-2bd4f6d1a726 admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:59:38.196912 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0252bfd3-ba18-479c-9a65-bcfeb1049e56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:59:38.197549 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0252bfd3-ba18-479c-9a65-bcfeb1049e56 admin admin] REQUEST_METHOD: `PUT` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:59:38.197827 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0252bfd3-ba18-479c-9a65-bcfeb1049e56 admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:59:38.198138 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0252bfd3-ba18-479c-9a65-bcfeb1049e56 admin admin] PATH_INFO: `/v3/projects/b4da6d3eec1c4cbeb01ba7fc21e5b1d7/users/baba92cb038942798075c45f9c4d5717/roles/640bda0879494e60b72680ee505285f0` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:59:38.200069 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0252bfd3-ba18-479c-9a65-bcfeb1049e56 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4da6d3eec1c4cbeb01ba7fc21e5b1d7, user_id=baba92cb038942798075c45f9c4d5717, role_id=640bda0879494e60b72680ee505285f0)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:59:38.202729 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0252bfd3-ba18-479c-9a65-bcfeb1049e56 admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:59:38.213419 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1404/2818] 10.222.0.26 () {60 vars in 1483 bytes} [Wed Aug 24 05:59:38 2022] PUT /identity/v3/projects/b4da6d3eec1c4cbeb01ba7fc21e5b1d7/users/baba92cb038942798075c45f9c4d5717/roles/640bda0879494e60b72680ee505285f0 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:59:38.224050 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c980f06b-2f6b-4c6e-ab8e-b2170399024b None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:59:38.224338 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c980f06b-2f6b-4c6e-ab8e-b2170399024b None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:59:38.224614 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c980f06b-2f6b-4c6e-ab8e-b2170399024b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:59:38.250973 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-c980f06b-2f6b-4c6e-ab8e-b2170399024b None None] MFA Rules not processed for user `baba92cb038942798075c45f9c4d5717`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:59:38.252196 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-c980f06b-2f6b-4c6e-ab8e-b2170399024b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:59:38.269112 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:59:38.320770 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1415/2819] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:59:38 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:59:38.332785 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0252bfd3-ba18-479c-9a65-bcfeb1049e56 admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:59:38.334567 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-0252bfd3-ba18-479c-9a65-bcfeb1049e56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:59:38.390978 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0252bfd3-ba18-479c-9a65-bcfeb1049e56 admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:59:38.395207 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f74ae0-db88-45da-ac6d-6dea9acdfb1a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17b450afe795495680fc70f522c83750', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:59:38.395802 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f74ae0-db88-45da-ac6d-6dea9acdfb1a service cinder] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:59:38.396085 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f74ae0-db88-45da-ac6d-6dea9acdfb1a service cinder] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:59:38.396355 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f74ae0-db88-45da-ac6d-6dea9acdfb1a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:59:38.405303 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f74ae0-db88-45da-ac6d-6dea9acdfb1a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:59:38.406758 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f74ae0-db88-45da-ac6d-6dea9acdfb1a service cinder] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:59:38.416108 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1405/2820] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 24 05:59:38 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 05:59:38.489895 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c980f06b-2f6b-4c6e-ab8e-b2170399024b None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:59:38.499960 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c980f06b-2f6b-4c6e-ab8e-b2170399024b None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:59:38.504363 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ff8d98-ea36-4ed1-925a-360b963a1d69 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17b450afe795495680fc70f522c83750', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:59:38.504969 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ff8d98-ea36-4ed1-925a-360b963a1d69 service cinder] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:59:38.505312 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ff8d98-ea36-4ed1-925a-360b963a1d69 service cinder] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:59:38.505617 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ff8d98-ea36-4ed1-925a-360b963a1d69 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:59:38.561502 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ff8d98-ea36-4ed1-925a-360b963a1d69 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:59:38.562960 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ff8d98-ea36-4ed1-925a-360b963a1d69 service cinder] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:59:38.572764 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1416/2821] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 24 05:59:38 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:59:41.273313 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f74ae0-db88-45da-ac6d-6dea9acdfb1a service cinder] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:59:41.323341 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:59:41.335987 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f74ae0-db88-45da-ac6d-6dea9acdfb1a service cinder] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:59:41.340529 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48aa50d-b862-4d45-b509-3aa64778aff3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:59:41.341147 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48aa50d-b862-4d45-b509-3aa64778aff3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:59:41.341429 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48aa50d-b862-4d45-b509-3aa64778aff3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:59:41.341701 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48aa50d-b862-4d45-b509-3aa64778aff3 admin admin] PATH_INFO: `/v3/users/d0931617bed649898cebb4513ee76247` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:59:41.342844 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48aa50d-b862-4d45-b509-3aa64778aff3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d0931617bed649898cebb4513ee76247)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:59:41.344738 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48aa50d-b862-4d45-b509-3aa64778aff3 admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:59:41.390836 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-e48aa50d-b862-4d45-b509-3aa64778aff3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd0931617bed649898cebb4513ee76247'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:59:41.398088 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-e48aa50d-b862-4d45-b509-3aa64778aff3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd0931617bed649898cebb4513ee76247'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:59:41.410528 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-e48aa50d-b862-4d45-b509-3aa64778aff3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd0931617bed649898cebb4513ee76247'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:59:41.417528 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-e48aa50d-b862-4d45-b509-3aa64778aff3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd0931617bed649898cebb4513ee76247'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:59:41.418171 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-e48aa50d-b862-4d45-b509-3aa64778aff3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd0931617bed649898cebb4513ee76247'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:59:41.424538 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1406/2822] 10.222.0.26 () {58 vars in 1224 bytes} [Wed Aug 24 05:59:41 2022] DELETE /identity/v3/users/d0931617bed649898cebb4513ee76247 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 05:59:41.429058 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717fe214-6667-4c62-8d49-91869a89769d None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:59:41.429538 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717fe214-6667-4c62-8d49-91869a89769d None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:59:41.429653 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717fe214-6667-4c62-8d49-91869a89769d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:59:41.448098 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-717fe214-6667-4c62-8d49-91869a89769d None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:59:41.449286 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-717fe214-6667-4c62-8d49-91869a89769d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:59:41.506318 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1417/2823] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:59:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:59:41.516020 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48aa50d-b862-4d45-b509-3aa64778aff3 admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:59:41.517415 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-e48aa50d-b862-4d45-b509-3aa64778aff3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:59:41.574192 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48aa50d-b862-4d45-b509-3aa64778aff3 admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:59:41.577782 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0255d6ab-79aa-47ed-a148-9d1f008bb709 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '874348b647194ac2b5ecbf12c33bf59e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:59:41.578407 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0255d6ab-79aa-47ed-a148-9d1f008bb709 service neutron] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:59:41.578736 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0255d6ab-79aa-47ed-a148-9d1f008bb709 service neutron] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:59:41.579009 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0255d6ab-79aa-47ed-a148-9d1f008bb709 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:59:41.587700 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0255d6ab-79aa-47ed-a148-9d1f008bb709 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:59:41.589109 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0255d6ab-79aa-47ed-a148-9d1f008bb709 service neutron] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:59:41.598879 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1407/2824] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 24 05:59:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:59:41.863146 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717fe214-6667-4c62-8d49-91869a89769d None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:59:41.864629 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-717fe214-6667-4c62-8d49-91869a89769d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:59:41.876751 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717fe214-6667-4c62-8d49-91869a89769d None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:59:41.881345 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e9c29d-179f-49e8-b587-eca1d0f65eca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:59:41.882035 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e9c29d-179f-49e8-b587-eca1d0f65eca admin admin] REQUEST_METHOD: `DELETE` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:59:41.882316 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e9c29d-179f-49e8-b587-eca1d0f65eca admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:59:41.882583 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e9c29d-179f-49e8-b587-eca1d0f65eca admin admin] PATH_INFO: `/v3/projects/405dbfc936ed4ae19fd73f2e89f60829` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:59:41.883699 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e9c29d-179f-49e8-b587-eca1d0f65eca admin admin] RBAC: Authorizing `identity:delete_project(project_id=405dbfc936ed4ae19fd73f2e89f60829)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:59:41.885612 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e9c29d-179f-49e8-b587-eca1d0f65eca admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:59:41.931109 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:59:41.932406 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-27e9c29d-179f-49e8-b587-eca1d0f65eca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '405dbfc936ed4ae19fd73f2e89f60829', 'request_id': 'req-27e9c29d-179f-49e8-b587-eca1d0f65eca'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:59:41.940362 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-27e9c29d-179f-49e8-b587-eca1d0f65eca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '405dbfc936ed4ae19fd73f2e89f60829', 'request_id': 'req-27e9c29d-179f-49e8-b587-eca1d0f65eca'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:59:41.946709 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-27e9c29d-179f-49e8-b587-eca1d0f65eca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '405dbfc936ed4ae19fd73f2e89f60829', 'request_id': 'req-27e9c29d-179f-49e8-b587-eca1d0f65eca'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:59:41.957695 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-27e9c29d-179f-49e8-b587-eca1d0f65eca admin admin] The token cache is being invalidate because project 405dbfc936ed4ae19fd73f2e89f60829 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:59:41.958017 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-27e9c29d-179f-49e8-b587-eca1d0f65eca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:59:41.958644 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-27e9c29d-179f-49e8-b587-eca1d0f65eca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:59:41.960161 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1418/2825] 10.222.0.26 () {58 vars in 1233 bytes} [Wed Aug 24 05:59:41 2022] DELETE /identity/v3/projects/405dbfc936ed4ae19fd73f2e89f60829 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:59:41.964397 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0255d6ab-79aa-47ed-a148-9d1f008bb709 service neutron] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:59:41.974801 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0255d6ab-79aa-47ed-a148-9d1f008bb709 service neutron] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:59:42.029962 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40f8fb5-1ddb-438f-9510-912a32a6e039 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:59:42.030595 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40f8fb5-1ddb-438f-9510-912a32a6e039 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:59:42.030876 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40f8fb5-1ddb-438f-9510-912a32a6e039 admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:59:42.031149 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40f8fb5-1ddb-438f-9510-912a32a6e039 admin admin] PATH_INFO: `/v3/users/baba92cb038942798075c45f9c4d5717` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:59:42.032259 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40f8fb5-1ddb-438f-9510-912a32a6e039 admin admin] RBAC: Authorizing `identity:delete_user(user_id=baba92cb038942798075c45f9c4d5717)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:59:42.034789 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40f8fb5-1ddb-438f-9510-912a32a6e039 admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:59:42.047638 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:59:42.081011 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-e40f8fb5-1ddb-438f-9510-912a32a6e039 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'baba92cb038942798075c45f9c4d5717'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:59:42.087827 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-e40f8fb5-1ddb-438f-9510-912a32a6e039 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'baba92cb038942798075c45f9c4d5717'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:59:42.100105 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-e40f8fb5-1ddb-438f-9510-912a32a6e039 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'baba92cb038942798075c45f9c4d5717'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:59:42.107367 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-e40f8fb5-1ddb-438f-9510-912a32a6e039 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'baba92cb038942798075c45f9c4d5717'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:59:42.107984 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-e40f8fb5-1ddb-438f-9510-912a32a6e039 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'baba92cb038942798075c45f9c4d5717'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:59:42.113807 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1408/2826] 10.222.0.26 () {58 vars in 1224 bytes} [Wed Aug 24 05:59:41 2022] DELETE /identity/v3/users/baba92cb038942798075c45f9c4d5717 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 05:59:42.387209 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e9c29d-179f-49e8-b587-eca1d0f65eca admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:59:42.388637 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-27e9c29d-179f-49e8-b587-eca1d0f65eca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:59:42.402607 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e9c29d-179f-49e8-b587-eca1d0f65eca admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:59:42.459139 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede16ba0-2876-4b74-bfa3-cba2e8a5eb33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:59:42.459826 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede16ba0-2876-4b74-bfa3-cba2e8a5eb33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:59:42.460030 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede16ba0-2876-4b74-bfa3-cba2e8a5eb33 admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:59:42.460300 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede16ba0-2876-4b74-bfa3-cba2e8a5eb33 admin admin] PATH_INFO: `/v3/projects/b4da6d3eec1c4cbeb01ba7fc21e5b1d7` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:59:42.461397 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede16ba0-2876-4b74-bfa3-cba2e8a5eb33 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b4da6d3eec1c4cbeb01ba7fc21e5b1d7)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:59:42.463339 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede16ba0-2876-4b74-bfa3-cba2e8a5eb33 admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:59:42.508942 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-ede16ba0-2876-4b74-bfa3-cba2e8a5eb33 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b4da6d3eec1c4cbeb01ba7fc21e5b1d7', 'request_id': 'req-ede16ba0-2876-4b74-bfa3-cba2e8a5eb33'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:59:42.515849 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-ede16ba0-2876-4b74-bfa3-cba2e8a5eb33 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b4da6d3eec1c4cbeb01ba7fc21e5b1d7', 'request_id': 'req-ede16ba0-2876-4b74-bfa3-cba2e8a5eb33'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:59:42.522505 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-ede16ba0-2876-4b74-bfa3-cba2e8a5eb33 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b4da6d3eec1c4cbeb01ba7fc21e5b1d7', 'request_id': 'req-ede16ba0-2876-4b74-bfa3-cba2e8a5eb33'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:59:42.532467 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-ede16ba0-2876-4b74-bfa3-cba2e8a5eb33 admin admin] The token cache is being invalidate because project b4da6d3eec1c4cbeb01ba7fc21e5b1d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:59:42.532751 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-ede16ba0-2876-4b74-bfa3-cba2e8a5eb33 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:59:42.533358 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-ede16ba0-2876-4b74-bfa3-cba2e8a5eb33 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:59:42.534904 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1419/2827] 10.222.0.26 () {58 vars in 1233 bytes} [Wed Aug 24 05:59:42 2022] DELETE /identity/v3/projects/b4da6d3eec1c4cbeb01ba7fc21e5b1d7 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:59:42.539931 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87077da-7439-44d1-9554-718bc62c2cb4 None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:59:42.540408 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87077da-7439-44d1-9554-718bc62c2cb4 None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:59:42.540527 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87077da-7439-44d1-9554-718bc62c2cb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:59:42.560275 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-f87077da-7439-44d1-9554-718bc62c2cb4 None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:59:42.561500 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-f87077da-7439-44d1-9554-718bc62c2cb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:59:42.619059 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1409/2828] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:59:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:59:42.627982 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4269073-fcd5-4bd8-8d7b-104108a66e38 None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:59:42.628382 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4269073-fcd5-4bd8-8d7b-104108a66e38 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:59:42.628661 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4269073-fcd5-4bd8-8d7b-104108a66e38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:59:42.648131 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-f4269073-fcd5-4bd8-8d7b-104108a66e38 None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:59:42.649313 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-f4269073-fcd5-4bd8-8d7b-104108a66e38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:59:42.656977 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1420/2829] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:59:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:59:42.661787 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87077da-7439-44d1-9554-718bc62c2cb4 None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:59:42.671613 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87077da-7439-44d1-9554-718bc62c2cb4 None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:59:42.676187 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760bde44-29fb-45b0-8110-433a02c741f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:59:42.676784 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760bde44-29fb-45b0-8110-433a02c741f6 admin admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:59:42.677062 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760bde44-29fb-45b0-8110-433a02c741f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:59:42.677331 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760bde44-29fb-45b0-8110-433a02c741f6 admin admin] PATH_INFO: `/v3/domains` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:59:42.678002 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760bde44-29fb-45b0-8110-433a02c741f6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:59:42.678307 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760bde44-29fb-45b0-8110-433a02c741f6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:59:42.679886 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760bde44-29fb-45b0-8110-433a02c741f6 admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:59:42.691289 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1410/2830] 10.222.0.26 () {58 vars in 1153 bytes} [Wed Aug 24 05:59:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:59:42.695641 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4269073-fcd5-4bd8-8d7b-104108a66e38 None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:59:42.704783 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4269073-fcd5-4bd8-8d7b-104108a66e38 None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:59:42.709787 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f62ba1-2012-4d5d-a7c0-92f51a692e2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:59:42.710468 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f62ba1-2012-4d5d-a7c0-92f51a692e2c admin admin] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:59:42.710687 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f62ba1-2012-4d5d-a7c0-92f51a692e2c admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:59:42.710955 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f62ba1-2012-4d5d-a7c0-92f51a692e2c admin admin] PATH_INFO: `/v3/projects` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:59:42.711562 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f62ba1-2012-4d5d-a7c0-92f51a692e2c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:59:42.713430 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f62ba1-2012-4d5d-a7c0-92f51a692e2c admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:59:42.739856 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1421/2831] 10.222.0.26 () {60 vars in 1153 bytes} [Wed Aug 24 05:59:42 2022] POST /identity/v3/projects => generated 365 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:59:42.744073 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760bde44-29fb-45b0-8110-433a02c741f6 admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:59:42.754062 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760bde44-29fb-45b0-8110-433a02c741f6 admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:59:42.808729 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4c9f2a-6193-4c44-96b8-25102ee53e55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:59:42.809331 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4c9f2a-6193-4c44-96b8-25102ee53e55 admin admin] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:59:42.809646 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4c9f2a-6193-4c44-96b8-25102ee53e55 admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:59:42.809879 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4c9f2a-6193-4c44-96b8-25102ee53e55 admin admin] PATH_INFO: `/v3/users` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:59:42.810578 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4c9f2a-6193-4c44-96b8-25102ee53e55 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:59:42.812486 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4c9f2a-6193-4c44-96b8-25102ee53e55 admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:59:42.833512 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1411/2832] 10.222.0.26 () {60 vars in 1144 bytes} [Wed Aug 24 05:59:42 2022] POST /identity/v3/users => generated 283 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:59:42.837646 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f62ba1-2012-4d5d-a7c0-92f51a692e2c admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:59:42.848792 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f62ba1-2012-4d5d-a7c0-92f51a692e2c admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:59:42.853376 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b61f5e7-d6e7-447b-bade-714c1b54913d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:59:42.853992 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b61f5e7-d6e7-447b-bade-714c1b54913d admin admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:59:42.854276 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b61f5e7-d6e7-447b-bade-714c1b54913d admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:59:42.854545 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b61f5e7-d6e7-447b-bade-714c1b54913d admin admin] PATH_INFO: `/v3/roles` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:59:42.855212 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b61f5e7-d6e7-447b-bade-714c1b54913d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:59:42.856791 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b61f5e7-d6e7-447b-bade-714c1b54913d admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:59:42.866444 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1422/2833] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Aug 24 05:59:42 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:59:42.870307 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4c9f2a-6193-4c44-96b8-25102ee53e55 admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:59:42.881163 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4c9f2a-6193-4c44-96b8-25102ee53e55 admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:59:42.885762 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323d4a3c-a855-4418-adc3-1923768da189 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:59:42.886379 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323d4a3c-a855-4418-adc3-1923768da189 admin admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:59:42.886658 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323d4a3c-a855-4418-adc3-1923768da189 admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:59:42.886927 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323d4a3c-a855-4418-adc3-1923768da189 admin admin] PATH_INFO: `/v3/roles` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:59:42.887555 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323d4a3c-a855-4418-adc3-1923768da189 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:59:42.889119 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323d4a3c-a855-4418-adc3-1923768da189 admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:59:42.891316 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:59:42.902125 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1412/2834] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Aug 24 05:59:42 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:59:42.905840 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b61f5e7-d6e7-447b-bade-714c1b54913d admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:59:42.915812 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b61f5e7-d6e7-447b-bade-714c1b54913d admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:59:42.920364 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f0f1b5-c054-4b3d-848e-a96861fc2701 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:59:42.921002 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f0f1b5-c054-4b3d-848e-a96861fc2701 admin admin] REQUEST_METHOD: `PUT` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:59:42.921286 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f0f1b5-c054-4b3d-848e-a96861fc2701 admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:59:42.921553 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f0f1b5-c054-4b3d-848e-a96861fc2701 admin admin] PATH_INFO: `/v3/projects/08adcd9071dd41a6930b596d2a0b2e12/users/ff82ef57a3fa4873992cf275d32edd7f/roles/f7aa4a2c74c94c1b9ca8ecdcccccda5c` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:59:42.937199 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f0f1b5-c054-4b3d-848e-a96861fc2701 admin admin] RBAC: Authorizing `identity:create_grant(project_id=08adcd9071dd41a6930b596d2a0b2e12, user_id=ff82ef57a3fa4873992cf275d32edd7f, role_id=f7aa4a2c74c94c1b9ca8ecdcccccda5c)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:59:42.940410 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f0f1b5-c054-4b3d-848e-a96861fc2701 admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:59:42.953352 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1423/2835] 10.222.0.26 () {60 vars in 1483 bytes} [Wed Aug 24 05:59:42 2022] PUT /identity/v3/projects/08adcd9071dd41a6930b596d2a0b2e12/users/ff82ef57a3fa4873992cf275d32edd7f/roles/f7aa4a2c74c94c1b9ca8ecdcccccda5c => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:59:43.016144 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b3f622-333a-446b-8ba3-182ca56e9ffc None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:59:43.016341 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b3f622-333a-446b-8ba3-182ca56e9ffc None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:59:43.016603 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b3f622-333a-446b-8ba3-182ca56e9ffc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:59:43.044272 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-35b3f622-333a-446b-8ba3-182ca56e9ffc None None] MFA Rules not processed for user `ff82ef57a3fa4873992cf275d32edd7f`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:59:43.045477 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-35b3f622-333a-446b-8ba3-182ca56e9ffc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:59:43.108408 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1413/2836] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:59:43 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:59:43.112944 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f0f1b5-c054-4b3d-848e-a96861fc2701 admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:59:43.117398 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:59:43.175466 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f0f1b5-c054-4b3d-848e-a96861fc2701 admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:59:43.180025 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7308d39c-46ae-4c9a-849d-50ded6a09699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:59:43.180615 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7308d39c-46ae-4c9a-849d-50ded6a09699 admin admin] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:59:43.180890 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7308d39c-46ae-4c9a-849d-50ded6a09699 admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:59:43.181157 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7308d39c-46ae-4c9a-849d-50ded6a09699 admin admin] PATH_INFO: `/v3/projects` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:59:43.181762 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7308d39c-46ae-4c9a-849d-50ded6a09699 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:59:43.183664 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7308d39c-46ae-4c9a-849d-50ded6a09699 admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:59:43.210088 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1424/2837] 10.222.0.26 () {60 vars in 1153 bytes} [Wed Aug 24 05:59:43 2022] POST /identity/v3/projects => generated 367 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:59:43.214078 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b3f622-333a-446b-8ba3-182ca56e9ffc None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:59:43.224739 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b3f622-333a-446b-8ba3-182ca56e9ffc None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:59:43.279627 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db79c50-977c-4c24-a352-d0b558f95e9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:59:43.280155 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db79c50-977c-4c24-a352-d0b558f95e9c admin admin] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:59:43.280433 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db79c50-977c-4c24-a352-d0b558f95e9c admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:59:43.280699 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db79c50-977c-4c24-a352-d0b558f95e9c admin admin] PATH_INFO: `/v3/users` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:59:43.281320 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db79c50-977c-4c24-a352-d0b558f95e9c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:59:43.283238 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db79c50-977c-4c24-a352-d0b558f95e9c admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:59:43.303773 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1414/2838] 10.222.0.26 () {60 vars in 1144 bytes} [Wed Aug 24 05:59:43 2022] POST /identity/v3/users => generated 290 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:59:43.307689 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7308d39c-46ae-4c9a-849d-50ded6a09699 admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:59:43.318368 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7308d39c-46ae-4c9a-849d-50ded6a09699 admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:59:43.323108 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9e228f-7d30-41f1-8cd4-a17501704628 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:59:43.323695 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9e228f-7d30-41f1-8cd4-a17501704628 admin admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:59:43.323968 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9e228f-7d30-41f1-8cd4-a17501704628 admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:59:43.324237 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9e228f-7d30-41f1-8cd4-a17501704628 admin admin] PATH_INFO: `/v3/roles` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:59:43.324870 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9e228f-7d30-41f1-8cd4-a17501704628 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:59:43.326480 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9e228f-7d30-41f1-8cd4-a17501704628 admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:59:43.336484 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1425/2839] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Aug 24 05:59:43 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:59:43.340375 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db79c50-977c-4c24-a352-d0b558f95e9c admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:59:43.350274 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db79c50-977c-4c24-a352-d0b558f95e9c admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:59:43.354952 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da55bf2-97af-46d9-a3e1-c96ef613014b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:59:43.355625 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da55bf2-97af-46d9-a3e1-c96ef613014b admin admin] REQUEST_METHOD: `PUT` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:59:43.355910 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da55bf2-97af-46d9-a3e1-c96ef613014b admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:59:43.356198 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da55bf2-97af-46d9-a3e1-c96ef613014b admin admin] PATH_INFO: `/v3/projects/cbfadfe23b6e467facf5ed4084b1b5a3/users/e7f7a183b4f94cb1809efc66a25f99af/roles/640bda0879494e60b72680ee505285f0` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:59:43.371015 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da55bf2-97af-46d9-a3e1-c96ef613014b admin admin] RBAC: Authorizing `identity:create_grant(project_id=cbfadfe23b6e467facf5ed4084b1b5a3, user_id=e7f7a183b4f94cb1809efc66a25f99af, role_id=640bda0879494e60b72680ee505285f0)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:59:43.373654 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da55bf2-97af-46d9-a3e1-c96ef613014b admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:59:43.386840 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1415/2840] 10.222.0.26 () {60 vars in 1483 bytes} [Wed Aug 24 05:59:43 2022] PUT /identity/v3/projects/cbfadfe23b6e467facf5ed4084b1b5a3/users/e7f7a183b4f94cb1809efc66a25f99af/roles/640bda0879494e60b72680ee505285f0 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:59:43.391091 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9e228f-7d30-41f1-8cd4-a17501704628 admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:59:43.401136 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9e228f-7d30-41f1-8cd4-a17501704628 admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:59:43.456746 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448a9f15-aa12-48ed-88b8-1bc3ab533644 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:59:43.457344 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448a9f15-aa12-48ed-88b8-1bc3ab533644 admin admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:59:43.457624 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448a9f15-aa12-48ed-88b8-1bc3ab533644 admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:59:43.457894 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448a9f15-aa12-48ed-88b8-1bc3ab533644 admin admin] PATH_INFO: `/v3/roles` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:59:43.458630 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448a9f15-aa12-48ed-88b8-1bc3ab533644 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:59:43.460212 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448a9f15-aa12-48ed-88b8-1bc3ab533644 admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:59:43.469719 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1426/2841] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Aug 24 05:59:43 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:59:43.473969 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da55bf2-97af-46d9-a3e1-c96ef613014b admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:59:43.484282 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da55bf2-97af-46d9-a3e1-c96ef613014b admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:59:43.489374 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f859ce43-8247-4311-8de9-cb6aa34cbae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:59:43.490110 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f859ce43-8247-4311-8de9-cb6aa34cbae6 admin admin] REQUEST_METHOD: `PUT` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:59:43.490390 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f859ce43-8247-4311-8de9-cb6aa34cbae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:59:43.490659 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f859ce43-8247-4311-8de9-cb6aa34cbae6 admin admin] PATH_INFO: `/v3/projects/cbfadfe23b6e467facf5ed4084b1b5a3/users/e7f7a183b4f94cb1809efc66a25f99af/roles/640bda0879494e60b72680ee505285f0` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:59:43.492549 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f859ce43-8247-4311-8de9-cb6aa34cbae6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cbfadfe23b6e467facf5ed4084b1b5a3, user_id=e7f7a183b4f94cb1809efc66a25f99af, role_id=640bda0879494e60b72680ee505285f0)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:59:43.495264 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f859ce43-8247-4311-8de9-cb6aa34cbae6 admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:59:43.506422 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1416/2842] 10.222.0.26 () {60 vars in 1483 bytes} [Wed Aug 24 05:59:43 2022] PUT /identity/v3/projects/cbfadfe23b6e467facf5ed4084b1b5a3/users/e7f7a183b4f94cb1809efc66a25f99af/roles/640bda0879494e60b72680ee505285f0 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:59:43.516416 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353948a8-adf3-49ac-b942-b1e4fb5ffe68 None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:59:43.516703 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353948a8-adf3-49ac-b942-b1e4fb5ffe68 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:59:43.516977 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353948a8-adf3-49ac-b942-b1e4fb5ffe68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:59:43.544126 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-353948a8-adf3-49ac-b942-b1e4fb5ffe68 None None] MFA Rules not processed for user `e7f7a183b4f94cb1809efc66a25f99af`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:59:43.545433 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-353948a8-adf3-49ac-b942-b1e4fb5ffe68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:59:43.607013 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:59:43.613191 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1427/2843] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:59:43 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:59:43.624172 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f859ce43-8247-4311-8de9-cb6aa34cbae6 admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:59:43.625958 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-f859ce43-8247-4311-8de9-cb6aa34cbae6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:59:43.670408 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:59:43.685179 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f859ce43-8247-4311-8de9-cb6aa34cbae6 admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:59:43.689100 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267db64f-01c2-4e94-af65-aa41a6f8239d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17b450afe795495680fc70f522c83750', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:59:43.689712 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267db64f-01c2-4e94-af65-aa41a6f8239d service cinder] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:59:43.690006 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267db64f-01c2-4e94-af65-aa41a6f8239d service cinder] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:59:43.690282 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267db64f-01c2-4e94-af65-aa41a6f8239d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:59:43.699560 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267db64f-01c2-4e94-af65-aa41a6f8239d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:59:43.700981 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267db64f-01c2-4e94-af65-aa41a6f8239d service cinder] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:59:43.710485 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1417/2844] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 24 05:59:43 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:59:43.791677 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353948a8-adf3-49ac-b942-b1e4fb5ffe68 None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:59:43.801918 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353948a8-adf3-49ac-b942-b1e4fb5ffe68 None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:59:43.805508 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcf84f3-5e65-4ec3-b8cb-654f4322237d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17b450afe795495680fc70f522c83750', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:59:43.806122 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcf84f3-5e65-4ec3-b8cb-654f4322237d service cinder] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:59:43.806400 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcf84f3-5e65-4ec3-b8cb-654f4322237d service cinder] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:59:43.806668 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcf84f3-5e65-4ec3-b8cb-654f4322237d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:59:43.861194 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcf84f3-5e65-4ec3-b8cb-654f4322237d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:59:43.863213 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcf84f3-5e65-4ec3-b8cb-654f4322237d service cinder] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:59:43.871842 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1428/2845] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 24 05:59:43 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:59:48.532312 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267db64f-01c2-4e94-af65-aa41a6f8239d service cinder] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:59:48.595762 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267db64f-01c2-4e94-af65-aa41a6f8239d service cinder] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:59:48.600268 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8deed5d7-d116-40b7-be12-53092444ceda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:59:48.600886 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8deed5d7-d116-40b7-be12-53092444ceda admin admin] REQUEST_METHOD: `DELETE` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:59:48.601166 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8deed5d7-d116-40b7-be12-53092444ceda admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:59:48.601455 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8deed5d7-d116-40b7-be12-53092444ceda admin admin] PATH_INFO: `/v3/users/ff82ef57a3fa4873992cf275d32edd7f` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:59:48.602546 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8deed5d7-d116-40b7-be12-53092444ceda admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff82ef57a3fa4873992cf275d32edd7f)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:59:48.604490 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8deed5d7-d116-40b7-be12-53092444ceda admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:59:48.648724 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-8deed5d7-d116-40b7-be12-53092444ceda admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff82ef57a3fa4873992cf275d32edd7f'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:59:48.655614 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-8deed5d7-d116-40b7-be12-53092444ceda admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff82ef57a3fa4873992cf275d32edd7f'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:59:48.667280 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-8deed5d7-d116-40b7-be12-53092444ceda admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff82ef57a3fa4873992cf275d32edd7f'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:59:48.674780 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-8deed5d7-d116-40b7-be12-53092444ceda admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff82ef57a3fa4873992cf275d32edd7f'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:59:48.675396 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-8deed5d7-d116-40b7-be12-53092444ceda admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff82ef57a3fa4873992cf275d32edd7f'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:59:48.681253 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1418/2846] 10.222.0.26 () {58 vars in 1224 bytes} [Wed Aug 24 05:59:48 2022] DELETE /identity/v3/users/ff82ef57a3fa4873992cf275d32edd7f => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 05:59:48.685739 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc4f640-2a5c-431d-b9b5-84997dfef9a9 None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:59:48.686249 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc4f640-2a5c-431d-b9b5-84997dfef9a9 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:59:48.686358 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc4f640-2a5c-431d-b9b5-84997dfef9a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:59:48.705298 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-abc4f640-2a5c-431d-b9b5-84997dfef9a9 None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:59:48.706593 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-abc4f640-2a5c-431d-b9b5-84997dfef9a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:59:48.763550 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1429/2847] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:59:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:59:48.773238 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8deed5d7-d116-40b7-be12-53092444ceda admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:59:48.774647 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-8deed5d7-d116-40b7-be12-53092444ceda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:59:48.831275 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8deed5d7-d116-40b7-be12-53092444ceda admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:59:48.834836 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3d90f3-df15-46b4-a2cd-2133805f311b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '874348b647194ac2b5ecbf12c33bf59e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:59:48.835436 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3d90f3-df15-46b4-a2cd-2133805f311b service neutron] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:59:48.835712 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3d90f3-df15-46b4-a2cd-2133805f311b service neutron] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:59:48.835977 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3d90f3-df15-46b4-a2cd-2133805f311b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:59:48.844736 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3d90f3-df15-46b4-a2cd-2133805f311b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:59:48.846217 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3d90f3-df15-46b4-a2cd-2133805f311b service neutron] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:59:48.855422 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1419/2848] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 24 05:59:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 05:59:49.115153 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc4f640-2a5c-431d-b9b5-84997dfef9a9 None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:59:49.116737 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-abc4f640-2a5c-431d-b9b5-84997dfef9a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:59:49.129232 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc4f640-2a5c-431d-b9b5-84997dfef9a9 None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:59:49.133900 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a0faac-d52d-4691-b77a-d44b6bba1d20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:59:49.135189 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a0faac-d52d-4691-b77a-d44b6bba1d20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:59:49.135701 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a0faac-d52d-4691-b77a-d44b6bba1d20 admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:59:49.135985 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a0faac-d52d-4691-b77a-d44b6bba1d20 admin admin] PATH_INFO: `/v3/projects/08adcd9071dd41a6930b596d2a0b2e12` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:59:49.137126 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a0faac-d52d-4691-b77a-d44b6bba1d20 admin admin] RBAC: Authorizing `identity:delete_project(project_id=08adcd9071dd41a6930b596d2a0b2e12)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:59:49.139053 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a0faac-d52d-4691-b77a-d44b6bba1d20 admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:59:49.185396 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-32a0faac-d52d-4691-b77a-d44b6bba1d20 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '08adcd9071dd41a6930b596d2a0b2e12', 'request_id': 'req-32a0faac-d52d-4691-b77a-d44b6bba1d20'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:59:49.192573 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-32a0faac-d52d-4691-b77a-d44b6bba1d20 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '08adcd9071dd41a6930b596d2a0b2e12', 'request_id': 'req-32a0faac-d52d-4691-b77a-d44b6bba1d20'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:59:49.199162 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-32a0faac-d52d-4691-b77a-d44b6bba1d20 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '08adcd9071dd41a6930b596d2a0b2e12', 'request_id': 'req-32a0faac-d52d-4691-b77a-d44b6bba1d20'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:59:49.209468 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-32a0faac-d52d-4691-b77a-d44b6bba1d20 admin admin] The token cache is being invalidate because project 08adcd9071dd41a6930b596d2a0b2e12 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:59:49.209752 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-32a0faac-d52d-4691-b77a-d44b6bba1d20 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:59:49.210420 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-32a0faac-d52d-4691-b77a-d44b6bba1d20 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:59:49.211884 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1430/2849] 10.222.0.26 () {58 vars in 1233 bytes} [Wed Aug 24 05:59:49 2022] DELETE /identity/v3/projects/08adcd9071dd41a6930b596d2a0b2e12 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:59:49.215934 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3d90f3-df15-46b4-a2cd-2133805f311b service neutron] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:59:49.222559 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:59:49.226578 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3d90f3-df15-46b4-a2cd-2133805f311b service neutron] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:59:49.282405 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105bf8e5-f806-47be-a766-05d6f461a1a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:59:49.283028 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105bf8e5-f806-47be-a766-05d6f461a1a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:59:49.284009 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105bf8e5-f806-47be-a766-05d6f461a1a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:59:49.284182 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105bf8e5-f806-47be-a766-05d6f461a1a5 admin admin] PATH_INFO: `/v3/users/e7f7a183b4f94cb1809efc66a25f99af` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:59:49.285301 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105bf8e5-f806-47be-a766-05d6f461a1a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e7f7a183b4f94cb1809efc66a25f99af)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:59:49.287246 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105bf8e5-f806-47be-a766-05d6f461a1a5 admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:59:49.332443 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-105bf8e5-f806-47be-a766-05d6f461a1a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e7f7a183b4f94cb1809efc66a25f99af'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:59:49.339265 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-105bf8e5-f806-47be-a766-05d6f461a1a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e7f7a183b4f94cb1809efc66a25f99af'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:59:49.351301 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-105bf8e5-f806-47be-a766-05d6f461a1a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e7f7a183b4f94cb1809efc66a25f99af'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:59:49.359075 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-105bf8e5-f806-47be-a766-05d6f461a1a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e7f7a183b4f94cb1809efc66a25f99af'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:59:49.359619 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-105bf8e5-f806-47be-a766-05d6f461a1a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e7f7a183b4f94cb1809efc66a25f99af'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:59:49.365398 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1420/2850] 10.222.0.26 () {58 vars in 1224 bytes} [Wed Aug 24 05:59:49 2022] DELETE /identity/v3/users/e7f7a183b4f94cb1809efc66a25f99af => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:59:49.629578 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a0faac-d52d-4691-b77a-d44b6bba1d20 admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:59:49.631064 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-32a0faac-d52d-4691-b77a-d44b6bba1d20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:59:49.645638 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a0faac-d52d-4691-b77a-d44b6bba1d20 admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:59:49.663769 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:59:49.705601 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92df26cc-40c0-4d48-9326-cdbede54c82f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:59:49.706279 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92df26cc-40c0-4d48-9326-cdbede54c82f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:59:49.706515 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92df26cc-40c0-4d48-9326-cdbede54c82f admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:59:49.706784 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92df26cc-40c0-4d48-9326-cdbede54c82f admin admin] PATH_INFO: `/v3/projects/cbfadfe23b6e467facf5ed4084b1b5a3` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:59:49.707867 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92df26cc-40c0-4d48-9326-cdbede54c82f admin admin] RBAC: Authorizing `identity:delete_project(project_id=cbfadfe23b6e467facf5ed4084b1b5a3)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:59:49.709756 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92df26cc-40c0-4d48-9326-cdbede54c82f admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:59:49.756275 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-92df26cc-40c0-4d48-9326-cdbede54c82f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cbfadfe23b6e467facf5ed4084b1b5a3', 'request_id': 'req-92df26cc-40c0-4d48-9326-cdbede54c82f'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:59:49.763482 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-92df26cc-40c0-4d48-9326-cdbede54c82f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cbfadfe23b6e467facf5ed4084b1b5a3', 'request_id': 'req-92df26cc-40c0-4d48-9326-cdbede54c82f'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:59:49.769724 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-92df26cc-40c0-4d48-9326-cdbede54c82f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cbfadfe23b6e467facf5ed4084b1b5a3', 'request_id': 'req-92df26cc-40c0-4d48-9326-cdbede54c82f'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:59:49.779819 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-92df26cc-40c0-4d48-9326-cdbede54c82f admin admin] The token cache is being invalidate because project cbfadfe23b6e467facf5ed4084b1b5a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:59:49.780107 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-92df26cc-40c0-4d48-9326-cdbede54c82f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:59:49.780733 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-92df26cc-40c0-4d48-9326-cdbede54c82f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:59:49.782222 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1431/2851] 10.222.0.26 () {58 vars in 1233 bytes} [Wed Aug 24 05:59:49 2022] DELETE /identity/v3/projects/cbfadfe23b6e467facf5ed4084b1b5a3 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:59:49.787687 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3feb5e-c8ef-42fd-9473-823ed142de8e None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:59:49.788165 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3feb5e-c8ef-42fd-9473-823ed142de8e None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:59:49.788272 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3feb5e-c8ef-42fd-9473-823ed142de8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:59:49.808690 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-ea3feb5e-c8ef-42fd-9473-823ed142de8e None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:59:49.809891 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-ea3feb5e-c8ef-42fd-9473-823ed142de8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:59:49.867207 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1421/2852] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:59:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:59:49.876126 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5c072c-b88d-479c-bb6a-f7affe19ec13 None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:59:49.876352 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5c072c-b88d-479c-bb6a-f7affe19ec13 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:59:49.876625 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5c072c-b88d-479c-bb6a-f7affe19ec13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:59:49.896774 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-8b5c072c-b88d-479c-bb6a-f7affe19ec13 None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:59:49.897961 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-8b5c072c-b88d-479c-bb6a-f7affe19ec13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:59:49.905691 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1432/2853] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:59:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:59:49.910302 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3feb5e-c8ef-42fd-9473-823ed142de8e None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:59:49.920304 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3feb5e-c8ef-42fd-9473-823ed142de8e None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:59:49.925507 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d88aea-eed7-4460-803f-c044c478c85d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:59:49.926146 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d88aea-eed7-4460-803f-c044c478c85d admin admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:59:49.926430 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d88aea-eed7-4460-803f-c044c478c85d admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:59:49.926703 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d88aea-eed7-4460-803f-c044c478c85d admin admin] PATH_INFO: `/v3/domains` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:59:49.927376 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d88aea-eed7-4460-803f-c044c478c85d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:59:49.927683 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d88aea-eed7-4460-803f-c044c478c85d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:59:49.929267 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d88aea-eed7-4460-803f-c044c478c85d admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:59:49.940681 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1422/2854] 10.222.0.26 () {58 vars in 1153 bytes} [Wed Aug 24 05:59:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:59:49.945092 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5c072c-b88d-479c-bb6a-f7affe19ec13 None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:59:49.954185 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5c072c-b88d-479c-bb6a-f7affe19ec13 None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:59:49.958842 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf37504e-1659-4865-95b8-73604b3f134d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:59:49.959454 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf37504e-1659-4865-95b8-73604b3f134d admin admin] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:59:49.959735 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf37504e-1659-4865-95b8-73604b3f134d admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:59:49.960006 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf37504e-1659-4865-95b8-73604b3f134d admin admin] PATH_INFO: `/v3/projects` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:59:49.960628 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf37504e-1659-4865-95b8-73604b3f134d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:59:49.962570 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf37504e-1659-4865-95b8-73604b3f134d admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:59:49.989188 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1433/2855] 10.222.0.26 () {60 vars in 1153 bytes} [Wed Aug 24 05:59:49 2022] POST /identity/v3/projects => generated 377 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:59:49.993195 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d88aea-eed7-4460-803f-c044c478c85d admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:59:50.003785 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d88aea-eed7-4460-803f-c044c478c85d admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:59:50.011754 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:59:50.061962 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4707657-7e6e-442d-8011-fda569365790 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:59:50.062574 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4707657-7e6e-442d-8011-fda569365790 admin admin] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:59:50.062877 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4707657-7e6e-442d-8011-fda569365790 admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:59:50.063232 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4707657-7e6e-442d-8011-fda569365790 admin admin] PATH_INFO: `/v3/users` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:59:50.063855 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4707657-7e6e-442d-8011-fda569365790 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:59:50.065981 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4707657-7e6e-442d-8011-fda569365790 admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:59:50.088983 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1423/2856] 10.222.0.26 () {60 vars in 1144 bytes} [Wed Aug 24 05:59:49 2022] POST /identity/v3/users => generated 289 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:59:50.093440 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf37504e-1659-4865-95b8-73604b3f134d admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:59:50.104130 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf37504e-1659-4865-95b8-73604b3f134d admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:59:50.109015 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876390b0-f9fc-4842-8d3a-185994010f96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:59:50.109667 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876390b0-f9fc-4842-8d3a-185994010f96 admin admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:59:50.109971 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876390b0-f9fc-4842-8d3a-185994010f96 admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:59:50.110245 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876390b0-f9fc-4842-8d3a-185994010f96 admin admin] PATH_INFO: `/v3/roles` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:59:50.110891 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876390b0-f9fc-4842-8d3a-185994010f96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:59:50.112483 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876390b0-f9fc-4842-8d3a-185994010f96 admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:59:50.122737 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1434/2857] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Aug 24 05:59:50 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:59:50.126681 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4707657-7e6e-442d-8011-fda569365790 admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:59:50.136738 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4707657-7e6e-442d-8011-fda569365790 admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:59:50.141601 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9827d3b-a724-496c-bc7d-0277238deba8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:59:50.142223 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9827d3b-a724-496c-bc7d-0277238deba8 admin admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:59:50.142505 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9827d3b-a724-496c-bc7d-0277238deba8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:59:50.143305 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9827d3b-a724-496c-bc7d-0277238deba8 admin admin] PATH_INFO: `/v3/roles` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:59:50.143946 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9827d3b-a724-496c-bc7d-0277238deba8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:59:50.145519 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9827d3b-a724-496c-bc7d-0277238deba8 admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:59:50.156245 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1424/2858] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Aug 24 05:59:50 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:59:50.160822 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876390b0-f9fc-4842-8d3a-185994010f96 admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:59:50.170590 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876390b0-f9fc-4842-8d3a-185994010f96 admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:59:50.175159 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2693c362-3dbc-4e17-bbac-e267abfad33c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:59:50.175789 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2693c362-3dbc-4e17-bbac-e267abfad33c admin admin] REQUEST_METHOD: `PUT` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:59:50.176069 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2693c362-3dbc-4e17-bbac-e267abfad33c admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:59:50.176343 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2693c362-3dbc-4e17-bbac-e267abfad33c admin admin] PATH_INFO: `/v3/projects/eb8d76813dfd437c8ce2fa1fdfbec8a6/users/5b8354d461c14e93b9ebb5105472ddbf/roles/f7aa4a2c74c94c1b9ca8ecdcccccda5c` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:59:50.190343 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2693c362-3dbc-4e17-bbac-e267abfad33c admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb8d76813dfd437c8ce2fa1fdfbec8a6, user_id=5b8354d461c14e93b9ebb5105472ddbf, role_id=f7aa4a2c74c94c1b9ca8ecdcccccda5c)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:59:50.192959 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2693c362-3dbc-4e17-bbac-e267abfad33c admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:59:50.206332 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1435/2859] 10.222.0.26 () {60 vars in 1483 bytes} [Wed Aug 24 05:59:50 2022] PUT /identity/v3/projects/eb8d76813dfd437c8ce2fa1fdfbec8a6/users/5b8354d461c14e93b9ebb5105472ddbf/roles/f7aa4a2c74c94c1b9ca8ecdcccccda5c => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:59:50.216601 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163d688c-994b-4481-841e-2e008c8fe58d None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:59:50.216889 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163d688c-994b-4481-841e-2e008c8fe58d None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:59:50.217198 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163d688c-994b-4481-841e-2e008c8fe58d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:59:50.244128 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-163d688c-994b-4481-841e-2e008c8fe58d None None] MFA Rules not processed for user `5b8354d461c14e93b9ebb5105472ddbf`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:59:50.245336 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-163d688c-994b-4481-841e-2e008c8fe58d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:59:50.307589 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1425/2860] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 05:59:50 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:59:50.318643 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2693c362-3dbc-4e17-bbac-e267abfad33c admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:59:50.320692 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-2693c362-3dbc-4e17-bbac-e267abfad33c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:59:50.372125 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:59:50.379125 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2693c362-3dbc-4e17-bbac-e267abfad33c admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:59:50.383632 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744282a1-07a5-4be1-941f-3b1a434370da service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17b450afe795495680fc70f522c83750', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:59:50.384251 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744282a1-07a5-4be1-941f-3b1a434370da service cinder] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:59:50.384527 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744282a1-07a5-4be1-941f-3b1a434370da service cinder] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:59:50.384793 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744282a1-07a5-4be1-941f-3b1a434370da service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:59:50.393556 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744282a1-07a5-4be1-941f-3b1a434370da service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:59:50.395050 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744282a1-07a5-4be1-941f-3b1a434370da service cinder] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:59:50.403588 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1436/2861] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 24 05:59:50 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 06:00:00.304862 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=61,keystone:INSERT=3 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:00:00.399768 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=5 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:00:03.862012 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163d688c-994b-4481-841e-2e008c8fe58d None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:00:03.924168 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163d688c-994b-4481-841e-2e008c8fe58d None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:00:03.929427 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9a6a3c-a640-4920-a9f8-c9ad4f333ca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:00:03.930089 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9a6a3c-a640-4920-a9f8-c9ad4f333ca5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:00:03.930367 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9a6a3c-a640-4920-a9f8-c9ad4f333ca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:00:03.930632 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9a6a3c-a640-4920-a9f8-c9ad4f333ca5 admin admin] PATH_INFO: `/v3/users/5b8354d461c14e93b9ebb5105472ddbf` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:00:03.931727 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9a6a3c-a640-4920-a9f8-c9ad4f333ca5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b8354d461c14e93b9ebb5105472ddbf)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:00:03.933622 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9a6a3c-a640-4920-a9f8-c9ad4f333ca5 admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:00:03.977749 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-5c9a6a3c-a640-4920-a9f8-c9ad4f333ca5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b8354d461c14e93b9ebb5105472ddbf'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:00:03.984450 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-5c9a6a3c-a640-4920-a9f8-c9ad4f333ca5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b8354d461c14e93b9ebb5105472ddbf'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:00:03.996513 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-5c9a6a3c-a640-4920-a9f8-c9ad4f333ca5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b8354d461c14e93b9ebb5105472ddbf'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:00:04.003728 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-5c9a6a3c-a640-4920-a9f8-c9ad4f333ca5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b8354d461c14e93b9ebb5105472ddbf'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:00:04.004352 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-5c9a6a3c-a640-4920-a9f8-c9ad4f333ca5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b8354d461c14e93b9ebb5105472ddbf'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:00:04.010227 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1426/2862] 10.222.0.26 () {58 vars in 1224 bytes} [Wed Aug 24 06:00:03 2022] DELETE /identity/v3/users/5b8354d461c14e93b9ebb5105472ddbf => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 06:00:04.014702 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4cd610-67f5-4a1d-903e-a460a22185e2 None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:00:04.015204 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4cd610-67f5-4a1d-903e-a460a22185e2 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:00:04.015311 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4cd610-67f5-4a1d-903e-a460a22185e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:00:04.034273 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-7a4cd610-67f5-4a1d-903e-a460a22185e2 None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:00:04.035484 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-7a4cd610-67f5-4a1d-903e-a460a22185e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:00:04.091505 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1437/2863] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 06:00:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:00:04.101509 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9a6a3c-a640-4920-a9f8-c9ad4f333ca5 admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:00:04.102917 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-5c9a6a3c-a640-4920-a9f8-c9ad4f333ca5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:00:04.164821 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9a6a3c-a640-4920-a9f8-c9ad4f333ca5 admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:00:04.168422 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bd77fc-533c-4007-91e3-8c1362162a06 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '874348b647194ac2b5ecbf12c33bf59e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:00:04.169023 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bd77fc-533c-4007-91e3-8c1362162a06 service neutron] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:00:04.169306 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bd77fc-533c-4007-91e3-8c1362162a06 service neutron] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:00:04.169577 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bd77fc-533c-4007-91e3-8c1362162a06 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:00:04.178974 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bd77fc-533c-4007-91e3-8c1362162a06 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:00:04.180398 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bd77fc-533c-4007-91e3-8c1362162a06 service neutron] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:00:04.189728 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1427/2864] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 24 06:00:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 06:00:04.443641 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4cd610-67f5-4a1d-903e-a460a22185e2 None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:00:04.445362 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-7a4cd610-67f5-4a1d-903e-a460a22185e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:00:04.457802 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4cd610-67f5-4a1d-903e-a460a22185e2 None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:00:04.462487 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67702b9c-5336-4972-af7a-a4d381bc7548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:00:04.463115 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67702b9c-5336-4972-af7a-a4d381bc7548 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:00:04.463388 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67702b9c-5336-4972-af7a-a4d381bc7548 admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:00:04.463684 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67702b9c-5336-4972-af7a-a4d381bc7548 admin admin] PATH_INFO: `/v3/projects/eb8d76813dfd437c8ce2fa1fdfbec8a6` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:00:04.464799 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67702b9c-5336-4972-af7a-a4d381bc7548 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb8d76813dfd437c8ce2fa1fdfbec8a6)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:00:04.466761 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67702b9c-5336-4972-af7a-a4d381bc7548 admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:00:04.514492 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-67702b9c-5336-4972-af7a-a4d381bc7548 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb8d76813dfd437c8ce2fa1fdfbec8a6', 'request_id': 'req-67702b9c-5336-4972-af7a-a4d381bc7548'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:00:04.522900 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-67702b9c-5336-4972-af7a-a4d381bc7548 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb8d76813dfd437c8ce2fa1fdfbec8a6', 'request_id': 'req-67702b9c-5336-4972-af7a-a4d381bc7548'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:00:04.529066 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-67702b9c-5336-4972-af7a-a4d381bc7548 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb8d76813dfd437c8ce2fa1fdfbec8a6', 'request_id': 'req-67702b9c-5336-4972-af7a-a4d381bc7548'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:00:04.539409 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-67702b9c-5336-4972-af7a-a4d381bc7548 admin admin] The token cache is being invalidate because project eb8d76813dfd437c8ce2fa1fdfbec8a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 06:00:04.539693 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-67702b9c-5336-4972-af7a-a4d381bc7548 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:00:04.540873 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-67702b9c-5336-4972-af7a-a4d381bc7548 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:00:04.541797 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1438/2865] 10.222.0.26 () {58 vars in 1233 bytes} [Wed Aug 24 06:00:04 2022] DELETE /identity/v3/projects/eb8d76813dfd437c8ce2fa1fdfbec8a6 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 06:00:04.546583 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21647195-7b71-4788-bfe1-ac399d87b0eb None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:00:04.546945 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21647195-7b71-4788-bfe1-ac399d87b0eb None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:00:04.547224 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21647195-7b71-4788-bfe1-ac399d87b0eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:00:04.567125 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-21647195-7b71-4788-bfe1-ac399d87b0eb None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:00:04.568317 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-21647195-7b71-4788-bfe1-ac399d87b0eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:00:04.584762 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:00:04.628010 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1428/2866] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 06:00:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:00:04.636675 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a701ee93-d963-4bcd-acfc-051a8e702764 None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:00:04.636964 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a701ee93-d963-4bcd-acfc-051a8e702764 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:00:04.637241 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a701ee93-d963-4bcd-acfc-051a8e702764 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:00:04.656997 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-a701ee93-d963-4bcd-acfc-051a8e702764 None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:00:04.658725 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-a701ee93-d963-4bcd-acfc-051a8e702764 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:00:04.666533 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1439/2867] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 06:00:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:00:04.670697 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21647195-7b71-4788-bfe1-ac399d87b0eb None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:00:04.680944 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21647195-7b71-4788-bfe1-ac399d87b0eb None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:00:04.685454 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e87863-5f2c-43e7-b13c-4ca1d049f0b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:00:04.686088 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e87863-5f2c-43e7-b13c-4ca1d049f0b5 admin admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:00:04.686373 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e87863-5f2c-43e7-b13c-4ca1d049f0b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:00:04.686647 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e87863-5f2c-43e7-b13c-4ca1d049f0b5 admin admin] PATH_INFO: `/v3/domains` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:00:04.687293 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e87863-5f2c-43e7-b13c-4ca1d049f0b5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:00:04.687597 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e87863-5f2c-43e7-b13c-4ca1d049f0b5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:00:04.689201 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e87863-5f2c-43e7-b13c-4ca1d049f0b5 admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:00:04.700664 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1429/2868] 10.222.0.26 () {58 vars in 1153 bytes} [Wed Aug 24 06:00:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:00:04.704765 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a701ee93-d963-4bcd-acfc-051a8e702764 None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:00:04.713891 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a701ee93-d963-4bcd-acfc-051a8e702764 None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:00:04.718525 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e861d56-d0da-44d3-8be3-e661eccaf03b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:00:04.719104 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e861d56-d0da-44d3-8be3-e661eccaf03b admin admin] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:00:04.719384 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e861d56-d0da-44d3-8be3-e661eccaf03b admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:00:04.719652 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e861d56-d0da-44d3-8be3-e661eccaf03b admin admin] PATH_INFO: `/v3/projects` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:00:04.720272 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e861d56-d0da-44d3-8be3-e661eccaf03b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:00:04.722686 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e861d56-d0da-44d3-8be3-e661eccaf03b admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:00:04.749186 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1440/2869] 10.222.0.26 () {60 vars in 1153 bytes} [Wed Aug 24 06:00:04 2022] POST /identity/v3/projects => generated 375 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 06:00:04.753332 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e87863-5f2c-43e7-b13c-4ca1d049f0b5 admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:00:04.763185 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e87863-5f2c-43e7-b13c-4ca1d049f0b5 admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:00:04.818200 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb81fa71-7cbb-4477-9910-94a32cb3060a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:00:04.818796 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb81fa71-7cbb-4477-9910-94a32cb3060a admin admin] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:00:04.819333 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb81fa71-7cbb-4477-9910-94a32cb3060a admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:00:04.819603 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb81fa71-7cbb-4477-9910-94a32cb3060a admin admin] PATH_INFO: `/v3/users` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:00:04.820210 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb81fa71-7cbb-4477-9910-94a32cb3060a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:00:04.822130 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb81fa71-7cbb-4477-9910-94a32cb3060a admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:00:04.842810 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1430/2870] 10.222.0.26 () {60 vars in 1144 bytes} [Wed Aug 24 06:00:04 2022] POST /identity/v3/users => generated 288 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 06:00:04.847467 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e861d56-d0da-44d3-8be3-e661eccaf03b admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:00:04.857590 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e861d56-d0da-44d3-8be3-e661eccaf03b admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:00:04.862692 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd454900-8e2c-44a9-9955-4c72926a7115 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:00:04.863280 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd454900-8e2c-44a9-9955-4c72926a7115 admin admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:00:04.863558 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd454900-8e2c-44a9-9955-4c72926a7115 admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:00:04.863829 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd454900-8e2c-44a9-9955-4c72926a7115 admin admin] PATH_INFO: `/v3/roles` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:00:04.864503 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd454900-8e2c-44a9-9955-4c72926a7115 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:00:04.866120 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd454900-8e2c-44a9-9955-4c72926a7115 admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:00:04.875771 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1441/2871] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Aug 24 06:00:04 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 06:00:04.879478 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb81fa71-7cbb-4477-9910-94a32cb3060a admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:00:04.889047 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb81fa71-7cbb-4477-9910-94a32cb3060a admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:00:04.893550 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114bd5f1-c90b-4ab9-a2d4-9807aa936f7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:00:04.894164 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114bd5f1-c90b-4ab9-a2d4-9807aa936f7e admin admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:00:04.894446 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114bd5f1-c90b-4ab9-a2d4-9807aa936f7e admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:00:04.894715 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114bd5f1-c90b-4ab9-a2d4-9807aa936f7e admin admin] PATH_INFO: `/v3/roles` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:00:04.895349 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114bd5f1-c90b-4ab9-a2d4-9807aa936f7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:00:04.896903 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114bd5f1-c90b-4ab9-a2d4-9807aa936f7e admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:00:04.907319 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1431/2872] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Aug 24 06:00:04 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 06:00:04.911767 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd454900-8e2c-44a9-9955-4c72926a7115 admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:00:04.921505 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd454900-8e2c-44a9-9955-4c72926a7115 admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:00:04.926725 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cfacfb-9ea8-484e-9076-92a8209228c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:00:04.927350 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cfacfb-9ea8-484e-9076-92a8209228c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:00:04.927627 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cfacfb-9ea8-484e-9076-92a8209228c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:00:04.927898 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cfacfb-9ea8-484e-9076-92a8209228c2 admin admin] PATH_INFO: `/v3/projects/c0828ccf7c6e4acba8190fa146dcf4d4/users/dabd24ceb3604a9e8e4ff2eb5ef6f08c/roles/f7aa4a2c74c94c1b9ca8ecdcccccda5c` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:00:04.942535 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cfacfb-9ea8-484e-9076-92a8209228c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0828ccf7c6e4acba8190fa146dcf4d4, user_id=dabd24ceb3604a9e8e4ff2eb5ef6f08c, role_id=f7aa4a2c74c94c1b9ca8ecdcccccda5c)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:00:04.945407 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cfacfb-9ea8-484e-9076-92a8209228c2 admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:00:04.957572 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1442/2873] 10.222.0.26 () {60 vars in 1483 bytes} [Wed Aug 24 06:00:04 2022] PUT /identity/v3/projects/c0828ccf7c6e4acba8190fa146dcf4d4/users/dabd24ceb3604a9e8e4ff2eb5ef6f08c/roles/f7aa4a2c74c94c1b9ca8ecdcccccda5c => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 06:00:04.967801 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70417623-40c8-451b-aa4a-145da5d03fd9 None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:00:04.968088 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70417623-40c8-451b-aa4a-145da5d03fd9 None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:00:04.968386 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70417623-40c8-451b-aa4a-145da5d03fd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:00:04.996001 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-70417623-40c8-451b-aa4a-145da5d03fd9 None None] MFA Rules not processed for user `dabd24ceb3604a9e8e4ff2eb5ef6f08c`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:00:04.997216 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-70417623-40c8-451b-aa4a-145da5d03fd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:00:05.059037 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1432/2874] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 06:00:04 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:00:05.069980 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cfacfb-9ea8-484e-9076-92a8209228c2 admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:00:05.071733 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-b9cfacfb-9ea8-484e-9076-92a8209228c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:00:05.093808 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:00:05.129989 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cfacfb-9ea8-484e-9076-92a8209228c2 admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:00:05.133569 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5eaf4b-e9cf-4fab-960d-41712cd47223 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17b450afe795495680fc70f522c83750', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:00:05.134197 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5eaf4b-e9cf-4fab-960d-41712cd47223 service cinder] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:00:05.134481 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5eaf4b-e9cf-4fab-960d-41712cd47223 service cinder] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:00:05.134754 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5eaf4b-e9cf-4fab-960d-41712cd47223 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:00:05.143324 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5eaf4b-e9cf-4fab-960d-41712cd47223 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:00:05.144751 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5eaf4b-e9cf-4fab-960d-41712cd47223 service cinder] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:00:05.153373 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1443/2875] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 24 06:00:05 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 06:00:08.137103 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70417623-40c8-451b-aa4a-145da5d03fd9 None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:00:08.157003 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:00:08.201559 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70417623-40c8-451b-aa4a-145da5d03fd9 None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:00:08.206599 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8fe559-324b-4be0-9db4-e7284c6b53cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:00:08.207220 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8fe559-324b-4be0-9db4-e7284c6b53cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:00:08.207523 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8fe559-324b-4be0-9db4-e7284c6b53cd admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:00:08.207796 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8fe559-324b-4be0-9db4-e7284c6b53cd admin admin] PATH_INFO: `/v3/users/dabd24ceb3604a9e8e4ff2eb5ef6f08c` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:00:08.208907 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8fe559-324b-4be0-9db4-e7284c6b53cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=dabd24ceb3604a9e8e4ff2eb5ef6f08c)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:00:08.210894 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8fe559-324b-4be0-9db4-e7284c6b53cd admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:00:08.255438 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-cf8fe559-324b-4be0-9db4-e7284c6b53cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dabd24ceb3604a9e8e4ff2eb5ef6f08c'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:00:08.262283 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-cf8fe559-324b-4be0-9db4-e7284c6b53cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dabd24ceb3604a9e8e4ff2eb5ef6f08c'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:00:08.274607 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-cf8fe559-324b-4be0-9db4-e7284c6b53cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dabd24ceb3604a9e8e4ff2eb5ef6f08c'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:00:08.281528 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-cf8fe559-324b-4be0-9db4-e7284c6b53cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dabd24ceb3604a9e8e4ff2eb5ef6f08c'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:00:08.282192 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-cf8fe559-324b-4be0-9db4-e7284c6b53cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dabd24ceb3604a9e8e4ff2eb5ef6f08c'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:00:08.288537 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1433/2876] 10.222.0.26 () {58 vars in 1224 bytes} [Wed Aug 24 06:00:08 2022] DELETE /identity/v3/users/dabd24ceb3604a9e8e4ff2eb5ef6f08c => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 06:00:08.293040 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92709629-0024-4f1b-b8b2-f4d0dacc057e None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:00:08.293522 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92709629-0024-4f1b-b8b2-f4d0dacc057e None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:00:08.293642 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92709629-0024-4f1b-b8b2-f4d0dacc057e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:00:08.311811 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-92709629-0024-4f1b-b8b2-f4d0dacc057e None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:00:08.312991 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-92709629-0024-4f1b-b8b2-f4d0dacc057e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:00:08.370988 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1444/2877] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 06:00:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:00:08.380989 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8fe559-324b-4be0-9db4-e7284c6b53cd admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:00:08.382444 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-cf8fe559-324b-4be0-9db4-e7284c6b53cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:00:08.443815 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8fe559-324b-4be0-9db4-e7284c6b53cd admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:00:08.447635 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3487f0-9d6f-40cf-aeda-3d1567ac614e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '874348b647194ac2b5ecbf12c33bf59e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:00:08.448228 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3487f0-9d6f-40cf-aeda-3d1567ac614e service neutron] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:00:08.448504 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3487f0-9d6f-40cf-aeda-3d1567ac614e service neutron] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:00:08.448771 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3487f0-9d6f-40cf-aeda-3d1567ac614e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:00:08.458203 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3487f0-9d6f-40cf-aeda-3d1567ac614e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:00:08.459611 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3487f0-9d6f-40cf-aeda-3d1567ac614e service neutron] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:00:08.468780 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1434/2878] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 24 06:00:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 06:00:08.730941 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92709629-0024-4f1b-b8b2-f4d0dacc057e None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:00:08.732444 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-92709629-0024-4f1b-b8b2-f4d0dacc057e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:00:08.746788 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92709629-0024-4f1b-b8b2-f4d0dacc057e None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:00:08.751416 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33520e1-bf05-43b3-b5ac-21951f2e2c21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:00:08.752047 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33520e1-bf05-43b3-b5ac-21951f2e2c21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:00:08.752331 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33520e1-bf05-43b3-b5ac-21951f2e2c21 admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:00:08.753102 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33520e1-bf05-43b3-b5ac-21951f2e2c21 admin admin] PATH_INFO: `/v3/projects/c0828ccf7c6e4acba8190fa146dcf4d4` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:00:08.754434 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33520e1-bf05-43b3-b5ac-21951f2e2c21 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c0828ccf7c6e4acba8190fa146dcf4d4)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:00:08.756352 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33520e1-bf05-43b3-b5ac-21951f2e2c21 admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:00:08.802829 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-e33520e1-bf05-43b3-b5ac-21951f2e2c21 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c0828ccf7c6e4acba8190fa146dcf4d4', 'request_id': 'req-e33520e1-bf05-43b3-b5ac-21951f2e2c21'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:00:08.809896 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-e33520e1-bf05-43b3-b5ac-21951f2e2c21 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c0828ccf7c6e4acba8190fa146dcf4d4', 'request_id': 'req-e33520e1-bf05-43b3-b5ac-21951f2e2c21'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:00:08.816192 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-e33520e1-bf05-43b3-b5ac-21951f2e2c21 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c0828ccf7c6e4acba8190fa146dcf4d4', 'request_id': 'req-e33520e1-bf05-43b3-b5ac-21951f2e2c21'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:00:08.826670 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-e33520e1-bf05-43b3-b5ac-21951f2e2c21 admin admin] The token cache is being invalidate because project c0828ccf7c6e4acba8190fa146dcf4d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 06:00:08.826955 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-e33520e1-bf05-43b3-b5ac-21951f2e2c21 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:00:08.827586 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-e33520e1-bf05-43b3-b5ac-21951f2e2c21 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:00:08.829038 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1445/2879] 10.222.0.26 () {58 vars in 1233 bytes} [Wed Aug 24 06:00:08 2022] DELETE /identity/v3/projects/c0828ccf7c6e4acba8190fa146dcf4d4 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 06:00:08.834443 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8960a71-0066-4535-8837-cb19affe002e None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:00:08.834730 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8960a71-0066-4535-8837-cb19affe002e None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:00:08.835004 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8960a71-0066-4535-8837-cb19affe002e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:00:08.854199 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-c8960a71-0066-4535-8837-cb19affe002e None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:00:08.855386 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-c8960a71-0066-4535-8837-cb19affe002e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:00:08.888259 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:00:08.915923 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1435/2880] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 06:00:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:00:08.923708 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9488a68-ad0f-4829-b25d-086d443efe26 None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:00:08.924025 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9488a68-ad0f-4829-b25d-086d443efe26 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:00:08.924322 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9488a68-ad0f-4829-b25d-086d443efe26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:00:08.943505 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-f9488a68-ad0f-4829-b25d-086d443efe26 None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:00:08.944969 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-f9488a68-ad0f-4829-b25d-086d443efe26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:00:08.952880 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1446/2881] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 06:00:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:00:08.957509 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8960a71-0066-4535-8837-cb19affe002e None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:00:08.967090 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8960a71-0066-4535-8837-cb19affe002e None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:00:08.971719 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3f9564-b241-4031-b813-7d883c9f5ca9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:00:08.972871 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3f9564-b241-4031-b813-7d883c9f5ca9 admin admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:00:08.973182 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3f9564-b241-4031-b813-7d883c9f5ca9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:00:08.973452 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3f9564-b241-4031-b813-7d883c9f5ca9 admin admin] PATH_INFO: `/v3/domains` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:00:08.974135 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3f9564-b241-4031-b813-7d883c9f5ca9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88112) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:00:08.974441 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3f9564-b241-4031-b813-7d883c9f5ca9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:00:08.976028 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3f9564-b241-4031-b813-7d883c9f5ca9 admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:00:08.987259 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1436/2882] 10.222.0.26 () {58 vars in 1153 bytes} [Wed Aug 24 06:00:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:00:08.991406 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9488a68-ad0f-4829-b25d-086d443efe26 None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:00:09.000488 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9488a68-ad0f-4829-b25d-086d443efe26 None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:00:09.005041 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f3cc14-3748-4413-95a9-ad52ded98d95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:00:09.005621 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f3cc14-3748-4413-95a9-ad52ded98d95 admin admin] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:00:09.005897 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f3cc14-3748-4413-95a9-ad52ded98d95 admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:00:09.006192 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f3cc14-3748-4413-95a9-ad52ded98d95 admin admin] PATH_INFO: `/v3/projects` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:00:09.006815 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f3cc14-3748-4413-95a9-ad52ded98d95 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:00:09.008726 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f3cc14-3748-4413-95a9-ad52ded98d95 admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:00:09.036102 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1447/2883] 10.222.0.26 () {60 vars in 1153 bytes} [Wed Aug 24 06:00:08 2022] POST /identity/v3/projects => generated 381 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 06:00:09.040260 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3f9564-b241-4031-b813-7d883c9f5ca9 admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:00:09.050312 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3f9564-b241-4031-b813-7d883c9f5ca9 admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:00:09.107408 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c8015a-bdd1-48dd-8a7a-866b3a8acb1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:00:09.108009 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c8015a-bdd1-48dd-8a7a-866b3a8acb1c admin admin] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:00:09.108287 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c8015a-bdd1-48dd-8a7a-866b3a8acb1c admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:00:09.108555 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c8015a-bdd1-48dd-8a7a-866b3a8acb1c admin admin] PATH_INFO: `/v3/users` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:00:09.109181 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c8015a-bdd1-48dd-8a7a-866b3a8acb1c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:00:09.111112 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c8015a-bdd1-48dd-8a7a-866b3a8acb1c admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:00:09.131505 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1437/2884] 10.222.0.26 () {60 vars in 1144 bytes} [Wed Aug 24 06:00:09 2022] POST /identity/v3/users => generated 291 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 06:00:09.135606 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f3cc14-3748-4413-95a9-ad52ded98d95 admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:00:09.146231 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f3cc14-3748-4413-95a9-ad52ded98d95 admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:00:09.150699 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95daaf5-a6a4-41d4-855a-f38fdcd8ff82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:00:09.151279 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95daaf5-a6a4-41d4-855a-f38fdcd8ff82 admin admin] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:00:09.151554 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95daaf5-a6a4-41d4-855a-f38fdcd8ff82 admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:00:09.151821 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95daaf5-a6a4-41d4-855a-f38fdcd8ff82 admin admin] PATH_INFO: `/v3/roles` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:00:09.152457 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95daaf5-a6a4-41d4-855a-f38fdcd8ff82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:00:09.154062 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95daaf5-a6a4-41d4-855a-f38fdcd8ff82 admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:00:09.163654 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1448/2885] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Aug 24 06:00:09 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 06:00:09.167606 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c8015a-bdd1-48dd-8a7a-866b3a8acb1c admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:00:09.177456 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c8015a-bdd1-48dd-8a7a-866b3a8acb1c admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:00:09.182196 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0130fc4f-79d0-47a6-abfa-f96c14dc0f53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:00:09.182792 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0130fc4f-79d0-47a6-abfa-f96c14dc0f53 admin admin] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:00:09.183071 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0130fc4f-79d0-47a6-abfa-f96c14dc0f53 admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:00:09.183347 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0130fc4f-79d0-47a6-abfa-f96c14dc0f53 admin admin] PATH_INFO: `/v3/roles` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:00:09.183990 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0130fc4f-79d0-47a6-abfa-f96c14dc0f53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:00:09.185565 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0130fc4f-79d0-47a6-abfa-f96c14dc0f53 admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:00:09.196839 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1438/2886] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Aug 24 06:00:09 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 06:00:09.200850 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95daaf5-a6a4-41d4-855a-f38fdcd8ff82 admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:00:09.211373 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95daaf5-a6a4-41d4-855a-f38fdcd8ff82 admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:00:09.215843 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd61601-407b-4141-933b-4b27e6da6ba4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:00:09.216472 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd61601-407b-4141-933b-4b27e6da6ba4 admin admin] REQUEST_METHOD: `PUT` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:00:09.216749 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd61601-407b-4141-933b-4b27e6da6ba4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:00:09.217016 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd61601-407b-4141-933b-4b27e6da6ba4 admin admin] PATH_INFO: `/v3/projects/b49320e574044166b1552e317c5d35b0/users/feca13f589b34956af265a10dcc46459/roles/f7aa4a2c74c94c1b9ca8ecdcccccda5c` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:00:09.219190 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:00:09.233336 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd61601-407b-4141-933b-4b27e6da6ba4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b49320e574044166b1552e317c5d35b0, user_id=feca13f589b34956af265a10dcc46459, role_id=f7aa4a2c74c94c1b9ca8ecdcccccda5c)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:00:09.236019 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd61601-407b-4141-933b-4b27e6da6ba4 admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:00:09.248053 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1449/2887] 10.222.0.26 () {60 vars in 1483 bytes} [Wed Aug 24 06:00:09 2022] PUT /identity/v3/projects/b49320e574044166b1552e317c5d35b0/users/feca13f589b34956af265a10dcc46459/roles/f7aa4a2c74c94c1b9ca8ecdcccccda5c => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 06:00:09.253282 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc88c3ac-af7f-4ab0-8c5c-a1fce5451631 None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:00:09.254139 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc88c3ac-af7f-4ab0-8c5c-a1fce5451631 None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:00:09.254415 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc88c3ac-af7f-4ab0-8c5c-a1fce5451631 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:00:09.273192 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-bc88c3ac-af7f-4ab0-8c5c-a1fce5451631 None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:00:09.274435 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-bc88c3ac-af7f-4ab0-8c5c-a1fce5451631 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:00:09.331250 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1439/2888] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 06:00:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:00:09.341402 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd61601-407b-4141-933b-4b27e6da6ba4 admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:00:09.343110 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-fbd61601-407b-4141-933b-4b27e6da6ba4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:00:09.398728 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd61601-407b-4141-933b-4b27e6da6ba4 admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:00:09.402325 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1faa075e-7ce4-497a-9e5a-0357e79ddd7c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '874348b647194ac2b5ecbf12c33bf59e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:00:09.402916 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faa075e-7ce4-497a-9e5a-0357e79ddd7c service neutron] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:00:09.403193 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faa075e-7ce4-497a-9e5a-0357e79ddd7c service neutron] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:00:09.403462 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faa075e-7ce4-497a-9e5a-0357e79ddd7c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:00:09.412157 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1faa075e-7ce4-497a-9e5a-0357e79ddd7c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:00:09.413580 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1faa075e-7ce4-497a-9e5a-0357e79ddd7c service neutron] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:00:09.422872 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1450/2889] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 24 06:00:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 06:00:10.009087 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e251eb4-9ff6-4762-b712-f7f261357d29 None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:00:10.009379 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e251eb4-9ff6-4762-b712-f7f261357d29 None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:00:10.009662 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e251eb4-9ff6-4762-b712-f7f261357d29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:00:10.038220 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-1e251eb4-9ff6-4762-b712-f7f261357d29 None None] MFA Rules not processed for user `feca13f589b34956af265a10dcc46459`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:00:10.039470 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-1e251eb4-9ff6-4762-b712-f7f261357d29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:00:10.074314 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:00:10.108545 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1440/2890] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 06:00:10 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:00:10.119819 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1faa075e-7ce4-497a-9e5a-0357e79ddd7c service neutron] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:00:10.121209 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-1faa075e-7ce4-497a-9e5a-0357e79ddd7c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:00:10.185984 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1faa075e-7ce4-497a-9e5a-0357e79ddd7c service neutron] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:00:10.189627 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bad35b-2ded-4fd3-8dec-093413fd01af service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17b450afe795495680fc70f522c83750', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:00:10.190206 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bad35b-2ded-4fd3-8dec-093413fd01af service cinder] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:00:10.190486 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bad35b-2ded-4fd3-8dec-093413fd01af service cinder] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:00:10.190754 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bad35b-2ded-4fd3-8dec-093413fd01af service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:00:10.199427 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bad35b-2ded-4fd3-8dec-093413fd01af service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:00:10.200888 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bad35b-2ded-4fd3-8dec-093413fd01af service cinder] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:00:10.210420 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1451/2891] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 24 06:00:10 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 06:00:11.559117 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fe25c6-ba2e-483e-a4de-dbd343541071 None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:00:11.559588 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fe25c6-ba2e-483e-a4de-dbd343541071 None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:00:11.559687 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fe25c6-ba2e-483e-a4de-dbd343541071 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:00:11.578588 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-c8fe25c6-ba2e-483e-a4de-dbd343541071 None None] MFA Rules not processed for user `feca13f589b34956af265a10dcc46459`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:00:11.579786 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-c8fe25c6-ba2e-483e-a4de-dbd343541071 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:00:11.586528 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1441/2892] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 06:00:11 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:00:20.205747 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=59,keystone:INSERT=1 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:00:21.573422 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=14 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:00:41.937138 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb328827-f933-43f7-a50b-788885845ec8 None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:00:41.937704 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb328827-f933-43f7-a50b-788885845ec8 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:00:41.937704 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb328827-f933-43f7-a50b-788885845ec8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:00:41.957228 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-eb328827-f933-43f7-a50b-788885845ec8 None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:00:41.958453 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-eb328827-f933-43f7-a50b-788885845ec8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:00:41.966219 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1452/2893] 10.222.0.17 () {58 vars in 1016 bytes} [Wed Aug 24 06:00:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:00:41.987820 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fe25c6-ba2e-483e-a4de-dbd343541071 None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:00:41.989515 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-c8fe25c6-ba2e-483e-a4de-dbd343541071 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:00:42.061035 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fe25c6-ba2e-483e-a4de-dbd343541071 None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:00:42.066411 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24b55ce-ae9d-4881-8f9e-00f08c1ae2fe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b633e1aec6c4269bce13aa9c89e911a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:00:42.067006 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24b55ce-ae9d-4881-8f9e-00f08c1ae2fe service nova] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:00:42.067282 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24b55ce-ae9d-4881-8f9e-00f08c1ae2fe service nova] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:00:42.067549 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24b55ce-ae9d-4881-8f9e-00f08c1ae2fe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:00:42.076295 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24b55ce-ae9d-4881-8f9e-00f08c1ae2fe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:00:42.077850 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24b55ce-ae9d-4881-8f9e-00f08c1ae2fe service nova] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:00:42.088812 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1442/2894] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 24 06:00:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 06:00:44.984471 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14046443-d98e-47ce-8b24-97dfd17acfe4 None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:00:44.985043 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14046443-d98e-47ce-8b24-97dfd17acfe4 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:00:44.985043 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14046443-d98e-47ce-8b24-97dfd17acfe4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:00:45.004688 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-14046443-d98e-47ce-8b24-97dfd17acfe4 None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:00:45.005886 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-14046443-d98e-47ce-8b24-97dfd17acfe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:00:45.013748 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1453/2895] 10.222.0.17 () {58 vars in 1016 bytes} [Wed Aug 24 06:00:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:00:45.038689 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24b55ce-ae9d-4881-8f9e-00f08c1ae2fe service nova] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:00:45.040562 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-c24b55ce-ae9d-4881-8f9e-00f08c1ae2fe service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:00:45.055856 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24b55ce-ae9d-4881-8f9e-00f08c1ae2fe service nova] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:00:45.061435 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd88764f-f427-4eb2-9d4c-0582f1c0e2ee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b633e1aec6c4269bce13aa9c89e911a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:00:45.062146 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd88764f-f427-4eb2-9d4c-0582f1c0e2ee service nova] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:00:45.066534 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd88764f-f427-4eb2-9d4c-0582f1c0e2ee service nova] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:00:45.066813 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd88764f-f427-4eb2-9d4c-0582f1c0e2ee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:00:45.079612 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd88764f-f427-4eb2-9d4c-0582f1c0e2ee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:00:45.081391 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd88764f-f427-4eb2-9d4c-0582f1c0e2ee service nova] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:00:45.091184 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1443/2896] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 24 06:00:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 06:00:48.231884 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe28e1d1-6ba9-436c-8488-9e0d092c8baa None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:00:48.232401 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe28e1d1-6ba9-436c-8488-9e0d092c8baa None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:00:48.232522 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe28e1d1-6ba9-436c-8488-9e0d092c8baa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:00:48.251274 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-fe28e1d1-6ba9-436c-8488-9e0d092c8baa None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:00:48.252460 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-fe28e1d1-6ba9-436c-8488-9e0d092c8baa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:00:48.260711 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1454/2897] 10.222.0.17 () {58 vars in 1016 bytes} [Wed Aug 24 06:00:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:00:48.280350 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd88764f-f427-4eb2-9d4c-0582f1c0e2ee service nova] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:00:48.291577 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd88764f-f427-4eb2-9d4c-0582f1c0e2ee service nova] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:00:48.297038 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcd929d-f395-48b6-90ad-720e39a03656 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b633e1aec6c4269bce13aa9c89e911a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:00:48.297626 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcd929d-f395-48b6-90ad-720e39a03656 service nova] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:00:48.297910 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcd929d-f395-48b6-90ad-720e39a03656 service nova] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:00:48.298213 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcd929d-f395-48b6-90ad-720e39a03656 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:00:48.306665 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcd929d-f395-48b6-90ad-720e39a03656 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:00:48.308231 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcd929d-f395-48b6-90ad-720e39a03656 service nova] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:00:48.317597 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1444/2898] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 24 06:00:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 06:00:51.317502 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41249027-21b3-4766-a8a2-14cc388d80a9 None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:00:51.317980 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41249027-21b3-4766-a8a2-14cc388d80a9 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:00:51.318103 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41249027-21b3-4766-a8a2-14cc388d80a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:00:51.337885 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-41249027-21b3-4766-a8a2-14cc388d80a9 None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:00:51.339116 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-41249027-21b3-4766-a8a2-14cc388d80a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:00:51.346712 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1455/2899] 10.222.0.17 () {58 vars in 1016 bytes} [Wed Aug 24 06:00:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:00:51.370089 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcd929d-f395-48b6-90ad-720e39a03656 service nova] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:00:51.381458 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcd929d-f395-48b6-90ad-720e39a03656 service nova] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:00:51.387316 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7391d75e-e658-4893-826e-e1b7590fcd74 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b633e1aec6c4269bce13aa9c89e911a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:00:51.387898 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7391d75e-e658-4893-826e-e1b7590fcd74 service nova] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:00:51.388175 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7391d75e-e658-4893-826e-e1b7590fcd74 service nova] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:00:51.388444 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7391d75e-e658-4893-826e-e1b7590fcd74 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:00:51.396317 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7391d75e-e658-4893-826e-e1b7590fcd74 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:00:51.397873 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7391d75e-e658-4893-826e-e1b7590fcd74 service nova] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:00:51.407092 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1445/2900] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 24 06:00:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 06:00:55.507056 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ba8556-d9c5-4d31-be7f-22cf4feaac19 None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:00:55.507518 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ba8556-d9c5-4d31-be7f-22cf4feaac19 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:00:55.507644 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ba8556-d9c5-4d31-be7f-22cf4feaac19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:00:55.527605 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-79ba8556-d9c5-4d31-be7f-22cf4feaac19 None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:00:55.528793 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-79ba8556-d9c5-4d31-be7f-22cf4feaac19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:00:55.536660 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1456/2901] 10.222.0.17 () {58 vars in 1016 bytes} [Wed Aug 24 06:00:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:00:55.560244 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7391d75e-e658-4893-826e-e1b7590fcd74 service nova] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:00:55.571658 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7391d75e-e658-4893-826e-e1b7590fcd74 service nova] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:00:55.577250 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb80bd77-d73f-4c51-a242-1b0ce84f6fa2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b633e1aec6c4269bce13aa9c89e911a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:00:55.577859 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb80bd77-d73f-4c51-a242-1b0ce84f6fa2 service nova] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:00:55.578164 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb80bd77-d73f-4c51-a242-1b0ce84f6fa2 service nova] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:00:55.578437 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb80bd77-d73f-4c51-a242-1b0ce84f6fa2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:00:55.586602 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb80bd77-d73f-4c51-a242-1b0ce84f6fa2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:00:55.588203 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb80bd77-d73f-4c51-a242-1b0ce84f6fa2 service nova] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:00:55.597453 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1446/2902] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 24 06:00:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 06:00:58.678395 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bb93c5-4a9e-4b6e-b833-84334c296805 None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:00:58.678904 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bb93c5-4a9e-4b6e-b833-84334c296805 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:00:58.679022 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bb93c5-4a9e-4b6e-b833-84334c296805 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:00:58.699705 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-00bb93c5-4a9e-4b6e-b833-84334c296805 None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:00:58.700918 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-00bb93c5-4a9e-4b6e-b833-84334c296805 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:00:58.708846 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1457/2903] 10.222.0.17 () {58 vars in 1016 bytes} [Wed Aug 24 06:00:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:00:58.732839 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb80bd77-d73f-4c51-a242-1b0ce84f6fa2 service nova] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:00:58.744890 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb80bd77-d73f-4c51-a242-1b0ce84f6fa2 service nova] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:00:58.750277 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca67b3c-195b-4358-84da-6ea4a7281716 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b633e1aec6c4269bce13aa9c89e911a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:00:58.750863 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca67b3c-195b-4358-84da-6ea4a7281716 service nova] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:00:58.751156 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca67b3c-195b-4358-84da-6ea4a7281716 service nova] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:00:58.751420 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca67b3c-195b-4358-84da-6ea4a7281716 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:00:58.759377 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca67b3c-195b-4358-84da-6ea4a7281716 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:00:58.760968 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca67b3c-195b-4358-84da-6ea4a7281716 service nova] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:00:58.770706 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1447/2904] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 24 06:00:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 06:01:08.693489 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=18 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:01:08.766328 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=64 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:01:09.017297 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bb93c5-4a9e-4b6e-b833-84334c296805 None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:01:09.018797 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-00bb93c5-4a9e-4b6e-b833-84334c296805 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:01:09.030701 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bb93c5-4a9e-4b6e-b833-84334c296805 None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:01:09.034210 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315474bf-5de3-4770-961b-ee79cb1b2b79 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '874348b647194ac2b5ecbf12c33bf59e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:01:09.034807 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315474bf-5de3-4770-961b-ee79cb1b2b79 service neutron] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:01:09.035084 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315474bf-5de3-4770-961b-ee79cb1b2b79 service neutron] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:01:09.035354 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315474bf-5de3-4770-961b-ee79cb1b2b79 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:01:09.037039 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-315474bf-5de3-4770-961b-ee79cb1b2b79 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:01:09.050971 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315474bf-5de3-4770-961b-ee79cb1b2b79 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:01:09.052384 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315474bf-5de3-4770-961b-ee79cb1b2b79 service neutron] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:01:09.064833 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1458/2905] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 24 06:01:09 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 06:01:13.765557 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac7129d-284c-4f05-800f-5f42a9d5a67d None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:01:13.766051 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac7129d-284c-4f05-800f-5f42a9d5a67d None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:01:13.766166 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac7129d-284c-4f05-800f-5f42a9d5a67d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:01:13.784873 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-bac7129d-284c-4f05-800f-5f42a9d5a67d None None] MFA Rules not processed for user `feca13f589b34956af265a10dcc46459`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:01:13.786152 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-bac7129d-284c-4f05-800f-5f42a9d5a67d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:01:13.793715 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1448/2906] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 24 06:01:13 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:01:14.326505 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315474bf-5de3-4770-961b-ee79cb1b2b79 service neutron] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:01:14.335138 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315474bf-5de3-4770-961b-ee79cb1b2b79 service neutron] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:01:14.338686 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8595c0-a9ef-4bd2-af8c-9b1d465bf098 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '874348b647194ac2b5ecbf12c33bf59e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:01:14.339936 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8595c0-a9ef-4bd2-af8c-9b1d465bf098 service neutron] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:01:14.340212 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8595c0-a9ef-4bd2-af8c-9b1d465bf098 service neutron] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:01:14.340479 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8595c0-a9ef-4bd2-af8c-9b1d465bf098 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:01:14.342206 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-5b8595c0-a9ef-4bd2-af8c-9b1d465bf098 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:01:14.355406 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8595c0-a9ef-4bd2-af8c-9b1d465bf098 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:01:14.356834 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8595c0-a9ef-4bd2-af8c-9b1d465bf098 service neutron] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:01:14.368174 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1459/2907] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 24 06:01:14 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 06:01:15.861602 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac7129d-284c-4f05-800f-5f42a9d5a67d None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:01:15.871864 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac7129d-284c-4f05-800f-5f42a9d5a67d None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:01:15.875612 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10747d8a-0b64-435d-bb7e-b7512b4961c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '874348b647194ac2b5ecbf12c33bf59e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:01:15.876196 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10747d8a-0b64-435d-bb7e-b7512b4961c9 service neutron] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:01:15.876481 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10747d8a-0b64-435d-bb7e-b7512b4961c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:01:15.876752 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10747d8a-0b64-435d-bb7e-b7512b4961c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:01:15.878519 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-10747d8a-0b64-435d-bb7e-b7512b4961c9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:01:15.938418 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10747d8a-0b64-435d-bb7e-b7512b4961c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:01:15.939860 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10747d8a-0b64-435d-bb7e-b7512b4961c9 service neutron] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:01:15.949398 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1449/2908] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 24 06:01:15 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 06:01:16.950518 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8595c0-a9ef-4bd2-af8c-9b1d465bf098 service neutron] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:01:16.963190 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8595c0-a9ef-4bd2-af8c-9b1d465bf098 service neutron] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:01:16.969380 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cda1966-79f1-4d88-8064-ff937dd1a9f7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b633e1aec6c4269bce13aa9c89e911a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:01:16.970476 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cda1966-79f1-4d88-8064-ff937dd1a9f7 service nova] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:01:16.970758 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cda1966-79f1-4d88-8064-ff937dd1a9f7 service nova] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:01:16.971024 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cda1966-79f1-4d88-8064-ff937dd1a9f7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:01:16.973212 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-1cda1966-79f1-4d88-8064-ff937dd1a9f7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:01:16.987475 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cda1966-79f1-4d88-8064-ff937dd1a9f7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:01:16.989395 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cda1966-79f1-4d88-8064-ff937dd1a9f7 service nova] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:01:17.002808 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1460/2909] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 24 06:01:16 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 06:01:23.062999 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10747d8a-0b64-435d-bb7e-b7512b4961c9 service neutron] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:01:23.072084 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10747d8a-0b64-435d-bb7e-b7512b4961c9 service neutron] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:01:23.076882 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74df2d42-a710-446b-ba63-7c8fd4a294db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '874348b647194ac2b5ecbf12c33bf59e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:01:23.077416 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74df2d42-a710-446b-ba63-7c8fd4a294db service neutron] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:01:23.077696 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74df2d42-a710-446b-ba63-7c8fd4a294db service neutron] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:01:23.077991 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74df2d42-a710-446b-ba63-7c8fd4a294db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:01:23.079762 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-74df2d42-a710-446b-ba63-7c8fd4a294db service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:01:23.092540 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74df2d42-a710-446b-ba63-7c8fd4a294db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:01:23.094002 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74df2d42-a710-446b-ba63-7c8fd4a294db service neutron] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:01:23.105149 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1450/2910] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 24 06:01:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 06:01:26.196919 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cda1966-79f1-4d88-8064-ff937dd1a9f7 service nova] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:01:26.199184 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-1cda1966-79f1-4d88-8064-ff937dd1a9f7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:01:26.294583 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cda1966-79f1-4d88-8064-ff937dd1a9f7 service nova] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:01:26.305265 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264b048c-7462-48a1-9974-f9c27a490997 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '995ebe690b7748c9842bc0696415fc52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:01:26.306855 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264b048c-7462-48a1-9974-f9c27a490997 service placement] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:01:26.307140 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264b048c-7462-48a1-9974-f9c27a490997 service placement] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:01:26.307415 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264b048c-7462-48a1-9974-f9c27a490997 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:01:26.312821 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-264b048c-7462-48a1-9974-f9c27a490997 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:01:26.326267 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264b048c-7462-48a1-9974-f9c27a490997 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:01:26.327910 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264b048c-7462-48a1-9974-f9c27a490997 service placement] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:01:26.338311 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1461/2911] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 24 06:01:26 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 06:01:29.529055 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74df2d42-a710-446b-ba63-7c8fd4a294db service neutron] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:01:29.530731 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-74df2d42-a710-446b-ba63-7c8fd4a294db service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:01:29.545688 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74df2d42-a710-446b-ba63-7c8fd4a294db service neutron] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:01:29.550574 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8753f47a-2563-4417-92d9-3d8871fe99e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:01:29.551219 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8753f47a-2563-4417-92d9-3d8871fe99e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:01:29.551501 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8753f47a-2563-4417-92d9-3d8871fe99e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:01:29.551779 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8753f47a-2563-4417-92d9-3d8871fe99e5 admin admin] PATH_INFO: `/v3/users/aca1ac97884743198ce912f892b2644d` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:01:29.552946 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8753f47a-2563-4417-92d9-3d8871fe99e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aca1ac97884743198ce912f892b2644d)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:01:29.555130 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8753f47a-2563-4417-92d9-3d8871fe99e5 admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:01:29.607876 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-8753f47a-2563-4417-92d9-3d8871fe99e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aca1ac97884743198ce912f892b2644d'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:01:29.615618 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-8753f47a-2563-4417-92d9-3d8871fe99e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aca1ac97884743198ce912f892b2644d'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:01:29.629204 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-8753f47a-2563-4417-92d9-3d8871fe99e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aca1ac97884743198ce912f892b2644d'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:01:29.637353 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-8753f47a-2563-4417-92d9-3d8871fe99e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aca1ac97884743198ce912f892b2644d'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:01:29.638295 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-8753f47a-2563-4417-92d9-3d8871fe99e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aca1ac97884743198ce912f892b2644d'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:01:29.638426 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42c6e3b-323d-45af-ac5b-5bb4fedc9439 None None] REQUEST_METHOD: `POST` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:01:29.638888 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42c6e3b-323d-45af-ac5b-5bb4fedc9439 None None] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:01:29.639023 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42c6e3b-323d-45af-ac5b-5bb4fedc9439 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:01:29.647495 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1451/2912] 10.222.0.26 () {58 vars in 1224 bytes} [Wed Aug 24 06:01:29 2022] DELETE /identity/v3/users/aca1ac97884743198ce912f892b2644d => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 06:01:29.664073 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.auth.core [None req-e42c6e3b-323d-45af-ac5b-5bb4fedc9439 None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:01:29.665295 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-e42c6e3b-323d-45af-ac5b-5bb4fedc9439 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:01:29.729199 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1462/2913] 10.222.0.17 () {58 vars in 1016 bytes} [Wed Aug 24 06:01:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 06:01:29.750388 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8753f47a-2563-4417-92d9-3d8871fe99e5 admin admin] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:01:29.751896 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-8753f47a-2563-4417-92d9-3d8871fe99e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:01:29.814282 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:01:29.828040 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42c6e3b-323d-45af-ac5b-5bb4fedc9439 None None] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:01:29.829676 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-e42c6e3b-323d-45af-ac5b-5bb4fedc9439 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:01:29.847377 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8753f47a-2563-4417-92d9-3d8871fe99e5 admin admin] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:01:29.858841 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e93588-4adb-4242-8625-528bb67de5c5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b633e1aec6c4269bce13aa9c89e911a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:01:29.859458 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e93588-4adb-4242-8625-528bb67de5c5 service nova] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:01:29.859739 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e93588-4adb-4242-8625-528bb67de5c5 service nova] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:01:29.860009 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e93588-4adb-4242-8625-528bb67de5c5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:01:29.860640 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42c6e3b-323d-45af-ac5b-5bb4fedc9439 None None] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:01:29.865481 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f31854-d154-4cc6-9d46-bc4a46cd71e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:01:29.866315 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f31854-d154-4cc6-9d46-bc4a46cd71e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:01:29.866667 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f31854-d154-4cc6-9d46-bc4a46cd71e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:01:29.867144 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f31854-d154-4cc6-9d46-bc4a46cd71e9 admin admin] PATH_INFO: `/v3/projects/938d6d4db870409a8d2d15586ab1b0ec` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:01:29.868320 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f31854-d154-4cc6-9d46-bc4a46cd71e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=938d6d4db870409a8d2d15586ab1b0ec)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:01:29.870867 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f31854-d154-4cc6-9d46-bc4a46cd71e9 admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:01:29.875709 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e93588-4adb-4242-8625-528bb67de5c5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:01:29.878118 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e93588-4adb-4242-8625-528bb67de5c5 service nova] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:01:29.888717 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1452/2914] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 24 06:01:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 06:01:29.921371 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:01:29.924998 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-54f31854-d154-4cc6-9d46-bc4a46cd71e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '938d6d4db870409a8d2d15586ab1b0ec', 'request_id': 'req-54f31854-d154-4cc6-9d46-bc4a46cd71e9'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:01:29.933735 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-54f31854-d154-4cc6-9d46-bc4a46cd71e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '938d6d4db870409a8d2d15586ab1b0ec', 'request_id': 'req-54f31854-d154-4cc6-9d46-bc4a46cd71e9'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:01:29.940636 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-54f31854-d154-4cc6-9d46-bc4a46cd71e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '938d6d4db870409a8d2d15586ab1b0ec', 'request_id': 'req-54f31854-d154-4cc6-9d46-bc4a46cd71e9'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:01:29.958280 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-54f31854-d154-4cc6-9d46-bc4a46cd71e9 admin admin] The token cache is being invalidate because project 938d6d4db870409a8d2d15586ab1b0ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 06:01:29.958574 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-54f31854-d154-4cc6-9d46-bc4a46cd71e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:01:29.959392 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-54f31854-d154-4cc6-9d46-bc4a46cd71e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:01:29.961126 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1463/2915] 10.222.0.26 () {58 vars in 1233 bytes} [Wed Aug 24 06:01:29 2022] DELETE /identity/v3/projects/938d6d4db870409a8d2d15586ab1b0ec => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 06:01:29.965200 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e93588-4adb-4242-8625-528bb67de5c5 service nova] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:01:29.975027 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e93588-4adb-4242-8625-528bb67de5c5 service nova] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:01:30.033984 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4addc89b-e1b4-4bea-8627-e491537f5422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:01:30.034521 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4addc89b-e1b4-4bea-8627-e491537f5422 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:01:30.035007 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4addc89b-e1b4-4bea-8627-e491537f5422 admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:01:30.035113 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4addc89b-e1b4-4bea-8627-e491537f5422 admin admin] PATH_INFO: `/v3/users/cee8dc4ad3764d74b184a3262ac9d334` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:01:30.036170 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4addc89b-e1b4-4bea-8627-e491537f5422 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cee8dc4ad3764d74b184a3262ac9d334)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:01:30.038117 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4addc89b-e1b4-4bea-8627-e491537f5422 admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:01:30.085379 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-4addc89b-e1b4-4bea-8627-e491537f5422 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cee8dc4ad3764d74b184a3262ac9d334'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:01:30.092458 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-4addc89b-e1b4-4bea-8627-e491537f5422 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cee8dc4ad3764d74b184a3262ac9d334'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:01:30.104166 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-4addc89b-e1b4-4bea-8627-e491537f5422 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cee8dc4ad3764d74b184a3262ac9d334'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:01:30.111519 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-4addc89b-e1b4-4bea-8627-e491537f5422 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cee8dc4ad3764d74b184a3262ac9d334'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:01:30.112187 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-4addc89b-e1b4-4bea-8627-e491537f5422 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cee8dc4ad3764d74b184a3262ac9d334'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:01:30.118052 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1453/2916] 10.222.0.26 () {58 vars in 1224 bytes} [Wed Aug 24 06:01:29 2022] DELETE /identity/v3/users/cee8dc4ad3764d74b184a3262ac9d334 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 06:01:30.294404 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f31854-d154-4cc6-9d46-bc4a46cd71e9 admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:01:30.295921 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-54f31854-d154-4cc6-9d46-bc4a46cd71e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:01:30.313835 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f31854-d154-4cc6-9d46-bc4a46cd71e9 admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:01:30.374311 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897ddc2d-c95d-4f4b-8387-da52e9397a69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:01:30.374939 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897ddc2d-c95d-4f4b-8387-da52e9397a69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:01:30.375246 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897ddc2d-c95d-4f4b-8387-da52e9397a69 admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:01:30.375518 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897ddc2d-c95d-4f4b-8387-da52e9397a69 admin admin] PATH_INFO: `/v3/projects/b1ee4f2e7e114c9b82fae57b6bf53282` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:01:30.376628 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897ddc2d-c95d-4f4b-8387-da52e9397a69 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b1ee4f2e7e114c9b82fae57b6bf53282)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:01:30.378578 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897ddc2d-c95d-4f4b-8387-da52e9397a69 admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:01:30.425598 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-897ddc2d-c95d-4f4b-8387-da52e9397a69 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b1ee4f2e7e114c9b82fae57b6bf53282', 'request_id': 'req-897ddc2d-c95d-4f4b-8387-da52e9397a69'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:01:30.432306 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-897ddc2d-c95d-4f4b-8387-da52e9397a69 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b1ee4f2e7e114c9b82fae57b6bf53282', 'request_id': 'req-897ddc2d-c95d-4f4b-8387-da52e9397a69'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:01:30.438438 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-897ddc2d-c95d-4f4b-8387-da52e9397a69 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b1ee4f2e7e114c9b82fae57b6bf53282', 'request_id': 'req-897ddc2d-c95d-4f4b-8387-da52e9397a69'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:01:30.448996 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-897ddc2d-c95d-4f4b-8387-da52e9397a69 admin admin] The token cache is being invalidate because project b1ee4f2e7e114c9b82fae57b6bf53282 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 06:01:30.449281 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-897ddc2d-c95d-4f4b-8387-da52e9397a69 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:01:30.449906 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-897ddc2d-c95d-4f4b-8387-da52e9397a69 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:01:30.451641 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1464/2917] 10.222.0.26 () {58 vars in 1233 bytes} [Wed Aug 24 06:01:30 2022] DELETE /identity/v3/projects/b1ee4f2e7e114c9b82fae57b6bf53282 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 06:01:32.886759 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8e9d81-8284-4cf9-9f39-095ad03b741b None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:01:32.887312 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8e9d81-8284-4cf9-9f39-095ad03b741b None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:01:32.887312 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8e9d81-8284-4cf9-9f39-095ad03b741b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:01:32.907075 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-0f8e9d81-8284-4cf9-9f39-095ad03b741b None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:01:32.908291 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-0f8e9d81-8284-4cf9-9f39-095ad03b741b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:01:32.954576 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:01:32.967838 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1454/2918] 10.222.0.17 () {58 vars in 1016 bytes} [Wed Aug 24 06:01:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:01:32.991372 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897ddc2d-c95d-4f4b-8387-da52e9397a69 admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:01:32.992830 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-897ddc2d-c95d-4f4b-8387-da52e9397a69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:01:33.059006 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:DELETE=11,keystone:SELECT=87,keystone:INSERT=2 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:01:33.065871 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897ddc2d-c95d-4f4b-8387-da52e9397a69 admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:01:33.072731 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1498c23-f1c8-4973-a474-aea4513106cb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b633e1aec6c4269bce13aa9c89e911a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:01:33.073885 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1498c23-f1c8-4973-a474-aea4513106cb service nova] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:01:33.074214 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1498c23-f1c8-4973-a474-aea4513106cb service nova] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:01:33.074491 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1498c23-f1c8-4973-a474-aea4513106cb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:01:33.082655 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1498c23-f1c8-4973-a474-aea4513106cb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:01:33.084335 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1498c23-f1c8-4973-a474-aea4513106cb service nova] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:01:33.094556 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1465/2919] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 24 06:01:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 06:01:35.966143 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d87d9c4-f51a-4f15-b5ab-5a0da253a17d None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:01:35.966665 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d87d9c4-f51a-4f15-b5ab-5a0da253a17d None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:01:35.966781 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d87d9c4-f51a-4f15-b5ab-5a0da253a17d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:01:35.986273 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-8d87d9c4-f51a-4f15-b5ab-5a0da253a17d None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:01:35.987470 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-8d87d9c4-f51a-4f15-b5ab-5a0da253a17d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:01:35.995876 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1455/2920] 10.222.0.17 () {58 vars in 1016 bytes} [Wed Aug 24 06:01:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:01:36.015263 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1498c23-f1c8-4973-a474-aea4513106cb service nova] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:01:36.016671 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-f1498c23-f1c8-4973-a474-aea4513106cb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:01:36.031290 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1498c23-f1c8-4973-a474-aea4513106cb service nova] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:01:36.036771 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facda78e-cbb1-4ea5-b645-3b1b44f481b7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b633e1aec6c4269bce13aa9c89e911a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:01:36.037356 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facda78e-cbb1-4ea5-b645-3b1b44f481b7 service nova] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:01:36.037638 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facda78e-cbb1-4ea5-b645-3b1b44f481b7 service nova] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:01:36.037912 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facda78e-cbb1-4ea5-b645-3b1b44f481b7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:01:36.046468 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facda78e-cbb1-4ea5-b645-3b1b44f481b7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:01:36.048031 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facda78e-cbb1-4ea5-b645-3b1b44f481b7 service nova] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:01:36.057923 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1466/2921] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 24 06:01:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 06:01:39.129285 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3db670-a504-4ac6-9fd2-820d316204c0 None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:01:39.129786 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3db670-a504-4ac6-9fd2-820d316204c0 None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:01:39.129899 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3db670-a504-4ac6-9fd2-820d316204c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:01:39.149069 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-1c3db670-a504-4ac6-9fd2-820d316204c0 None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:01:39.150310 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-1c3db670-a504-4ac6-9fd2-820d316204c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:01:39.158382 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1456/2922] 10.222.0.17 () {58 vars in 1016 bytes} [Wed Aug 24 06:01:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:01:39.180647 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facda78e-cbb1-4ea5-b645-3b1b44f481b7 service nova] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:01:39.192472 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facda78e-cbb1-4ea5-b645-3b1b44f481b7 service nova] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:01:39.198149 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb44627-68f0-4072-bf56-233d9d1118d8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b633e1aec6c4269bce13aa9c89e911a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:01:39.198734 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb44627-68f0-4072-bf56-233d9d1118d8 service nova] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:01:39.199009 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb44627-68f0-4072-bf56-233d9d1118d8 service nova] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:01:39.199276 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb44627-68f0-4072-bf56-233d9d1118d8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:01:39.207200 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb44627-68f0-4072-bf56-233d9d1118d8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:01:39.208755 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb44627-68f0-4072-bf56-233d9d1118d8 service nova] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:01:39.218598 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1467/2923] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 24 06:01:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 06:01:43.317743 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60afb96c-7be1-4bc4-9d60-caa64a198721 None None] REQUEST_METHOD: `POST` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:01:43.318294 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60afb96c-7be1-4bc4-9d60-caa64a198721 None None] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:01:43.318294 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60afb96c-7be1-4bc4-9d60-caa64a198721 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:01:43.338581 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.auth.core [None req-60afb96c-7be1-4bc4-9d60-caa64a198721 None None] MFA Rules not processed for user `f35a18a67d5646f5b515c46f902c78fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88112) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:01:43.339792 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-60afb96c-7be1-4bc4-9d60-caa64a198721 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:01:43.347634 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1457/2924] 10.222.0.17 () {58 vars in 1016 bytes} [Wed Aug 24 06:01:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:01:43.369005 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb44627-68f0-4072-bf56-233d9d1118d8 service nova] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:01:43.380822 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb44627-68f0-4072-bf56-233d9d1118d8 service nova] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:01:43.386392 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec03a6f-b17a-4755-be58-f3dd37d84430 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b633e1aec6c4269bce13aa9c89e911a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:01:43.386981 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec03a6f-b17a-4755-be58-f3dd37d84430 service nova] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:01:43.387262 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec03a6f-b17a-4755-be58-f3dd37d84430 service nova] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:01:43.387537 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec03a6f-b17a-4755-be58-f3dd37d84430 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:01:43.395629 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec03a6f-b17a-4755-be58-f3dd37d84430 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:01:43.397209 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec03a6f-b17a-4755-be58-f3dd37d84430 service nova] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:01:43.406510 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1468/2925] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 24 06:01:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 06:01:52.993706 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60afb96c-7be1-4bc4-9d60-caa64a198721 None None] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:01:53.007373 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60afb96c-7be1-4bc4-9d60-caa64a198721 None None] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:01:53.014252 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb763858-435f-45f4-8f79-10c1ac221eab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b633e1aec6c4269bce13aa9c89e911a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:01:53.014865 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb763858-435f-45f4-8f79-10c1ac221eab service nova] REQUEST_METHOD: `GET` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:01:53.015179 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb763858-435f-45f4-8f79-10c1ac221eab service nova] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:01:53.015456 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb763858-435f-45f4-8f79-10c1ac221eab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:01:53.017187 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.fernet_utils [None req-bb763858-435f-45f4-8f79-10c1ac221eab service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88112) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:01:53.031632 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb763858-435f-45f4-8f79-10c1ac221eab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:01:53.033228 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb763858-435f-45f4-8f79-10c1ac221eab service nova] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:01:53.045091 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1458/2926] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 24 06:01:52 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 06:01:53.402409 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=23 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:02:03.039396 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=17 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:02:12.254666 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec03a6f-b17a-4755-be58-f3dd37d84430 service nova] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:02:12.256177 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-4ec03a6f-b17a-4755-be58-f3dd37d84430 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:02:12.270669 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec03a6f-b17a-4755-be58-f3dd37d84430 service nova] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:02:12.275190 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5e21e6-8852-4c45-a7c9-2f48fc029697 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:02:12.275805 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5e21e6-8852-4c45-a7c9-2f48fc029697 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:02:12.276082 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5e21e6-8852-4c45-a7c9-2f48fc029697 admin admin] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:02:12.276353 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5e21e6-8852-4c45-a7c9-2f48fc029697 admin admin] PATH_INFO: `/v3/users/feca13f589b34956af265a10dcc46459` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:02:12.277473 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5e21e6-8852-4c45-a7c9-2f48fc029697 admin admin] RBAC: Authorizing `identity:delete_user(user_id=feca13f589b34956af265a10dcc46459)` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:02:12.279405 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5e21e6-8852-4c45-a7c9-2f48fc029697 admin admin] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:02:12.325135 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-1e5e21e6-8852-4c45-a7c9-2f48fc029697 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'feca13f589b34956af265a10dcc46459'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:02:12.331787 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-1e5e21e6-8852-4c45-a7c9-2f48fc029697 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'feca13f589b34956af265a10dcc46459'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:02:12.332449 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-1e5e21e6-8852-4c45-a7c9-2f48fc029697 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'feca13f589b34956af265a10dcc46459'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:02:12.344503 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-1e5e21e6-8852-4c45-a7c9-2f48fc029697 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'feca13f589b34956af265a10dcc46459'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:02:12.350743 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.notifications [None req-1e5e21e6-8852-4c45-a7c9-2f48fc029697 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'feca13f589b34956af265a10dcc46459'} {{(pid=88113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:02:12.357042 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1469/2927] 10.222.0.26 () {58 vars in 1224 bytes} [Wed Aug 24 06:02:12 2022] DELETE /identity/v3/users/feca13f589b34956af265a10dcc46459 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 06:02:12.529431 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb763858-435f-45f4-8f79-10c1ac221eab service nova] Authenticating user token {{(pid=88112) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:02:12.540826 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb763858-435f-45f4-8f79-10c1ac221eab service nova] Validating token access rules against request {{(pid=88112) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:02:12.598905 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46422881-f585-4eff-a15f-c3160ab51264 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f35a18a67d5646f5b515c46f902c78fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e0475c5e4ae4451b23bd74342fbe5f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88112) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:02:12.599466 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46422881-f585-4eff-a15f-c3160ab51264 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:02:12.599748 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46422881-f585-4eff-a15f-c3160ab51264 admin admin] SCRIPT_NAME: `/identity` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:02:12.600019 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46422881-f585-4eff-a15f-c3160ab51264 admin admin] PATH_INFO: `/v3/projects/b49320e574044166b1552e317c5d35b0` {{(pid=88112) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:02:12.601121 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46422881-f585-4eff-a15f-c3160ab51264 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b49320e574044166b1552e317c5d35b0)` {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:02:12.603052 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46422881-f585-4eff-a15f-c3160ab51264 admin admin] RBAC: Authorization granted {{(pid=88112) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:02:12.649440 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-46422881-f585-4eff-a15f-c3160ab51264 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b49320e574044166b1552e317c5d35b0', 'request_id': 'req-46422881-f585-4eff-a15f-c3160ab51264'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:02:12.656938 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-46422881-f585-4eff-a15f-c3160ab51264 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b49320e574044166b1552e317c5d35b0', 'request_id': 'req-46422881-f585-4eff-a15f-c3160ab51264'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:02:12.662969 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-46422881-f585-4eff-a15f-c3160ab51264 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b49320e574044166b1552e317c5d35b0', 'request_id': 'req-46422881-f585-4eff-a15f-c3160ab51264'} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:02:12.672991 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-46422881-f585-4eff-a15f-c3160ab51264 admin admin] The token cache is being invalidate because project b49320e574044166b1552e317c5d35b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88112) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 06:02:12.673277 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-46422881-f585-4eff-a15f-c3160ab51264 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:02:12.673893 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG keystone.notifications [None req-46422881-f585-4eff-a15f-c3160ab51264 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88112) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:02:12.675402 dv-cinder-854268-1-smb devstack@keystone.service[88112]: [pid: 88112|app: 0|req: 1459/2928] 10.222.0.26 () {58 vars in 1233 bytes} [Wed Aug 24 06:02:12 2022] DELETE /identity/v3/projects/b49320e574044166b1552e317c5d35b0 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 06:02:22.353006 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=29,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:02:22.670097 dv-cinder-854268-1-smb devstack@keystone.service[88112]: DEBUG dbcounter [-] [88112] Writing DB stats keystone:SELECT=51,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:04:15.789714 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5e21e6-8852-4c45-a7c9-2f48fc029697 admin admin] Authenticating user token {{(pid=88113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:04:15.791175 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-1e5e21e6-8852-4c45-a7c9-2f48fc029697 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:04:15.927656 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5e21e6-8852-4c45-a7c9-2f48fc029697 admin admin] Validating token access rules against request {{(pid=88113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:04:15.986476 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511617e6-d289-4d7e-af09-8f4b3b9f6134 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '995ebe690b7748c9842bc0696415fc52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ded4fe81d4dc43188dd84e53025ee783', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:04:15.987080 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511617e6-d289-4d7e-af09-8f4b3b9f6134 service placement] REQUEST_METHOD: `GET` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:04:15.987359 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511617e6-d289-4d7e-af09-8f4b3b9f6134 service placement] SCRIPT_NAME: `/identity` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:04:15.987633 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511617e6-d289-4d7e-af09-8f4b3b9f6134 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:04:15.989457 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.fernet_utils [None req-511617e6-d289-4d7e-af09-8f4b3b9f6134 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:04:16.000682 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511617e6-d289-4d7e-af09-8f4b3b9f6134 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:04:16.002278 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511617e6-d289-4d7e-af09-8f4b3b9f6134 service placement] RBAC: Authorization granted {{(pid=88113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:04:16.012567 dv-cinder-854268-1-smb devstack@keystone.service[88113]: [pid: 88113|app: 0|req: 1470/2929] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 24 06:04:15 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 06:04:26.007774 dv-cinder-854268-1-smb devstack@keystone.service[88113]: DEBUG dbcounter [-] [88113] Writing DB stats keystone:SELECT=89 {{(pid=88113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}